Nov 29 01:32:10 user nova-compute[75210]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75210) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75210) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75210) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 29 01:32:10 user nova-compute[75210]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:32:10 user nova-compute[75210]: INFO nova.virt.driver [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 29 01:32:10 user nova-compute[75210]: INFO nova.compute.provider_config [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] Acquiring lock "singleton_lock" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] Acquired lock "singleton_lock" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] Releasing lock "singleton_lock" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] Full set of CONF: {{(pid=75210) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ******************************************************************************** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] Configuration options gathered from: {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ================================================================================ {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] allow_resize_to_same_host      = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] arq_binding_timeout            = 300 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] backdoor_port                  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] backdoor_socket                = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] block_device_allocate_retries  = 300 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] block_device_allocate_retries_interval = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cert                           = self.pem {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute_monitors               = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] config_dir                     = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] config_drive_format            = iso9660 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] config_source                  = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] console_host                   = user {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] control_exchange               = nova {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cpu_allocation_ratio           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] daemon                         = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] debug                          = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] default_access_ip_network_name = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] default_availability_zone      = nova {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] default_ephemeral_format       = ext4 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] default_green_pool_size        = 1000 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] default_schedule_zone          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] disk_allocation_ratio          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] enable_new_services            = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] enabled_ssl_apis               = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] flat_injected                  = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] force_config_drive             = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] force_raw_images               = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] graceful_shutdown_timeout      = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] heal_instance_info_cache_interval = 60 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] host                           = user {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] instance_build_timeout         = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] instance_delete_interval       = 300 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] instance_name_template         = instance-%08x {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] instance_usage_audit           = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] instance_usage_audit_period    = month {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] internal_service_availability_zone = internal {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] key                            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] live_migration_retry_count     = 30 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] log_config_append              = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] log_dir                        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] log_file                       = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] log_options                    = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] log_rotate_interval            = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] log_rotate_interval_type       = days {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] log_rotation_type              = none {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] long_rpc_timeout               = 1800 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] max_concurrent_builds          = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] max_concurrent_live_migrations = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] max_concurrent_snapshots       = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] max_local_block_devices        = 3 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] max_logfile_count              = 30 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] max_logfile_size_mb            = 200 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] maximum_instance_delete_attempts = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] metadata_listen                = 0.0.0.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] metadata_listen_port           = 8775 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] metadata_workers               = 3 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] migrate_max_retries            = -1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] mkisofs_cmd                    = genisoimage {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] my_ip                          = 10.0.0.210 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] network_allocate_retries       = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] osapi_compute_listen_port      = 8774 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] osapi_compute_unique_server_name_scope =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] osapi_compute_workers          = 3 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] password_length                = 12 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] periodic_enable                = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] periodic_fuzzy_delay           = 60 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] pointer_model                  = ps2mouse {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] preallocate_images             = none {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] publish_errors                 = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] pybasedir                      = /opt/stack/nova {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ram_allocation_ratio           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] rate_limit_burst               = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] rate_limit_except_level        = CRITICAL {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] rate_limit_interval            = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] reboot_timeout                 = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] reclaim_instance_interval      = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] record                         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] reimage_timeout_per_gb         = 60 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] report_interval                = 120 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] rescue_timeout                 = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] reserved_host_cpus             = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] reserved_host_disk_mb          = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] reserved_host_memory_mb        = 512 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] reserved_huge_pages            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] resize_confirm_window          = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] resize_fs_using_block_device   = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] resume_guests_state_on_host_boot = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] rpc_response_timeout           = 60 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] run_external_periodic_tasks    = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] running_deleted_instance_action = reap {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] running_deleted_instance_timeout = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] scheduler_instance_sync_interval = 120 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] service_down_time              = 720 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] servicegroup_driver            = db {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] shelved_offload_time           = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] shelved_poll_interval          = 3600 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] shutdown_timeout               = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] source_is_ipv6                 = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ssl_only                       = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] state_path                     = /opt/stack/data/nova {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] sync_power_state_interval      = 600 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] sync_power_state_pool_size     = 1000 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] syslog_log_facility            = LOG_USER {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] tempdir                        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] timeout_nbd                    = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] transport_url                  = **** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] update_resources_interval      = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] use_cow_images                 = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] use_eventlog                   = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] use_journal                    = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] use_json                       = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] use_rootwrap_daemon            = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] use_stderr                     = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] use_syslog                     = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vcpu_pin_set                   = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plugging_is_fatal          = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plugging_timeout           = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] virt_mkfs                      = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] volume_usage_poll_interval     = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] watch_log_file                 = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] web                            = /usr/share/spice-html5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_concurrency.disable_process_locking = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.auth_strategy              = keystone {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.compute_link_prefix        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.dhcp_domain                = novalocal {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.enable_instance_password   = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.glance_link_prefix         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.instance_list_per_project_cells = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.list_records_by_skipping_down_cells = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.local_metadata_per_cell    = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.max_limit                  = 1000 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.metadata_cache_expiration  = 15 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.neutron_default_tenant_id  = default {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.use_forwarded_for          = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.use_neutron_default_nets   = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.vendordata_dynamic_targets = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.vendordata_jsonfile_path   = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.backend_argument         = **** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.config_prefix            = cache.oslo {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.dead_timeout             = 60.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.debug_cache_backend      = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.enable_retry_client      = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.enable_socket_keepalive  = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.enabled                  = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.expiration_time          = 600 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.hashclient_retry_attempts = 2 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.memcache_dead_retry      = 300 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.memcache_password        =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.memcache_sasl_enabled    = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.memcache_username        =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.proxies                  = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.retry_attempts           = 2 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.retry_delay              = 0.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.socket_keepalive_count   = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.socket_keepalive_idle    = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.socket_keepalive_interval = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.tls_allowed_ciphers      = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.tls_cafile               = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.tls_certfile             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.tls_enabled              = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cache.tls_keyfile              = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.auth_section            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.auth_type               = password {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.cafile                  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.certfile                = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.collect_timing          = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.cross_az_attach         = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.debug                   = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.endpoint_template       = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.http_retries            = 3 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.insecure                = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.keyfile                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.os_region_name          = RegionOne {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.split_loggers           = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cinder.timeout                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute.cpu_dedicated_set      = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute.cpu_shared_set         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute.image_type_exclude_list = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute.resource_provider_association_refresh = 300 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute.shutdown_retry_interval = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] conductor.workers              = 3 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] console.allowed_origins        = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] console.ssl_ciphers            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] console.ssl_minimum_version    = default {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] consoleauth.token_ttl          = 600 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.cafile                  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.certfile                = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.collect_timing          = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.connect_retries         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.connect_retry_delay     = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.endpoint_override       = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.insecure                = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.keyfile                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.max_version             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.min_version             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.region_name             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.service_name            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.service_type            = accelerator {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.split_loggers           = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.status_code_retries     = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.status_code_retry_delay = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.timeout                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] cyborg.version                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.backend               = sqlalchemy {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.connection            = **** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.connection_debug      = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.connection_parameters =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.connection_recycle_time = 3600 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.connection_trace      = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.db_inc_retry_interval = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.db_max_retries        = 20 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.db_max_retry_interval = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.db_retry_interval     = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.max_overflow          = 50 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.max_pool_size         = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.max_retries           = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.mysql_wsrep_sync_wait = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.pool_timeout          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.retry_interval        = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.slave_connection      = **** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] database.sqlite_synchronous    = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.backend           = sqlalchemy {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.connection        = **** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.connection_debug  = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.connection_parameters =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.connection_recycle_time = 3600 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.connection_trace  = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.db_inc_retry_interval = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.db_max_retries    = 20 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.db_max_retry_interval = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.db_retry_interval = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.max_overflow      = 50 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.max_pool_size     = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.max_retries       = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.pool_timeout      = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.retry_interval    = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.slave_connection  = **** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] api_database.sqlite_synchronous = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] devices.enabled_mdev_types     = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ephemeral_storage_encryption.enabled = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.api_servers             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.cafile                  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.certfile                = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.collect_timing          = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.connect_retries         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.connect_retry_delay     = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.debug                   = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.default_trusted_certificate_ids = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.enable_certificate_validation = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.enable_rbd_download     = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.endpoint_override       = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.insecure                = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.keyfile                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.max_version             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.min_version             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.num_retries             = 3 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.rbd_ceph_conf           =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.rbd_connect_timeout     = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.rbd_pool                =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.rbd_user                =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.region_name             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.service_name            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.service_type            = image {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.split_loggers           = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.status_code_retries     = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.status_code_retry_delay = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.timeout                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.verify_glance_signatures = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] glance.version                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] guestfs.debug                  = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.config_drive_cdrom      = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.config_drive_inject_password = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.enable_remotefx         = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.instances_path_share    =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.limit_cpu_features      = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.use_multipath_io        = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.vswitch_name            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] mks.enabled                    = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] image_cache.manager_interval   = 2400 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] image_cache.precache_concurrency = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] image_cache.remove_unused_base_images = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] image_cache.subdirectory_name  = _base {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.api_max_retries         = 60 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.api_retry_interval      = 2 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.auth_section            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.auth_type               = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.cafile                  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.certfile                = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.collect_timing          = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.conductor_group         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.connect_retries         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.connect_retry_delay     = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.endpoint_override       = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.insecure                = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.keyfile                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.max_version             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.min_version             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.peer_list               = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.region_name             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.serial_console_state_timeout = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.service_name            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.service_type            = baremetal {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.split_loggers           = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.status_code_retries     = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.status_code_retry_delay = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.timeout                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ironic.version                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] key_manager.fixed_key          = **** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.barbican_api_version  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.barbican_endpoint     = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.barbican_endpoint_type = public {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.barbican_region_name  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.cafile                = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.certfile              = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.collect_timing        = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.insecure              = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.keyfile               = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.number_of_retries     = 60 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.retry_delay           = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.send_service_user_token = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.split_loggers         = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.timeout               = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.verify_ssl            = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican.verify_ssl_path       = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican_service_user.auth_section = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican_service_user.auth_type = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican_service_user.cafile   = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican_service_user.certfile = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican_service_user.collect_timing = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican_service_user.insecure = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican_service_user.keyfile  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican_service_user.split_loggers = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] barbican_service_user.timeout  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.approle_role_id          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.approle_secret_id        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.cafile                   = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.certfile                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.collect_timing           = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.insecure                 = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.keyfile                  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.kv_mountpoint            = secret {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.kv_path                  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.kv_version               = 2 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.namespace                = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.root_token_id            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.split_loggers            = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.ssl_ca_crt_file          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.timeout                  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.use_ssl                  = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.auth_section          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.auth_type             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.cafile                = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.certfile              = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.collect_timing        = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.connect_retries       = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.connect_retry_delay   = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.endpoint_override     = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.insecure              = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.keyfile               = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.max_version           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.min_version           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.region_name           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.service_name          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.service_type          = identity {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.split_loggers         = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.status_code_retries   = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.status_code_retry_delay = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.timeout               = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] keystone.version               = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.connection_uri         =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.cpu_mode               = custom {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: WARNING oslo_config.cfg [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.cpu_power_governor_high = performance {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.cpu_power_management   = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.device_detach_attempts = 8 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.device_detach_timeout  = 20 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.disk_cachemodes        = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.disk_prefix            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.enabled_perf_events    = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.file_backed_memory     = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.gid_maps               = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.hw_disk_discard        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.hw_machine_type        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.images_rbd_pool        = rbd {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.images_type            = default {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.images_volume_group    = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.inject_key             = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.inject_partition       = -2 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.inject_password        = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.iscsi_iface            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.iser_use_multipath     = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.live_migration_downtime = 500 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.live_migration_inbound_addr = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.live_migration_scheme  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.live_migration_timeout_action = abort {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.live_migration_tunnelled = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: WARNING oslo_config.cfg [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 29 01:32:10 user nova-compute[75210]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 29 01:32:10 user nova-compute[75210]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 29 01:32:10 user nova-compute[75210]: and ``live_migration_inbound_addr`` respectively.
Nov 29 01:32:10 user nova-compute[75210]: ).  Its value may be silently ignored in the future.
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.live_migration_with_native_tls = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.max_queues             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.nfs_mount_options      = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.num_pcie_ports         = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.pmem_namespaces        = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.quobyte_client_cfg     = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.rbd_secret_uuid        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.rbd_user               = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.rescue_image_id        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.rescue_kernel_id       = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.rx_queue_size          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.smbfs_mount_options    =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.snapshot_compression   = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.snapshot_image_format  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.sparse_logical_volumes = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.swtpm_enabled          = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.swtpm_group            = tss {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.swtpm_user             = tss {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.sysinfo_serial         = unique {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.tb_cache_size          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.tx_queue_size          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.uid_maps               = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.use_virtio_for_bridges = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.virt_type              = kvm {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.volume_clear           = zero {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.volume_clear_size      = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.volume_use_multipath   = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.vzstorage_cache_path   = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.auth_section           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.auth_type              = password {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.cafile                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.certfile               = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.collect_timing         = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.connect_retries        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.connect_retry_delay    = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.default_floating_pool  = public {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.endpoint_override      = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.extension_sync_interval = 600 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.http_retries           = 3 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.insecure               = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.keyfile                = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.max_version            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.min_version            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.ovs_bridge             = br-int {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.physnets               = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.region_name            = RegionOne {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.service_metadata_proxy = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.service_name           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.service_type           = network {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.split_loggers          = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.status_code_retries    = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.status_code_retry_delay = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.timeout                = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] neutron.version                = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] notifications.bdms_in_notifications = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] notifications.default_level    = INFO {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] notifications.notification_format = unversioned {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] notifications.notify_on_state_change = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] pci.alias                      = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] pci.device_spec                = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] pci.report_in_placement        = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.auth_section         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.auth_type            = password {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.cafile               = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.certfile             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.collect_timing       = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.connect_retries      = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.connect_retry_delay  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.default_domain_id    = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.default_domain_name  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.domain_id            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.domain_name          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.endpoint_override    = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.insecure             = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.keyfile              = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.max_version          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.min_version          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.password             = **** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.project_domain_id    = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.project_domain_name  = Default {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.project_id           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.project_name         = service {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.region_name          = RegionOne {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.service_name         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.service_type         = placement {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.split_loggers        = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.status_code_retries  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.status_code_retry_delay = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.system_scope         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.timeout              = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.trust_id             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.user_domain_id       = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.user_domain_name     = Default {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.user_id              = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.username             = placement {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] placement.version              = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] quota.cores                    = 20 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] quota.count_usage_from_placement = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] quota.injected_file_content_bytes = 10240 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] quota.injected_file_path_length = 255 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] quota.injected_files           = 5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] quota.instances                = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] quota.key_pairs                = 100 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] quota.metadata_items           = 128 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] quota.ram                      = 51200 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] quota.recheck_quota            = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] quota.server_group_members     = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] quota.server_groups            = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] rdp.enabled                    = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] scheduler.image_metadata_prefilter = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] scheduler.max_attempts         = 3 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] scheduler.max_placement_results = 1000 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] scheduler.workers              = 3 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.host_subset_size = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.isolated_hosts = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.isolated_images = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.pci_in_placement = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.track_instance_changes = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] metrics.required               = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] metrics.weight_multiplier      = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] metrics.weight_setting         = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] serial_console.enabled         = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] serial_console.port_range      = 10000:20000 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] serial_console.serialproxy_port = 6083 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] service_user.auth_section      = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] service_user.auth_type         = password {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] service_user.cafile            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] service_user.certfile          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] service_user.collect_timing    = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] service_user.insecure          = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] service_user.keyfile           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] service_user.send_service_user_token = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] service_user.split_loggers     = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] service_user.timeout           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] spice.agent_enabled            = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] spice.enabled                  = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] spice.html5proxy_port          = 6082 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] spice.image_compression        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] spice.jpeg_compression         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] spice.playback_compression     = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] spice.server_listen            = 127.0.0.1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] spice.streaming_mode           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] spice.zlib_compression         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] upgrade_levels.baseapi         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] upgrade_levels.compute         = auto {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] upgrade_levels.conductor       = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] upgrade_levels.scheduler       = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vendordata_dynamic_auth.cafile = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vendordata_dynamic_auth.certfile = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vendordata_dynamic_auth.insecure = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vendordata_dynamic_auth.timeout = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.api_retry_count         = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.ca_file                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.cache_prefix            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.cluster_name            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.connection_pool_size    = 10 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.console_delay_seconds   = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.datastore_regex         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.host_ip                 = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.host_password           = **** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.host_port               = 443 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.host_username           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.insecure                = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.integration_bridge      = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.maximum_objects         = 100 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.pbm_default_policy      = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.pbm_enabled             = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.pbm_wsdl_location       = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.serial_port_proxy_uri   = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.serial_port_service_uri = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.task_poll_interval      = 0.5 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.use_linked_clone        = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.vnc_keymap              = en-us {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.vnc_port                = 5900 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vmware.vnc_port_total          = 10000 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vnc.auth_schemes               = ['none'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vnc.enabled                    = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vnc.novncproxy_port            = 6080 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vnc.vencrypt_ca_certs          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vnc.vencrypt_client_cert       = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vnc.vencrypt_client_key        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.disable_rootwrap   = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.enable_numa_live_migration = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.libvirt_disable_apic = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] wsgi.client_socket_timeout     = 900 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] wsgi.default_pool_size         = 1000 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] wsgi.keep_alive                = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] wsgi.max_header_line           = 16384 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] wsgi.ssl_ca_file               = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] wsgi.ssl_cert_file             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] wsgi.ssl_key_file              = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] wsgi.tcp_keepidle              = 600 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] zvm.ca_file                    = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] zvm.cloud_connector_url        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] zvm.reachable_timeout          = 300 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_policy.enforce_new_defaults = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_policy.enforce_scope      = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_policy.policy_default_rule = default {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:10 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler.connection_string     = messaging:// {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler.enabled               = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler.es_doc_type           = notification {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler.es_scroll_size        = 10000 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler.es_scroll_time        = 2m {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler.filter_error_trace    = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler.hmac_keys             = **** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler.sentinel_service_name = mymaster {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler.socket_timeout        = 0.1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler.trace_requests        = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler.trace_sqlalchemy      = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler_jaeger.process_tags   = {} {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler_jaeger.service_name_prefix = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] profiler_otlp.service_name_prefix = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] remote_debug.host              = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] remote_debug.port              = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_notifications.retry = -1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.auth_section        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.auth_type           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.cafile              = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.certfile            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.collect_timing      = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.connect_retries     = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.connect_retry_delay = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.endpoint_id         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.endpoint_override   = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.insecure            = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.keyfile             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.max_version         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.min_version         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.region_name         = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.service_name        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.service_type        = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.split_loggers       = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.status_code_retries = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.status_code_retry_delay = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.timeout             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.valid_interfaces    = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_limit.version             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_reports.file_event_handler = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] oslo_reports.log_dir           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plug_ovs_privileged.group  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] vif_plug_ovs_privileged.user   = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_ovs.isolate_vif         = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] os_brick.lock_path             = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] privsep_osbrick.capabilities   = [21] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] privsep_osbrick.group          = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] privsep_osbrick.helper_command = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] privsep_osbrick.user           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] nova_sys_admin.group           = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] nova_sys_admin.helper_command  = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] nova_sys_admin.user            = None {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG oslo_service.service [None req-20d79e59-de81-4d94-bcc1-e85706b2b0e7 None None] ******************************************************************************** {{(pid=75210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 29 01:32:11 user nova-compute[75210]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 29 01:32:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Connecting to libvirt: qemu:///system {{(pid=75210) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f240c66a3b0> {{(pid=75210) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 29 01:32:11 user nova-compute[75210]: libvirt:  error : internal error: could not initialize domain event timer
Nov 29 01:32:11 user nova-compute[75210]: WARNING nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 29 01:32:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f240c66a3b0> {{(pid=75210) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Starting native event thread {{(pid=75210) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Starting green dispatch thread {{(pid=75210) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 29 01:32:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Starting connection event dispatch thread {{(pid=75210) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 29 01:32:11 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Connection event '1' reason 'None'
Nov 29 01:32:11 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 01:32:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.mount [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Initialising _HostMountState generation 0 {{(pid=75210) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 29 01:32:18 user nova-compute[75210]: INFO nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Libvirt host capabilities <capabilities>
Nov 29 01:32:18 user nova-compute[75210]:   <host>
Nov 29 01:32:18 user nova-compute[75210]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 29 01:32:18 user nova-compute[75210]:     <cpu>
Nov 29 01:32:18 user nova-compute[75210]:       <arch>x86_64</arch>
Nov 29 01:32:18 user nova-compute[75210]:       <model>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <vendor>Intel</vendor>
Nov 29 01:32:18 user nova-compute[75210]:       <microcode version='1070'/>
Nov 29 01:32:18 user nova-compute[75210]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 29 01:32:18 user nova-compute[75210]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='ss'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='vmx'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='pcid'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='osxsave'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='hypervisor'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='arat'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='tsc_adjust'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='md-clear'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='arch-capabilities'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='invtsc'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='rsba'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature name='skip-l1dfl-vmentry'/>
Nov 29 01:32:18 user nova-compute[75210]:       <pages unit='KiB' size='4'/>
Nov 29 01:32:18 user nova-compute[75210]:       <pages unit='KiB' size='2048'/>
Nov 29 01:32:18 user nova-compute[75210]:     </cpu>
Nov 29 01:32:18 user nova-compute[75210]:     <power_management>
Nov 29 01:32:18 user nova-compute[75210]:       <suspend_mem/>
Nov 29 01:32:18 user nova-compute[75210]:       <suspend_disk/>
Nov 29 01:32:18 user nova-compute[75210]:       <suspend_hybrid/>
Nov 29 01:32:18 user nova-compute[75210]:     </power_management>
Nov 29 01:32:18 user nova-compute[75210]:     <iommu support='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     <migration_features>
Nov 29 01:32:18 user nova-compute[75210]:       <live/>
Nov 29 01:32:18 user nova-compute[75210]:       <uri_transports>
Nov 29 01:32:18 user nova-compute[75210]:         <uri_transport>tcp</uri_transport>
Nov 29 01:32:18 user nova-compute[75210]:         <uri_transport>rdma</uri_transport>
Nov 29 01:32:18 user nova-compute[75210]:       </uri_transports>
Nov 29 01:32:18 user nova-compute[75210]:     </migration_features>
Nov 29 01:32:18 user nova-compute[75210]:     <topology>
Nov 29 01:32:18 user nova-compute[75210]:       <cells num='2'>
Nov 29 01:32:18 user nova-compute[75210]:         <cell id='0'>
Nov 29 01:32:18 user nova-compute[75210]:           <memory unit='KiB'>8140616</memory>
Nov 29 01:32:18 user nova-compute[75210]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 29 01:32:18 user nova-compute[75210]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 01:32:18 user nova-compute[75210]:           <distances>
Nov 29 01:32:18 user nova-compute[75210]:             <sibling id='0' value='10'/>
Nov 29 01:32:18 user nova-compute[75210]:             <sibling id='1' value='20'/>
Nov 29 01:32:18 user nova-compute[75210]:           </distances>
Nov 29 01:32:18 user nova-compute[75210]:           <cpus num='6'>
Nov 29 01:32:18 user nova-compute[75210]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 29 01:32:18 user nova-compute[75210]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 29 01:32:18 user nova-compute[75210]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 29 01:32:18 user nova-compute[75210]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 29 01:32:18 user nova-compute[75210]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 29 01:32:18 user nova-compute[75210]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 29 01:32:18 user nova-compute[75210]:           </cpus>
Nov 29 01:32:18 user nova-compute[75210]:         </cell>
Nov 29 01:32:18 user nova-compute[75210]:         <cell id='1'>
Nov 29 01:32:18 user nova-compute[75210]:           <memory unit='KiB'>8255068</memory>
Nov 29 01:32:18 user nova-compute[75210]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 29 01:32:18 user nova-compute[75210]:           <pages unit='KiB' size='2048'>0</pages>
Nov 29 01:32:18 user nova-compute[75210]:           <distances>
Nov 29 01:32:18 user nova-compute[75210]:             <sibling id='0' value='20'/>
Nov 29 01:32:18 user nova-compute[75210]:             <sibling id='1' value='10'/>
Nov 29 01:32:18 user nova-compute[75210]:           </distances>
Nov 29 01:32:18 user nova-compute[75210]:           <cpus num='6'>
Nov 29 01:32:18 user nova-compute[75210]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 29 01:32:18 user nova-compute[75210]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 29 01:32:18 user nova-compute[75210]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 29 01:32:18 user nova-compute[75210]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 29 01:32:18 user nova-compute[75210]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 29 01:32:18 user nova-compute[75210]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 29 01:32:18 user nova-compute[75210]:           </cpus>
Nov 29 01:32:18 user nova-compute[75210]:         </cell>
Nov 29 01:32:18 user nova-compute[75210]:       </cells>
Nov 29 01:32:18 user nova-compute[75210]:     </topology>
Nov 29 01:32:18 user nova-compute[75210]:     <cache>
Nov 29 01:32:18 user nova-compute[75210]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 29 01:32:18 user nova-compute[75210]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 29 01:32:18 user nova-compute[75210]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 29 01:32:18 user nova-compute[75210]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 29 01:32:18 user nova-compute[75210]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 29 01:32:18 user nova-compute[75210]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 29 01:32:18 user nova-compute[75210]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 29 01:32:18 user nova-compute[75210]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 29 01:32:18 user nova-compute[75210]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 29 01:32:18 user nova-compute[75210]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 29 01:32:18 user nova-compute[75210]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 29 01:32:18 user nova-compute[75210]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 29 01:32:18 user nova-compute[75210]:     </cache>
Nov 29 01:32:18 user nova-compute[75210]:     <secmodel>
Nov 29 01:32:18 user nova-compute[75210]:       <model>apparmor</model>
Nov 29 01:32:18 user nova-compute[75210]:       <doi>0</doi>
Nov 29 01:32:18 user nova-compute[75210]:     </secmodel>
Nov 29 01:32:18 user nova-compute[75210]:     <secmodel>
Nov 29 01:32:18 user nova-compute[75210]:       <model>dac</model>
Nov 29 01:32:18 user nova-compute[75210]:       <doi>0</doi>
Nov 29 01:32:18 user nova-compute[75210]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 29 01:32:18 user nova-compute[75210]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 29 01:32:18 user nova-compute[75210]:     </secmodel>
Nov 29 01:32:18 user nova-compute[75210]:   </host>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='alpha'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>64</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>clipper</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='armv6l'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>spitz</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>nuri</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>kzm</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sx1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>z2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>tosa</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>n810</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>n800</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>terrier</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>midway</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>microbit</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>verdex</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>highbank</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>akita</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>connex</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>collie</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='armv7l'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>spitz</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>nuri</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>kzm</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sx1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>z2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>tosa</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>n810</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>n800</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>terrier</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>midway</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>microbit</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>verdex</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>highbank</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>akita</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>connex</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>collie</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='aarch64'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>64</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>integratorcp</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>borzoi</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>spitz</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>nuri</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>musca-b1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>versatileab</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>kzm</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>musca-a</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>smdkc210</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sx1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>z2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>tosa</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>sabrelite</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>realview-eb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>n810</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>n800</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>versatilepb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>terrier</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mainstone</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>midway</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>musicpal</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>microbit</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>cubieboard</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>verdex</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>netduino2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>raspi3b</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>raspi2b</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>cheetah</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>highbank</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>akita</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>connex</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>collie</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>raspi0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <acpi default='on' toggle='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='cris'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='i686'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>isapc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>microvm</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='kvm'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <pae/>
Nov 29 01:32:18 user nova-compute[75210]:       <nonpae/>
Nov 29 01:32:18 user nova-compute[75210]:       <acpi default='on' toggle='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:       <apic default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='m68k'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>an5206</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>q800</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>next-cube</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='microblaze'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='microblazeel'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='mips'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='16'>malta</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='mipsel'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='16'>malta</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='mips64'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>64</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='16'>malta</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>pica61</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>magnum</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='mips64el'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>64</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='16'>malta</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mipssim</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>pica61</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>magnum</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='16'>boston</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='ppc'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mac99</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>40p</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>taihu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='ppc64'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>64</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>taihu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>40p</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mac99</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='ppc64le'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>64</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2048'>powernv9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>taihu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2048'>powernv10</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>ppce500</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>40p</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>pegasos2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>bamboo</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>g3beige</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>mac99</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sam460ex</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>ref405ep</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2048'>powernv8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='riscv32'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='8'>spike</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>opentitan</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='8'>virt</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='riscv64'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>64</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='8'>spike</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='5'>sifive_u</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>shakti_c</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sifive_e</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='8'>virt</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='s390x'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>64</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='sh4'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>shix</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>r2d</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='sh4eb'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>64</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>shix</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>r2d</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='sparc'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>SS-5</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>SS-20</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>LX</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>SS-4</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>SS-10</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>Voyager</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='sparc64'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>64</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sun4u</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>niagara</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>sun4v</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='x86_64'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>64</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>x-remote</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='1'>isapc</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>microvm</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='kvm'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <acpi default='on' toggle='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:       <apic default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='xtensa'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>sim</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>kc705</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>ml605</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>virt</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>lx200</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>lx60</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]:   <guest>
Nov 29 01:32:18 user nova-compute[75210]:     <os_type>hvm</os_type>
Nov 29 01:32:18 user nova-compute[75210]:     <arch name='xtensaeb'>
Nov 29 01:32:18 user nova-compute[75210]:       <wordsize>32</wordsize>
Nov 29 01:32:18 user nova-compute[75210]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='4'>sim</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>kc705</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>ml605</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>virt</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>lx200</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>lx60</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 29 01:32:18 user nova-compute[75210]:       <domain type='qemu'/>
Nov 29 01:32:18 user nova-compute[75210]:     </arch>
Nov 29 01:32:18 user nova-compute[75210]:     <features>
Nov 29 01:32:18 user nova-compute[75210]:       <cpuselection/>
Nov 29 01:32:18 user nova-compute[75210]:       <deviceboot/>
Nov 29 01:32:18 user nova-compute[75210]:       <disksnapshot default='on' toggle='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     </features>
Nov 29 01:32:18 user nova-compute[75210]:   </guest>
Nov 29 01:32:18 user nova-compute[75210]: </capabilities>
Nov 29 01:32:18 user nova-compute[75210]: 
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 29 01:32:18 user nova-compute[75210]: <domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 01:32:18 user nova-compute[75210]:   <domain>kvm</domain>
Nov 29 01:32:18 user nova-compute[75210]:   <machine>pc-i440fx-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:   <arch>i686</arch>
Nov 29 01:32:18 user nova-compute[75210]:   <vcpu max='255'/>
Nov 29 01:32:18 user nova-compute[75210]:   <iothreads supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:   <os supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='firmware'/>
Nov 29 01:32:18 user nova-compute[75210]:     <loader supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>rom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pflash</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='readonly'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>yes</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='secure'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </loader>
Nov 29 01:32:18 user nova-compute[75210]:   </os>
Nov 29 01:32:18 user nova-compute[75210]:   <cpu>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-passthrough' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='hostPassthroughMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='maximum' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='maximumMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>on</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-model' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <vendor>Intel</vendor>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ss'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='vmx'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='pcid'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='hypervisor'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arat'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='umip'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='md-clear'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibpb'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibrs'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='erms'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='lm'/>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='custom' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>qemu64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>qemu32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>phenom</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>n270</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>kvm64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>kvm32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>coreduo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>core2duo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>athlon</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Westmere</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Snowridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Penryn</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G5</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G4</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G1</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Nehalem</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Rome</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Milan</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Dhyana</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cooperlake</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Conroe</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>486</model>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:   </cpu>
Nov 29 01:32:18 user nova-compute[75210]:   <memoryBacking supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='sourceType'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>file</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>anonymous</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>memfd</value>
Nov 29 01:32:18 user nova-compute[75210]:     </enum>
Nov 29 01:32:18 user nova-compute[75210]:   </memoryBacking>
Nov 29 01:32:18 user nova-compute[75210]:   <devices>
Nov 29 01:32:18 user nova-compute[75210]:     <disk supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='diskDevice'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>disk</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cdrom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>floppy</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>lun</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='bus'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>ide</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>fdc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sata</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </disk>
Nov 29 01:32:18 user nova-compute[75210]:     <graphics supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sdl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vnc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>spice</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egl-headless</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </graphics>
Nov 29 01:32:18 user nova-compute[75210]:     <video supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='modelType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cirrus</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vmvga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>qxl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>none</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>bochs</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>ramfb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </video>
Nov 29 01:32:18 user nova-compute[75210]:     <hostdev supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='mode'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>subsystem</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='startupPolicy'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>default</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>mandatory</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>requisite</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>optional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='subsysType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pci</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='capsType'/>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='pciBackend'/>
Nov 29 01:32:18 user nova-compute[75210]:     </hostdev>
Nov 29 01:32:18 user nova-compute[75210]:     <rng supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>random</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egd</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>builtin</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </rng>
Nov 29 01:32:18 user nova-compute[75210]:     <filesystem supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='driverType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>path</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>handle</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtiofs</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </filesystem>
Nov 29 01:32:18 user nova-compute[75210]:     <tpm supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-tis</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-crb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>passthrough</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>emulator</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </tpm>
Nov 29 01:32:18 user nova-compute[75210]:   </devices>
Nov 29 01:32:18 user nova-compute[75210]:   <features>
Nov 29 01:32:18 user nova-compute[75210]:     <gic supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     <vmcoreinfo supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <genid supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backingStoreInput supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backup supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <sev supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:   </features>
Nov 29 01:32:18 user nova-compute[75210]: </domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:  {{(pid=75210) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 29 01:32:18 user nova-compute[75210]: <domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 01:32:18 user nova-compute[75210]:   <domain>kvm</domain>
Nov 29 01:32:18 user nova-compute[75210]:   <machine>pc-q35-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:   <arch>i686</arch>
Nov 29 01:32:18 user nova-compute[75210]:   <vcpu max='288'/>
Nov 29 01:32:18 user nova-compute[75210]:   <iothreads supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:   <os supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='firmware'/>
Nov 29 01:32:18 user nova-compute[75210]:     <loader supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>rom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pflash</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='readonly'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>yes</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='secure'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </loader>
Nov 29 01:32:18 user nova-compute[75210]:   </os>
Nov 29 01:32:18 user nova-compute[75210]:   <cpu>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-passthrough' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='hostPassthroughMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='maximum' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='maximumMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>on</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-model' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <vendor>Intel</vendor>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ss'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='vmx'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='pcid'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='hypervisor'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arat'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='umip'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='md-clear'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibpb'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibrs'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='erms'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='lm'/>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='custom' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>qemu64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>qemu32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>phenom</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>n270</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>kvm64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>kvm32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>coreduo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>core2duo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>athlon</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Westmere</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Snowridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Penryn</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G5</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G4</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G1</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Nehalem</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Rome</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Milan</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Dhyana</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cooperlake</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Conroe</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>486</model>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:   </cpu>
Nov 29 01:32:18 user nova-compute[75210]:   <memoryBacking supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='sourceType'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>file</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>anonymous</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>memfd</value>
Nov 29 01:32:18 user nova-compute[75210]:     </enum>
Nov 29 01:32:18 user nova-compute[75210]:   </memoryBacking>
Nov 29 01:32:18 user nova-compute[75210]:   <devices>
Nov 29 01:32:18 user nova-compute[75210]:     <disk supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='diskDevice'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>disk</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cdrom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>floppy</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>lun</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='bus'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>fdc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sata</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </disk>
Nov 29 01:32:18 user nova-compute[75210]:     <graphics supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sdl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vnc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>spice</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egl-headless</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </graphics>
Nov 29 01:32:18 user nova-compute[75210]:     <video supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='modelType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cirrus</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vmvga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>qxl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>none</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>bochs</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>ramfb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </video>
Nov 29 01:32:18 user nova-compute[75210]:     <hostdev supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='mode'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>subsystem</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='startupPolicy'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>default</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>mandatory</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>requisite</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>optional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='subsysType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pci</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='capsType'/>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='pciBackend'/>
Nov 29 01:32:18 user nova-compute[75210]:     </hostdev>
Nov 29 01:32:18 user nova-compute[75210]:     <rng supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>random</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egd</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>builtin</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </rng>
Nov 29 01:32:18 user nova-compute[75210]:     <filesystem supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='driverType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>path</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>handle</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtiofs</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </filesystem>
Nov 29 01:32:18 user nova-compute[75210]:     <tpm supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-tis</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-crb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>passthrough</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>emulator</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </tpm>
Nov 29 01:32:18 user nova-compute[75210]:   </devices>
Nov 29 01:32:18 user nova-compute[75210]:   <features>
Nov 29 01:32:18 user nova-compute[75210]:     <gic supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     <vmcoreinfo supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <genid supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backingStoreInput supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backup supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <sev supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:   </features>
Nov 29 01:32:18 user nova-compute[75210]: </domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:  {{(pid=75210) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 29 01:32:18 user nova-compute[75210]: <domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 01:32:18 user nova-compute[75210]:   <domain>kvm</domain>
Nov 29 01:32:18 user nova-compute[75210]:   <machine>pc-q35-jammy</machine>
Nov 29 01:32:18 user nova-compute[75210]:   <arch>i686</arch>
Nov 29 01:32:18 user nova-compute[75210]:   <vcpu max='288'/>
Nov 29 01:32:18 user nova-compute[75210]:   <iothreads supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:   <os supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='firmware'/>
Nov 29 01:32:18 user nova-compute[75210]:     <loader supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>rom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pflash</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='readonly'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>yes</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='secure'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </loader>
Nov 29 01:32:18 user nova-compute[75210]:   </os>
Nov 29 01:32:18 user nova-compute[75210]:   <cpu>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-passthrough' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='hostPassthroughMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='maximum' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='maximumMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>on</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-model' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <vendor>Intel</vendor>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ss'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='vmx'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='pcid'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='hypervisor'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arat'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='umip'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='md-clear'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibpb'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibrs'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='erms'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='lm'/>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='custom' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>qemu64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>qemu32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>phenom</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>n270</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>kvm64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>kvm32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>coreduo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>core2duo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>athlon</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Westmere</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Snowridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Penryn</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G5</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G4</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G1</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Nehalem</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Rome</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Milan</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Dhyana</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cooperlake</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Conroe</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>486</model>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:   </cpu>
Nov 29 01:32:18 user nova-compute[75210]:   <memoryBacking supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='sourceType'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>file</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>anonymous</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>memfd</value>
Nov 29 01:32:18 user nova-compute[75210]:     </enum>
Nov 29 01:32:18 user nova-compute[75210]:   </memoryBacking>
Nov 29 01:32:18 user nova-compute[75210]:   <devices>
Nov 29 01:32:18 user nova-compute[75210]:     <disk supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='diskDevice'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>disk</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cdrom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>floppy</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>lun</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='bus'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>fdc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sata</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </disk>
Nov 29 01:32:18 user nova-compute[75210]:     <graphics supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sdl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vnc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>spice</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egl-headless</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </graphics>
Nov 29 01:32:18 user nova-compute[75210]:     <video supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='modelType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cirrus</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vmvga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>qxl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>none</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>bochs</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>ramfb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </video>
Nov 29 01:32:18 user nova-compute[75210]:     <hostdev supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='mode'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>subsystem</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='startupPolicy'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>default</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>mandatory</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>requisite</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>optional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='subsysType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pci</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='capsType'/>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='pciBackend'/>
Nov 29 01:32:18 user nova-compute[75210]:     </hostdev>
Nov 29 01:32:18 user nova-compute[75210]:     <rng supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>random</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egd</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>builtin</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </rng>
Nov 29 01:32:18 user nova-compute[75210]:     <filesystem supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='driverType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>path</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>handle</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtiofs</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </filesystem>
Nov 29 01:32:18 user nova-compute[75210]:     <tpm supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-tis</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-crb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>passthrough</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>emulator</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </tpm>
Nov 29 01:32:18 user nova-compute[75210]:   </devices>
Nov 29 01:32:18 user nova-compute[75210]:   <features>
Nov 29 01:32:18 user nova-compute[75210]:     <gic supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     <vmcoreinfo supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <genid supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backingStoreInput supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backup supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <sev supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:   </features>
Nov 29 01:32:18 user nova-compute[75210]: </domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:  {{(pid=75210) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 29 01:32:18 user nova-compute[75210]: <domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:   <path>/usr/bin/qemu-system-i386</path>
Nov 29 01:32:18 user nova-compute[75210]:   <domain>kvm</domain>
Nov 29 01:32:18 user nova-compute[75210]:   <machine>pc-i440fx-jammy</machine>
Nov 29 01:32:18 user nova-compute[75210]:   <arch>i686</arch>
Nov 29 01:32:18 user nova-compute[75210]:   <vcpu max='255'/>
Nov 29 01:32:18 user nova-compute[75210]:   <iothreads supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:   <os supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='firmware'/>
Nov 29 01:32:18 user nova-compute[75210]:     <loader supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>rom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pflash</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='readonly'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>yes</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='secure'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </loader>
Nov 29 01:32:18 user nova-compute[75210]:   </os>
Nov 29 01:32:18 user nova-compute[75210]:   <cpu>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-passthrough' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='hostPassthroughMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='maximum' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='maximumMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>on</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-model' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <vendor>Intel</vendor>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ss'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='vmx'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='pcid'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='hypervisor'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arat'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='umip'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='md-clear'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibpb'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibrs'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='erms'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='lm'/>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='custom' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>qemu64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>qemu32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>phenom</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>n270</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>kvm64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>kvm32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>coreduo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>core2duo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>athlon</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Westmere-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Westmere</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Snowridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Penryn</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G5</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G4</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G1</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Nehalem-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Nehalem</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Rome</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Milan</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Dhyana</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cooperlake</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Conroe</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>486</model>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:   </cpu>
Nov 29 01:32:18 user nova-compute[75210]:   <memoryBacking supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='sourceType'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>file</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>anonymous</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>memfd</value>
Nov 29 01:32:18 user nova-compute[75210]:     </enum>
Nov 29 01:32:18 user nova-compute[75210]:   </memoryBacking>
Nov 29 01:32:18 user nova-compute[75210]:   <devices>
Nov 29 01:32:18 user nova-compute[75210]:     <disk supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='diskDevice'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>disk</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cdrom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>floppy</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>lun</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='bus'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>ide</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>fdc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sata</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </disk>
Nov 29 01:32:18 user nova-compute[75210]:     <graphics supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sdl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vnc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>spice</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egl-headless</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </graphics>
Nov 29 01:32:18 user nova-compute[75210]:     <video supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='modelType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cirrus</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vmvga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>qxl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>none</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>bochs</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>ramfb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </video>
Nov 29 01:32:18 user nova-compute[75210]:     <hostdev supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='mode'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>subsystem</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='startupPolicy'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>default</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>mandatory</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>requisite</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>optional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='subsysType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pci</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='capsType'/>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='pciBackend'/>
Nov 29 01:32:18 user nova-compute[75210]:     </hostdev>
Nov 29 01:32:18 user nova-compute[75210]:     <rng supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>random</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egd</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>builtin</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </rng>
Nov 29 01:32:18 user nova-compute[75210]:     <filesystem supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='driverType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>path</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>handle</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtiofs</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </filesystem>
Nov 29 01:32:18 user nova-compute[75210]:     <tpm supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-tis</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-crb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>passthrough</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>emulator</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </tpm>
Nov 29 01:32:18 user nova-compute[75210]:   </devices>
Nov 29 01:32:18 user nova-compute[75210]:   <features>
Nov 29 01:32:18 user nova-compute[75210]:     <gic supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     <vmcoreinfo supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <genid supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backingStoreInput supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backup supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <sev supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:   </features>
Nov 29 01:32:18 user nova-compute[75210]: </domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:  {{(pid=75210) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 29 01:32:18 user nova-compute[75210]: <domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 01:32:18 user nova-compute[75210]:   <domain>kvm</domain>
Nov 29 01:32:18 user nova-compute[75210]:   <machine>pc-i440fx-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:   <arch>x86_64</arch>
Nov 29 01:32:18 user nova-compute[75210]:   <vcpu max='255'/>
Nov 29 01:32:18 user nova-compute[75210]:   <iothreads supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:   <os supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='firmware'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>efi</value>
Nov 29 01:32:18 user nova-compute[75210]:     </enum>
Nov 29 01:32:18 user nova-compute[75210]:     <loader supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>rom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pflash</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='readonly'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>yes</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='secure'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </loader>
Nov 29 01:32:18 user nova-compute[75210]:   </os>
Nov 29 01:32:18 user nova-compute[75210]:   <cpu>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-passthrough' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='hostPassthroughMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>on</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='maximum' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='maximumMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>on</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-model' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <vendor>Intel</vendor>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ss'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='vmx'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='pcid'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='hypervisor'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arat'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='umip'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='md-clear'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='invtsc'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibpb'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibrs'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='rsba'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='erms'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='custom' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>qemu64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>qemu32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>phenom</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>n270</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>kvm64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>kvm32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>coreduo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>core2duo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>athlon</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Westmere</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Snowridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Penryn</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G5</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G4</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Opteron_G1</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Nehalem</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Rome</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Milan</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Dhyana</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cooperlake</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Conroe</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>486</model>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:   </cpu>
Nov 29 01:32:18 user nova-compute[75210]:   <memoryBacking supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='sourceType'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>file</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>anonymous</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>memfd</value>
Nov 29 01:32:18 user nova-compute[75210]:     </enum>
Nov 29 01:32:18 user nova-compute[75210]:   </memoryBacking>
Nov 29 01:32:18 user nova-compute[75210]:   <devices>
Nov 29 01:32:18 user nova-compute[75210]:     <disk supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='diskDevice'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>disk</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cdrom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>floppy</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>lun</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='bus'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>ide</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>fdc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sata</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </disk>
Nov 29 01:32:18 user nova-compute[75210]:     <graphics supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sdl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vnc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>spice</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egl-headless</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </graphics>
Nov 29 01:32:18 user nova-compute[75210]:     <video supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='modelType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cirrus</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vmvga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>qxl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>none</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>bochs</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>ramfb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </video>
Nov 29 01:32:18 user nova-compute[75210]:     <hostdev supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='mode'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>subsystem</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='startupPolicy'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>default</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>mandatory</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>requisite</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>optional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='subsysType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pci</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='capsType'/>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='pciBackend'/>
Nov 29 01:32:18 user nova-compute[75210]:     </hostdev>
Nov 29 01:32:18 user nova-compute[75210]:     <rng supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>random</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egd</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>builtin</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </rng>
Nov 29 01:32:18 user nova-compute[75210]:     <filesystem supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='driverType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>path</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>handle</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtiofs</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </filesystem>
Nov 29 01:32:18 user nova-compute[75210]:     <tpm supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-tis</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-crb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>passthrough</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>emulator</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </tpm>
Nov 29 01:32:18 user nova-compute[75210]:   </devices>
Nov 29 01:32:18 user nova-compute[75210]:   <features>
Nov 29 01:32:18 user nova-compute[75210]:     <gic supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     <vmcoreinfo supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <genid supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backingStoreInput supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backup supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <sev supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:   </features>
Nov 29 01:32:18 user nova-compute[75210]: </domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:  {{(pid=75210) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 29 01:32:18 user nova-compute[75210]: <domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 01:32:18 user nova-compute[75210]:   <domain>kvm</domain>
Nov 29 01:32:18 user nova-compute[75210]:   <machine>pc-q35-6.2</machine>
Nov 29 01:32:18 user nova-compute[75210]:   <arch>x86_64</arch>
Nov 29 01:32:18 user nova-compute[75210]:   <vcpu max='288'/>
Nov 29 01:32:18 user nova-compute[75210]:   <iothreads supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:   <os supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='firmware'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>efi</value>
Nov 29 01:32:18 user nova-compute[75210]:     </enum>
Nov 29 01:32:18 user nova-compute[75210]:     <loader supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>rom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pflash</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='readonly'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>yes</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='secure'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>yes</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </loader>
Nov 29 01:32:18 user nova-compute[75210]:   </os>
Nov 29 01:32:18 user nova-compute[75210]:   <cpu>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-passthrough' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='hostPassthroughMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>on</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='maximum' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='maximumMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>on</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-model' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <vendor>Intel</vendor>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ss'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='vmx'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='pcid'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='hypervisor'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arat'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='umip'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='md-clear'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='invtsc'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibpb'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibrs'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='rsba'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='erms'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='custom' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>qemu64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>qemu32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>phenom</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>n270</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>kvm64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>kvm32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>coreduo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>core2duo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>athlon</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Westmere</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Snowridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Penryn</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G5</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G4</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Opteron_G1</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Nehalem</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Rome</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Milan</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Dhyana</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cooperlake</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Conroe</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>486</model>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:   </cpu>
Nov 29 01:32:18 user nova-compute[75210]:   <memoryBacking supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='sourceType'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>file</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>anonymous</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>memfd</value>
Nov 29 01:32:18 user nova-compute[75210]:     </enum>
Nov 29 01:32:18 user nova-compute[75210]:   </memoryBacking>
Nov 29 01:32:18 user nova-compute[75210]:   <devices>
Nov 29 01:32:18 user nova-compute[75210]:     <disk supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='diskDevice'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>disk</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cdrom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>floppy</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>lun</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='bus'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>fdc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sata</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </disk>
Nov 29 01:32:18 user nova-compute[75210]:     <graphics supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sdl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vnc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>spice</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egl-headless</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </graphics>
Nov 29 01:32:18 user nova-compute[75210]:     <video supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='modelType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cirrus</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vmvga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>qxl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>none</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>bochs</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>ramfb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </video>
Nov 29 01:32:18 user nova-compute[75210]:     <hostdev supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='mode'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>subsystem</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='startupPolicy'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>default</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>mandatory</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>requisite</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>optional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='subsysType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pci</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='capsType'/>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='pciBackend'/>
Nov 29 01:32:18 user nova-compute[75210]:     </hostdev>
Nov 29 01:32:18 user nova-compute[75210]:     <rng supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>random</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egd</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>builtin</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </rng>
Nov 29 01:32:18 user nova-compute[75210]:     <filesystem supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='driverType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>path</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>handle</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtiofs</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </filesystem>
Nov 29 01:32:18 user nova-compute[75210]:     <tpm supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-tis</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-crb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>passthrough</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>emulator</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </tpm>
Nov 29 01:32:18 user nova-compute[75210]:   </devices>
Nov 29 01:32:18 user nova-compute[75210]:   <features>
Nov 29 01:32:18 user nova-compute[75210]:     <gic supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     <vmcoreinfo supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <genid supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backingStoreInput supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backup supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <sev supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:   </features>
Nov 29 01:32:18 user nova-compute[75210]: </domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:  {{(pid=75210) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 29 01:32:18 user nova-compute[75210]: <domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 01:32:18 user nova-compute[75210]:   <domain>kvm</domain>
Nov 29 01:32:18 user nova-compute[75210]:   <machine>pc-q35-jammy</machine>
Nov 29 01:32:18 user nova-compute[75210]:   <arch>x86_64</arch>
Nov 29 01:32:18 user nova-compute[75210]:   <vcpu max='288'/>
Nov 29 01:32:18 user nova-compute[75210]:   <iothreads supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:   <os supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='firmware'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>efi</value>
Nov 29 01:32:18 user nova-compute[75210]:     </enum>
Nov 29 01:32:18 user nova-compute[75210]:     <loader supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>rom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pflash</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='readonly'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>yes</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='secure'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>yes</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </loader>
Nov 29 01:32:18 user nova-compute[75210]:   </os>
Nov 29 01:32:18 user nova-compute[75210]:   <cpu>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-passthrough' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='hostPassthroughMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>on</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='maximum' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='maximumMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>on</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-model' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <vendor>Intel</vendor>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ss'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='vmx'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='pcid'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='hypervisor'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arat'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='umip'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='md-clear'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='invtsc'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibpb'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibrs'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='rsba'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='erms'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='custom' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>qemu64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>qemu32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>phenom</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>n270</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>kvm64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>kvm32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>coreduo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>core2duo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>athlon</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Westmere</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Snowridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Penryn</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G5</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G4</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Opteron_G1</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Nehalem</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Rome</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Milan</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Dhyana</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cooperlake</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Conroe</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>486</model>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:   </cpu>
Nov 29 01:32:18 user nova-compute[75210]:   <memoryBacking supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='sourceType'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>file</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>anonymous</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>memfd</value>
Nov 29 01:32:18 user nova-compute[75210]:     </enum>
Nov 29 01:32:18 user nova-compute[75210]:   </memoryBacking>
Nov 29 01:32:18 user nova-compute[75210]:   <devices>
Nov 29 01:32:18 user nova-compute[75210]:     <disk supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='diskDevice'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>disk</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cdrom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>floppy</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>lun</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='bus'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>fdc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sata</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </disk>
Nov 29 01:32:18 user nova-compute[75210]:     <graphics supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sdl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vnc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>spice</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egl-headless</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </graphics>
Nov 29 01:32:18 user nova-compute[75210]:     <video supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='modelType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cirrus</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vmvga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>qxl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>none</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>bochs</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>ramfb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </video>
Nov 29 01:32:18 user nova-compute[75210]:     <hostdev supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='mode'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>subsystem</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='startupPolicy'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>default</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>mandatory</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>requisite</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>optional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='subsysType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pci</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='capsType'/>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='pciBackend'/>
Nov 29 01:32:18 user nova-compute[75210]:     </hostdev>
Nov 29 01:32:18 user nova-compute[75210]:     <rng supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>random</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egd</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>builtin</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </rng>
Nov 29 01:32:18 user nova-compute[75210]:     <filesystem supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='driverType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>path</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>handle</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtiofs</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </filesystem>
Nov 29 01:32:18 user nova-compute[75210]:     <tpm supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-tis</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-crb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>passthrough</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>emulator</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </tpm>
Nov 29 01:32:18 user nova-compute[75210]:   </devices>
Nov 29 01:32:18 user nova-compute[75210]:   <features>
Nov 29 01:32:18 user nova-compute[75210]:     <gic supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     <vmcoreinfo supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <genid supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backingStoreInput supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backup supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <sev supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:   </features>
Nov 29 01:32:18 user nova-compute[75210]: </domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:  {{(pid=75210) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 29 01:32:18 user nova-compute[75210]: <domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 29 01:32:18 user nova-compute[75210]:   <domain>kvm</domain>
Nov 29 01:32:18 user nova-compute[75210]:   <machine>pc-i440fx-jammy</machine>
Nov 29 01:32:18 user nova-compute[75210]:   <arch>x86_64</arch>
Nov 29 01:32:18 user nova-compute[75210]:   <vcpu max='255'/>
Nov 29 01:32:18 user nova-compute[75210]:   <iothreads supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:   <os supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='firmware'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>efi</value>
Nov 29 01:32:18 user nova-compute[75210]:     </enum>
Nov 29 01:32:18 user nova-compute[75210]:     <loader supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>rom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pflash</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='readonly'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>yes</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='secure'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>no</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </loader>
Nov 29 01:32:18 user nova-compute[75210]:   </os>
Nov 29 01:32:18 user nova-compute[75210]:   <cpu>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-passthrough' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='hostPassthroughMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>on</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='maximum' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='maximumMigratable'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>on</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>off</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='host-model' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <vendor>Intel</vendor>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ss'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='vmx'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='pcid'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='hypervisor'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arat'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='tsc_adjust'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='umip'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='md-clear'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='arch-capabilities'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='invtsc'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibpb'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='ibrs'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-stibp'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='amd-ssbd'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='rsba'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='require' name='pschange-mc-no'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='erms'/>
Nov 29 01:32:18 user nova-compute[75210]:       <feature policy='disable' name='xsaveopt'/>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:     <mode name='custom' supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>qemu64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>qemu32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>phenom</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>pentium</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>n270</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>kvm64</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>kvm32</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>coreduo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>core2duo</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>athlon</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Westmere-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Westmere</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Snowridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Skylake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>SandyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Penryn</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G5</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G4</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G3</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Opteron_G2</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Opteron_G1</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Nehalem</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>IvyBridge</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Icelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Haswell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Rome</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-Milan</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC-IBPB</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>EPYC</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Dhyana</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cooperlake</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>Conroe</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Cascadelake-Server</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-noTSX</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell-IBRS</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='no'>Broadwell</model>
Nov 29 01:32:18 user nova-compute[75210]:       <model usable='yes'>486</model>
Nov 29 01:32:18 user nova-compute[75210]:     </mode>
Nov 29 01:32:18 user nova-compute[75210]:   </cpu>
Nov 29 01:32:18 user nova-compute[75210]:   <memoryBacking supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:     <enum name='sourceType'>
Nov 29 01:32:18 user nova-compute[75210]:       <value>file</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>anonymous</value>
Nov 29 01:32:18 user nova-compute[75210]:       <value>memfd</value>
Nov 29 01:32:18 user nova-compute[75210]:     </enum>
Nov 29 01:32:18 user nova-compute[75210]:   </memoryBacking>
Nov 29 01:32:18 user nova-compute[75210]:   <devices>
Nov 29 01:32:18 user nova-compute[75210]:     <disk supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='diskDevice'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>disk</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cdrom</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>floppy</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>lun</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='bus'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>ide</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>fdc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sata</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </disk>
Nov 29 01:32:18 user nova-compute[75210]:     <graphics supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='type'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>sdl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vnc</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>spice</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egl-headless</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </graphics>
Nov 29 01:32:18 user nova-compute[75210]:     <video supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='modelType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>cirrus</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>vmvga</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>qxl</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>none</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>bochs</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>ramfb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </video>
Nov 29 01:32:18 user nova-compute[75210]:     <hostdev supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='mode'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>subsystem</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='startupPolicy'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>default</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>mandatory</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>requisite</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>optional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='subsysType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>usb</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>pci</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>scsi</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='capsType'/>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='pciBackend'/>
Nov 29 01:32:18 user nova-compute[75210]:     </hostdev>
Nov 29 01:32:18 user nova-compute[75210]:     <rng supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtio-non-transitional</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>random</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>egd</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>builtin</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </rng>
Nov 29 01:32:18 user nova-compute[75210]:     <filesystem supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='driverType'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>path</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>handle</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>virtiofs</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </filesystem>
Nov 29 01:32:18 user nova-compute[75210]:     <tpm supported='yes'>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='model'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-tis</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>tpm-crb</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:       <enum name='backendModel'>
Nov 29 01:32:18 user nova-compute[75210]:         <value>passthrough</value>
Nov 29 01:32:18 user nova-compute[75210]:         <value>emulator</value>
Nov 29 01:32:18 user nova-compute[75210]:       </enum>
Nov 29 01:32:18 user nova-compute[75210]:     </tpm>
Nov 29 01:32:18 user nova-compute[75210]:   </devices>
Nov 29 01:32:18 user nova-compute[75210]:   <features>
Nov 29 01:32:18 user nova-compute[75210]:     <gic supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:     <vmcoreinfo supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <genid supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backingStoreInput supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <backup supported='yes'/>
Nov 29 01:32:18 user nova-compute[75210]:     <sev supported='no'/>
Nov 29 01:32:18 user nova-compute[75210]:   </features>
Nov 29 01:32:18 user nova-compute[75210]: </domainCapabilities>
Nov 29 01:32:18 user nova-compute[75210]:  {{(pid=75210) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75210) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75210) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Checking secure boot support for host arch (x86_64) {{(pid=75210) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Checking secure boot support for host arch (x86_64) {{(pid=75210) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Checking secure boot support for host arch (x86_64) {{(pid=75210) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 29 01:32:18 user nova-compute[75210]: INFO nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Secure Boot support detected
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] cpu compare xml: <cpu match="exact">
Nov 29 01:32:18 user nova-compute[75210]:   <model>Nehalem</model>
Nov 29 01:32:18 user nova-compute[75210]: </cpu>
Nov 29 01:32:18 user nova-compute[75210]:  {{(pid=75210) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 29 01:32:18 user nova-compute[75210]: INFO nova.virt.node [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Generated node identity 28871a06-d5c8-43d0-87af-3689cd143011
Nov 29 01:32:18 user nova-compute[75210]: INFO nova.virt.node [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Wrote node identity 28871a06-d5c8-43d0-87af-3689cd143011 to /opt/stack/data/nova/compute_id
Nov 29 01:32:18 user nova-compute[75210]: WARNING nova.compute.manager [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Compute nodes ['28871a06-d5c8-43d0-87af-3689cd143011'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 29 01:32:18 user nova-compute[75210]: INFO nova.compute.manager [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 29 01:32:18 user nova-compute[75210]: WARNING nova.compute.manager [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 29 01:32:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:32:18 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:32:18 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:32:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Hypervisor/Node resource view: name=user free_ram=10967MB free_disk=26.15658187866211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:32:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:32:18 user nova-compute[75210]: WARNING nova.compute.resource_tracker [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] No compute node record for user:28871a06-d5c8-43d0-87af-3689cd143011: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 28871a06-d5c8-43d0-87af-3689cd143011 could not be found.
Nov 29 01:32:18 user nova-compute[75210]: INFO nova.compute.resource_tracker [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Compute node record created for user:user with uuid: 28871a06-d5c8-43d0-87af-3689cd143011
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:32:19 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] [req-f93d7e81-ad2a-4392-9f48-22b4f327f9e5] Created resource provider record via placement API for resource provider with UUID 28871a06-d5c8-43d0-87af-3689cd143011 and name user.
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75210) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 29 01:32:19 user nova-compute[75210]: INFO nova.virt.libvirt.host [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] kernel doesn't support AMD SEV
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Updating inventory in ProviderTree for provider 28871a06-d5c8-43d0-87af-3689cd143011 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Libvirt baseline CPU <cpu>
Nov 29 01:32:19 user nova-compute[75210]:   <arch>x86_64</arch>
Nov 29 01:32:19 user nova-compute[75210]:   <model>Nehalem</model>
Nov 29 01:32:19 user nova-compute[75210]:   <vendor>Intel</vendor>
Nov 29 01:32:19 user nova-compute[75210]:   <topology sockets="6" cores="1" threads="1"/>
Nov 29 01:32:19 user nova-compute[75210]: </cpu>
Nov 29 01:32:19 user nova-compute[75210]:  {{(pid=75210) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Updated inventory for provider 28871a06-d5c8-43d0-87af-3689cd143011 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Updating resource provider 28871a06-d5c8-43d0-87af-3689cd143011 generation from 0 to 1 during operation: update_inventory {{(pid=75210) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Updating inventory in ProviderTree for provider 28871a06-d5c8-43d0-87af-3689cd143011 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Updating resource provider 28871a06-d5c8-43d0-87af-3689cd143011 generation from 1 to 2 during operation: update_traits {{(pid=75210) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:32:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.689s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.service [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Creating RPC server for service compute {{(pid=75210) start /opt/stack/nova/nova/service.py:182}}
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.service [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] Join ServiceGroup membership for this service compute {{(pid=75210) start /opt/stack/nova/nova/service.py:199}}
Nov 29 01:32:19 user nova-compute[75210]: DEBUG nova.servicegroup.drivers.db [None req-264fb265-6594-4c33-bae0-9ada77d07d57 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75210) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 29 01:32:55 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_power_states {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:32:55 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Didn't find any instances for network info cache update. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:33:10 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:33:10 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:33:10 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=10412MB free_disk=26.060333251953125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:33:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:34:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:34:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:34:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:34:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Didn't find any instances for network info cache update. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:34:11 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:34:11 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:34:11 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=10345MB free_disk=26.124855041503906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:34:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:34:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:34:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:34:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:35:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:35:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:35:11 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:35:11 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:35:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:35:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:35:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 01:35:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Didn't find any instances for network info cache update. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 01:35:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:35:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:35:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:35:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:35:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:35:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:35:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:35:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:35:13 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:35:13 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:35:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=10320MB free_disk=25.877105712890625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:35:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:35:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:35:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:35:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:35:13 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:35:13 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:35:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:35:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:35:14 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:36:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:36:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:36:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:36:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:36:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 01:36:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Didn't find any instances for network info cache update. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 01:36:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:36:13 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:36:13 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:36:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=9624MB free_disk=25.897708892822266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:36:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:14 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:36:14 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:36:14 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:36:16 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:36:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "18aa0259-a720-42aa-be33-4a676dd4d0e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:36:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:36:23 user nova-compute[75210]: INFO nova.compute.claims [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Claim successful on node user
Nov 29 01:36:23 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:36:23 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:36:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:36:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:36:24 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:36:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:36:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:36:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:36:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:36:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Creating image(s)
Nov 29 01:36:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "/opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "/opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "/opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8.part --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:24 user nova-compute[75210]: DEBUG nova.policy [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '654b0e70c6334fa3906a6e1d9023320f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba7aca2be7400e98500e02035788de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:36:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8.part --force-share --output=json" returned: 0 in 0.199s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:25 user nova-compute[75210]: DEBUG nova.virt.images [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] 7071ee05-5aa5-4613-b78b-8f17b0ec59bc was qcow2, converting to raw {{(pid=75210) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 01:36:25 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 01:36:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8.part /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8.converted {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8.part /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8.converted" returned: 0 in 0.586s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8.converted --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.431s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:25 user nova-compute[75210]: INFO oslo.privsep.daemon [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcx6zoz1w/privsep.sock']
Nov 29 01:36:25 user sudo[84484]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcx6zoz1w/privsep.sock
Nov 29 01:36:25 user sudo[84484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 01:36:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:25 user nova-compute[75210]: DEBUG nova.compute.manager [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:36:26 user nova-compute[75210]: INFO nova.compute.claims [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Claim successful on node user
Nov 29 01:36:26 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Successfully created port: d660481b-c417-49b9-9efe-9a11b09edc5b {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG nova.network.neutron [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:36:26 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:36:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG nova.policy [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd39b87d15084d84983873b59f36a211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f1a3d6f5994f6eb15e0ab2294efd53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:36:26 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Creating image(s)
Nov 29 01:36:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "/opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "/opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "/opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:27 user sudo[84484]: pam_unix(sudo:session): session closed for user root
Nov 29 01:36:27 user nova-compute[75210]: INFO oslo.privsep.daemon [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Spawned new privsep daemon via rootwrap
Nov 29 01:36:27 user nova-compute[75210]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 01:36:27 user nova-compute[75210]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 01:36:27 user nova-compute[75210]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 29 01:36:27 user nova-compute[75210]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84495
Nov 29 01:36:27 user nova-compute[75210]: WARNING oslo_privsep.priv_context [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] privsep daemon already running
Nov 29 01:36:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.243s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.236s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk 1073741824" returned: 0 in 0.048s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.311s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.259s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk 1073741824" returned: 0 in 0.076s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.network.neutron [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Successfully created port: c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Successfully updated port: d660481b-c417-49b9-9efe-9a11b09edc5b {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "refresh_cache-18aa0259-a720-42aa-be33-4a676dd4d0e7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquired lock "refresh_cache-18aa0259-a720-42aa-be33-4a676dd4d0e7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Cannot resize image /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Ensure instance console log exists: /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.209s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Cannot resize image /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Ensure instance console log exists: /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-fb200459-badd-42aa-949f-c68f70c243a8 req-ccaf3876-e42b-4f9c-a105-49b209008dc1 service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Received event network-changed-d660481b-c417-49b9-9efe-9a11b09edc5b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-fb200459-badd-42aa-949f-c68f70c243a8 req-ccaf3876-e42b-4f9c-a105-49b209008dc1 service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Refreshing instance network info cache due to event network-changed-d660481b-c417-49b9-9efe-9a11b09edc5b. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:36:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fb200459-badd-42aa-949f-c68f70c243a8 req-ccaf3876-e42b-4f9c-a105-49b209008dc1 service nova] Acquiring lock "refresh_cache-18aa0259-a720-42aa-be33-4a676dd4d0e7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Updating instance_info_cache with network_info: [{"id": "d660481b-c417-49b9-9efe-9a11b09edc5b", "address": "fa:16:3e:69:ed:7f", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd660481b-c4", "ovs_interfaceid": "d660481b-c417-49b9-9efe-9a11b09edc5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Releasing lock "refresh_cache-18aa0259-a720-42aa-be33-4a676dd4d0e7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Instance network_info: |[{"id": "d660481b-c417-49b9-9efe-9a11b09edc5b", "address": "fa:16:3e:69:ed:7f", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd660481b-c4", "ovs_interfaceid": "d660481b-c417-49b9-9efe-9a11b09edc5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fb200459-badd-42aa-949f-c68f70c243a8 req-ccaf3876-e42b-4f9c-a105-49b209008dc1 service nova] Acquired lock "refresh_cache-18aa0259-a720-42aa-be33-4a676dd4d0e7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.network.neutron [req-fb200459-badd-42aa-949f-c68f70c243a8 req-ccaf3876-e42b-4f9c-a105-49b209008dc1 service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Refreshing network info cache for port d660481b-c417-49b9-9efe-9a11b09edc5b {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Start _get_guest_xml network_info=[{"id": "d660481b-c417-49b9-9efe-9a11b09edc5b", "address": "fa:16:3e:69:ed:7f", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd660481b-c4", "ovs_interfaceid": "d660481b-c417-49b9-9efe-9a11b09edc5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:36:29 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:36:29 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1373939452',display_name='tempest-ServersNegativeTestJSON-server-1373939452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1373939452',id=1,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faba7aca2be7400e98500e02035788de',ramdisk_id='',reservation_id='r-4qi6lksw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1979179804',owner_user_name='tempest-ServersNegativeTestJSON-1979179804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:36:24Z,user_data=None,user_id='654b0e70c6334fa3906a6e1d9023320f',uuid=18aa0259-a720-42aa-be33-4a676dd4d0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d660481b-c417-49b9-9efe-9a11b09edc5b", "address": "fa:16:3e:69:ed:7f", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd660481b-c4", "ovs_interfaceid": "d660481b-c417-49b9-9efe-9a11b09edc5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Converting VIF {"id": "d660481b-c417-49b9-9efe-9a11b09edc5b", "address": "fa:16:3e:69:ed:7f", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd660481b-c4", "ovs_interfaceid": "d660481b-c417-49b9-9efe-9a11b09edc5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:ed:7f,bridge_name='br-int',has_traffic_filtering=True,id=d660481b-c417-49b9-9efe-9a11b09edc5b,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd660481b-c4') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.objects.instance [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lazy-loading 'pci_devices' on Instance uuid 18aa0259-a720-42aa-be33-4a676dd4d0e7 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:36:29 user nova-compute[75210]:   <uuid>18aa0259-a720-42aa-be33-4a676dd4d0e7</uuid>
Nov 29 01:36:29 user nova-compute[75210]:   <name>instance-00000001</name>
Nov 29 01:36:29 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:36:29 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:36:29 user nova-compute[75210]:   <metadata>
Nov 29 01:36:29 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:36:29 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:36:29 user nova-compute[75210]:       <nova:name>tempest-ServersNegativeTestJSON-server-1373939452</nova:name>
Nov 29 01:36:29 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:36:29</nova:creationTime>
Nov 29 01:36:29 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:36:29 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:36:29 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:36:29 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:36:29 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:36:29 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:36:29 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:36:29 user nova-compute[75210]:       <nova:owner>
Nov 29 01:36:29 user nova-compute[75210]:         <nova:user uuid="654b0e70c6334fa3906a6e1d9023320f">tempest-ServersNegativeTestJSON-1979179804-project-member</nova:user>
Nov 29 01:36:29 user nova-compute[75210]:         <nova:project uuid="faba7aca2be7400e98500e02035788de">tempest-ServersNegativeTestJSON-1979179804</nova:project>
Nov 29 01:36:29 user nova-compute[75210]:       </nova:owner>
Nov 29 01:36:29 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:36:29 user nova-compute[75210]:       <nova:ports>
Nov 29 01:36:29 user nova-compute[75210]:         <nova:port uuid="d660481b-c417-49b9-9efe-9a11b09edc5b">
Nov 29 01:36:29 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:36:29 user nova-compute[75210]:         </nova:port>
Nov 29 01:36:29 user nova-compute[75210]:       </nova:ports>
Nov 29 01:36:29 user nova-compute[75210]:     </nova:instance>
Nov 29 01:36:29 user nova-compute[75210]:   </metadata>
Nov 29 01:36:29 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:36:29 user nova-compute[75210]:     <system>
Nov 29 01:36:29 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:36:29 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:36:29 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:36:29 user nova-compute[75210]:       <entry name="serial">18aa0259-a720-42aa-be33-4a676dd4d0e7</entry>
Nov 29 01:36:29 user nova-compute[75210]:       <entry name="uuid">18aa0259-a720-42aa-be33-4a676dd4d0e7</entry>
Nov 29 01:36:29 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:36:29 user nova-compute[75210]:     </system>
Nov 29 01:36:29 user nova-compute[75210]:   </sysinfo>
Nov 29 01:36:29 user nova-compute[75210]:   <os>
Nov 29 01:36:29 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:36:29 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:36:29 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:36:29 user nova-compute[75210]:   </os>
Nov 29 01:36:29 user nova-compute[75210]:   <features>
Nov 29 01:36:29 user nova-compute[75210]:     <acpi/>
Nov 29 01:36:29 user nova-compute[75210]:     <apic/>
Nov 29 01:36:29 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:36:29 user nova-compute[75210]:   </features>
Nov 29 01:36:29 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:36:29 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:36:29 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:36:29 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:36:29 user nova-compute[75210]:   </clock>
Nov 29 01:36:29 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:36:29 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:36:29 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:36:29 user nova-compute[75210]:   </cpu>
Nov 29 01:36:29 user nova-compute[75210]:   <devices>
Nov 29 01:36:29 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:36:29 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:36:29 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk"/>
Nov 29 01:36:29 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:36:29 user nova-compute[75210]:     </disk>
Nov 29 01:36:29 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:36:29 user nova-compute[75210]:       <mac address="fa:16:3e:69:ed:7f"/>
Nov 29 01:36:29 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:36:29 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:36:29 user nova-compute[75210]:       <target dev="tapd660481b-c4"/>
Nov 29 01:36:29 user nova-compute[75210]:     </interface>
Nov 29 01:36:29 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:36:29 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/console.log" append="off"/>
Nov 29 01:36:29 user nova-compute[75210]:     </serial>
Nov 29 01:36:29 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:36:29 user nova-compute[75210]:     <video>
Nov 29 01:36:29 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:36:29 user nova-compute[75210]:     </video>
Nov 29 01:36:29 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:36:29 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:36:29 user nova-compute[75210]:     </rng>
Nov 29 01:36:29 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:36:29 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:36:29 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:36:29 user nova-compute[75210]:     </memballoon>
Nov 29 01:36:29 user nova-compute[75210]:   </devices>
Nov 29 01:36:29 user nova-compute[75210]: </domain>
Nov 29 01:36:29 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1373939452',display_name='tempest-ServersNegativeTestJSON-server-1373939452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1373939452',id=1,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faba7aca2be7400e98500e02035788de',ramdisk_id='',reservation_id='r-4qi6lksw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1979179804',owner_user_name='tempest-ServersNegativeTestJSON-1979179804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:36:24Z,user_data=None,user_id='654b0e70c6334fa3906a6e1d9023320f',uuid=18aa0259-a720-42aa-be33-4a676dd4d0e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d660481b-c417-49b9-9efe-9a11b09edc5b", "address": "fa:16:3e:69:ed:7f", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd660481b-c4", "ovs_interfaceid": "d660481b-c417-49b9-9efe-9a11b09edc5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Converting VIF {"id": "d660481b-c417-49b9-9efe-9a11b09edc5b", "address": "fa:16:3e:69:ed:7f", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd660481b-c4", "ovs_interfaceid": "d660481b-c417-49b9-9efe-9a11b09edc5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:ed:7f,bridge_name='br-int',has_traffic_filtering=True,id=d660481b-c417-49b9-9efe-9a11b09edc5b,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd660481b-c4') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG os_vif [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:ed:7f,bridge_name='br-int',has_traffic_filtering=True,id=d660481b-c417-49b9-9efe-9a11b09edc5b,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd660481b-c4') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Created schema index Interface.name {{(pid=75210) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Created schema index Port.name {{(pid=75210) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Created schema index Bridge.name {{(pid=75210) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [POLLOUT] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05aee4ef-0e89-5bb0-966c-14c3de8272f1', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:29 user nova-compute[75210]: INFO oslo.privsep.daemon [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpobxoc75i/privsep.sock']
Nov 29 01:36:29 user sudo[84534]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpobxoc75i/privsep.sock
Nov 29 01:36:29 user sudo[84534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 01:36:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Successfully updated port: c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:36:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "refresh_cache-42760d1a-1d14-47bb-a602-6eb3ed5205d4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:36:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquired lock "refresh_cache-42760d1a-1d14-47bb-a602-6eb3ed5205d4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:36:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:36:30 user nova-compute[75210]: DEBUG nova.network.neutron [req-fb200459-badd-42aa-949f-c68f70c243a8 req-ccaf3876-e42b-4f9c-a105-49b209008dc1 service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Updated VIF entry in instance network info cache for port d660481b-c417-49b9-9efe-9a11b09edc5b. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:36:30 user nova-compute[75210]: DEBUG nova.network.neutron [req-fb200459-badd-42aa-949f-c68f70c243a8 req-ccaf3876-e42b-4f9c-a105-49b209008dc1 service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Updating instance_info_cache with network_info: [{"id": "d660481b-c417-49b9-9efe-9a11b09edc5b", "address": "fa:16:3e:69:ed:7f", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd660481b-c4", "ovs_interfaceid": "d660481b-c417-49b9-9efe-9a11b09edc5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fb200459-badd-42aa-949f-c68f70c243a8 req-ccaf3876-e42b-4f9c-a105-49b209008dc1 service nova] Releasing lock "refresh_cache-18aa0259-a720-42aa-be33-4a676dd4d0e7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-c9010fc7-4f8f-43e7-a42a-34d33b902536 req-6587e9f0-43a8-4937-99ad-5b06a5d39524 service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Received event network-changed-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-c9010fc7-4f8f-43e7-a42a-34d33b902536 req-6587e9f0-43a8-4937-99ad-5b06a5d39524 service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Refreshing instance network info cache due to event network-changed-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c9010fc7-4f8f-43e7-a42a-34d33b902536 req-6587e9f0-43a8-4937-99ad-5b06a5d39524 service nova] Acquiring lock "refresh_cache-42760d1a-1d14-47bb-a602-6eb3ed5205d4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.network.neutron [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:31 user sudo[84534]: pam_unix(sudo:session): session closed for user root
Nov 29 01:36:31 user nova-compute[75210]: INFO oslo.privsep.daemon [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Spawned new privsep daemon via rootwrap
Nov 29 01:36:31 user nova-compute[75210]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 01:36:31 user nova-compute[75210]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 01:36:31 user nova-compute[75210]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 29 01:36:31 user nova-compute[75210]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84547
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.network.neutron [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Updating instance_info_cache with network_info: [{"id": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "address": "fa:16:3e:1d:ad:ca", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb15f2-12", "ovs_interfaceid": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Releasing lock "refresh_cache-42760d1a-1d14-47bb-a602-6eb3ed5205d4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.compute.manager [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Instance network_info: |[{"id": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "address": "fa:16:3e:1d:ad:ca", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb15f2-12", "ovs_interfaceid": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c9010fc7-4f8f-43e7-a42a-34d33b902536 req-6587e9f0-43a8-4937-99ad-5b06a5d39524 service nova] Acquired lock "refresh_cache-42760d1a-1d14-47bb-a602-6eb3ed5205d4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.network.neutron [req-c9010fc7-4f8f-43e7-a42a-34d33b902536 req-6587e9f0-43a8-4937-99ad-5b06a5d39524 service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Refreshing network info cache for port c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Start _get_guest_xml network_info=[{"id": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "address": "fa:16:3e:1d:ad:ca", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb15f2-12", "ovs_interfaceid": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:36:31 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:36:31 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2032096304',display_name='tempest-AttachVolumeNegativeTest-server-2032096304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2032096304',id=2,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFki8rGEeYwlTJ6VZmSW6HvMwoFgfz2AbyUWqlbAWrVTvNMpttmtTrMMaSXUNN4EzYC2Ycm0RnaCP+vIwNXYe0/1suCwGsCzNG+uEYXy5P32t8Z2wOiPras2/Y0PFVNOBg==',key_name='tempest-keypair-523617607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18f1a3d6f5994f6eb15e0ab2294efd53',ramdisk_id='',reservation_id='r-u6v3eet4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-648523364',owner_user_name='tempest-AttachVolumeNegativeTest-648523364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:36:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd39b87d15084d84983873b59f36a211',uuid=42760d1a-1d14-47bb-a602-6eb3ed5205d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "address": "fa:16:3e:1d:ad:ca", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb15f2-12", "ovs_interfaceid": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converting VIF {"id": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "address": "fa:16:3e:1d:ad:ca", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb15f2-12", "ovs_interfaceid": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ad:ca,bridge_name='br-int',has_traffic_filtering=True,id=c4bb15f2-129e-4c14-bc47-ebe84aec2d7e,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb15f2-12') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.objects.instance [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'pci_devices' on Instance uuid 42760d1a-1d14-47bb-a602-6eb3ed5205d4 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:36:31 user nova-compute[75210]:   <uuid>42760d1a-1d14-47bb-a602-6eb3ed5205d4</uuid>
Nov 29 01:36:31 user nova-compute[75210]:   <name>instance-00000002</name>
Nov 29 01:36:31 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:36:31 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:36:31 user nova-compute[75210]:   <metadata>
Nov 29 01:36:31 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:36:31 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:36:31 user nova-compute[75210]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2032096304</nova:name>
Nov 29 01:36:31 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:36:31</nova:creationTime>
Nov 29 01:36:31 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:36:31 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:36:31 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:36:31 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:36:31 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:36:31 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:36:31 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:36:31 user nova-compute[75210]:       <nova:owner>
Nov 29 01:36:31 user nova-compute[75210]:         <nova:user uuid="bd39b87d15084d84983873b59f36a211">tempest-AttachVolumeNegativeTest-648523364-project-member</nova:user>
Nov 29 01:36:31 user nova-compute[75210]:         <nova:project uuid="18f1a3d6f5994f6eb15e0ab2294efd53">tempest-AttachVolumeNegativeTest-648523364</nova:project>
Nov 29 01:36:31 user nova-compute[75210]:       </nova:owner>
Nov 29 01:36:31 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:36:31 user nova-compute[75210]:       <nova:ports>
Nov 29 01:36:31 user nova-compute[75210]:         <nova:port uuid="c4bb15f2-129e-4c14-bc47-ebe84aec2d7e">
Nov 29 01:36:31 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 01:36:31 user nova-compute[75210]:         </nova:port>
Nov 29 01:36:31 user nova-compute[75210]:       </nova:ports>
Nov 29 01:36:31 user nova-compute[75210]:     </nova:instance>
Nov 29 01:36:31 user nova-compute[75210]:   </metadata>
Nov 29 01:36:31 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:36:31 user nova-compute[75210]:     <system>
Nov 29 01:36:31 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:36:31 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:36:31 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:36:31 user nova-compute[75210]:       <entry name="serial">42760d1a-1d14-47bb-a602-6eb3ed5205d4</entry>
Nov 29 01:36:31 user nova-compute[75210]:       <entry name="uuid">42760d1a-1d14-47bb-a602-6eb3ed5205d4</entry>
Nov 29 01:36:31 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:36:31 user nova-compute[75210]:     </system>
Nov 29 01:36:31 user nova-compute[75210]:   </sysinfo>
Nov 29 01:36:31 user nova-compute[75210]:   <os>
Nov 29 01:36:31 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:36:31 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:36:31 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:36:31 user nova-compute[75210]:   </os>
Nov 29 01:36:31 user nova-compute[75210]:   <features>
Nov 29 01:36:31 user nova-compute[75210]:     <acpi/>
Nov 29 01:36:31 user nova-compute[75210]:     <apic/>
Nov 29 01:36:31 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:36:31 user nova-compute[75210]:   </features>
Nov 29 01:36:31 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:36:31 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:36:31 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:36:31 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:36:31 user nova-compute[75210]:   </clock>
Nov 29 01:36:31 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:36:31 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:36:31 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:36:31 user nova-compute[75210]:   </cpu>
Nov 29 01:36:31 user nova-compute[75210]:   <devices>
Nov 29 01:36:31 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:36:31 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:36:31 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk"/>
Nov 29 01:36:31 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:36:31 user nova-compute[75210]:     </disk>
Nov 29 01:36:31 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:36:31 user nova-compute[75210]:       <mac address="fa:16:3e:1d:ad:ca"/>
Nov 29 01:36:31 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:36:31 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:36:31 user nova-compute[75210]:       <target dev="tapc4bb15f2-12"/>
Nov 29 01:36:31 user nova-compute[75210]:     </interface>
Nov 29 01:36:31 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:36:31 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/console.log" append="off"/>
Nov 29 01:36:31 user nova-compute[75210]:     </serial>
Nov 29 01:36:31 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:36:31 user nova-compute[75210]:     <video>
Nov 29 01:36:31 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:36:31 user nova-compute[75210]:     </video>
Nov 29 01:36:31 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:36:31 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:36:31 user nova-compute[75210]:     </rng>
Nov 29 01:36:31 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:36:31 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:36:31 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:36:31 user nova-compute[75210]:     </memballoon>
Nov 29 01:36:31 user nova-compute[75210]:   </devices>
Nov 29 01:36:31 user nova-compute[75210]: </domain>
Nov 29 01:36:31 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2032096304',display_name='tempest-AttachVolumeNegativeTest-server-2032096304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2032096304',id=2,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFki8rGEeYwlTJ6VZmSW6HvMwoFgfz2AbyUWqlbAWrVTvNMpttmtTrMMaSXUNN4EzYC2Ycm0RnaCP+vIwNXYe0/1suCwGsCzNG+uEYXy5P32t8Z2wOiPras2/Y0PFVNOBg==',key_name='tempest-keypair-523617607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18f1a3d6f5994f6eb15e0ab2294efd53',ramdisk_id='',reservation_id='r-u6v3eet4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-648523364',owner_user_name='tempest-AttachVolumeNegativeTest-648523364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:36:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd39b87d15084d84983873b59f36a211',uuid=42760d1a-1d14-47bb-a602-6eb3ed5205d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "address": "fa:16:3e:1d:ad:ca", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb15f2-12", "ovs_interfaceid": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converting VIF {"id": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "address": "fa:16:3e:1d:ad:ca", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb15f2-12", "ovs_interfaceid": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ad:ca,bridge_name='br-int',has_traffic_filtering=True,id=c4bb15f2-129e-4c14-bc47-ebe84aec2d7e,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb15f2-12') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG os_vif [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ad:ca,bridge_name='br-int',has_traffic_filtering=True,id=c4bb15f2-129e-4c14-bc47-ebe84aec2d7e,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb15f2-12') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4271e6e-3084-5e83-a1cf-d224528e95f5', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:36:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd660481b-c4, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd660481b-c4, col_values=(('qos', UUID('a09a4d3f-4a8c-4a24-8947-97c4a9398e9d')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd660481b-c4, col_values=(('external_ids', {'iface-id': 'd660481b-c417-49b9-9efe-9a11b09edc5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:ed:7f', 'vm-uuid': '18aa0259-a720-42aa-be33-4a676dd4d0e7'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:32 user nova-compute[75210]: INFO os_vif [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:ed:7f,bridge_name='br-int',has_traffic_filtering=True,id=d660481b-c417-49b9-9efe-9a11b09edc5b,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd660481b-c4')
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4bb15f2-12, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4bb15f2-12, col_values=(('qos', UUID('f439a9c2-2884-4d74-928f-d2b3ffc9a35a')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4bb15f2-12, col_values=(('external_ids', {'iface-id': 'c4bb15f2-129e-4c14-bc47-ebe84aec2d7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:ad:ca', 'vm-uuid': '42760d1a-1d14-47bb-a602-6eb3ed5205d4'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:32 user nova-compute[75210]: INFO os_vif [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:ad:ca,bridge_name='br-int',has_traffic_filtering=True,id=c4bb15f2-129e-4c14-bc47-ebe84aec2d7e,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb15f2-12')
Nov 29 01:36:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] No VIF found with MAC fa:16:3e:69:ed:7f, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No VIF found with MAC fa:16:3e:1d:ad:ca, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG nova.network.neutron [req-c9010fc7-4f8f-43e7-a42a-34d33b902536 req-6587e9f0-43a8-4937-99ad-5b06a5d39524 service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Updated VIF entry in instance network info cache for port c4bb15f2-129e-4c14-bc47-ebe84aec2d7e. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG nova.network.neutron [req-c9010fc7-4f8f-43e7-a42a-34d33b902536 req-6587e9f0-43a8-4937-99ad-5b06a5d39524 service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Updating instance_info_cache with network_info: [{"id": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "address": "fa:16:3e:1d:ad:ca", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb15f2-12", "ovs_interfaceid": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c9010fc7-4f8f-43e7-a42a-34d33b902536 req-6587e9f0-43a8-4937-99ad-5b06a5d39524 service nova] Releasing lock "refresh_cache-42760d1a-1d14-47bb-a602-6eb3ed5205d4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:36:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:36:37 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Instance spawned successfully.
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:36:37 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Instance spawned successfully.
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:38 user nova-compute[75210]: INFO nova.compute.manager [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Took 11.23 seconds to spawn the instance on the hypervisor.
Nov 29 01:36:38 user nova-compute[75210]: DEBUG nova.compute.manager [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:36:38 user nova-compute[75210]: INFO nova.compute.manager [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Took 13.78 seconds to spawn the instance on the hypervisor.
Nov 29 01:36:38 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:36:38 user nova-compute[75210]: INFO nova.compute.manager [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Took 12.16 seconds to build instance.
Nov 29 01:36:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-706609dc-8af1-4747-a37c-3bdf537886ab tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.351s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:38 user nova-compute[75210]: INFO nova.compute.manager [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Took 14.83 seconds to build instance.
Nov 29 01:36:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ffa75473-e53a-4835-a780-28b1e2ff3fab tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.307s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-b7cf72b8-c27e-4378-8aad-43f39f359b38 req-859b29d7-637d-4e01-9302-e9a1a92f769c service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Received event network-vif-plugged-d660481b-c417-49b9-9efe-9a11b09edc5b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:36:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b7cf72b8-c27e-4378-8aad-43f39f359b38 req-859b29d7-637d-4e01-9302-e9a1a92f769c service nova] Acquiring lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b7cf72b8-c27e-4378-8aad-43f39f359b38 req-859b29d7-637d-4e01-9302-e9a1a92f769c service nova] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b7cf72b8-c27e-4378-8aad-43f39f359b38 req-859b29d7-637d-4e01-9302-e9a1a92f769c service nova] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-b7cf72b8-c27e-4378-8aad-43f39f359b38 req-859b29d7-637d-4e01-9302-e9a1a92f769c service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] No waiting events found dispatching network-vif-plugged-d660481b-c417-49b9-9efe-9a11b09edc5b {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:36:43 user nova-compute[75210]: WARNING nova.compute.manager [req-b7cf72b8-c27e-4378-8aad-43f39f359b38 req-859b29d7-637d-4e01-9302-e9a1a92f769c service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Received unexpected event network-vif-plugged-d660481b-c417-49b9-9efe-9a11b09edc5b for instance with vm_state active and task_state None.
Nov 29 01:36:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:36:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:43 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:36:43 user nova-compute[75210]: INFO nova.compute.claims [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Claim successful on node user
Nov 29 01:36:44 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:36:44 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:36:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:44 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:36:44 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:36:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:36:44 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:36:44 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:36:44 user nova-compute[75210]: DEBUG nova.policy [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b74bb613cf57414b8495c3391821442e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ac01a07914222b8d881ce54802dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:36:44 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:36:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:36:44 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Creating image(s)
Nov 29 01:36:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "/opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "/opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "/opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.331s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG nova.compute.manager [req-ff21fa35-5698-45bb-9039-55ea5ceaf8ae req-57c10a90-c789-4d5e-9368-061dd6914426 service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Received event network-vif-plugged-d660481b-c417-49b9-9efe-9a11b09edc5b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ff21fa35-5698-45bb-9039-55ea5ceaf8ae req-57c10a90-c789-4d5e-9368-061dd6914426 service nova] Acquiring lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ff21fa35-5698-45bb-9039-55ea5ceaf8ae req-57c10a90-c789-4d5e-9368-061dd6914426 service nova] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ff21fa35-5698-45bb-9039-55ea5ceaf8ae req-57c10a90-c789-4d5e-9368-061dd6914426 service nova] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG nova.compute.manager [req-ff21fa35-5698-45bb-9039-55ea5ceaf8ae req-57c10a90-c789-4d5e-9368-061dd6914426 service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] No waiting events found dispatching network-vif-plugged-d660481b-c417-49b9-9efe-9a11b09edc5b {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:36:45 user nova-compute[75210]: WARNING nova.compute.manager [req-ff21fa35-5698-45bb-9039-55ea5ceaf8ae req-57c10a90-c789-4d5e-9368-061dd6914426 service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Received unexpected event network-vif-plugged-d660481b-c417-49b9-9efe-9a11b09edc5b for instance with vm_state active and task_state None.
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.272s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk 1073741824" returned: 0 in 0.079s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.223s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Cannot resize image /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Ensure instance console log exists: /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:46 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Successfully created port: 5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:36:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:46 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:36:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:36:47 user nova-compute[75210]: INFO nova.compute.claims [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Claim successful on node user
Nov 29 01:36:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:47 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:36:47 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:36:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:36:48 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:36:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Successfully updated port: 5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "refresh_cache-088f3f0c-2895-46f9-9697-a48d35a1f6f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquired lock "refresh_cache-088f3f0c-2895-46f9-9697-a48d35a1f6f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG nova.compute.manager [req-4c0f3b8e-9855-4f63-b33a-294b4028c45b req-f13c7602-dc24-4a63-8a9b-94352977822f service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Received event network-changed-5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG nova.compute.manager [req-4c0f3b8e-9855-4f63-b33a-294b4028c45b req-f13c7602-dc24-4a63-8a9b-94352977822f service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Refreshing instance network info cache due to event network-changed-5b7af5ad-622c-41e2-a119-90373684cf5b. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4c0f3b8e-9855-4f63-b33a-294b4028c45b req-f13c7602-dc24-4a63-8a9b-94352977822f service nova] Acquiring lock "refresh_cache-088f3f0c-2895-46f9-9697-a48d35a1f6f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG nova.policy [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40bd0a0fcbaa47deac0d46734d73eea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68ae9a24730042c7804b969aa21d7cbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:36:48 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Creating image(s)
Nov 29 01:36:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "/opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "/opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.218s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.276s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk 1073741824" returned: 0 in 0.071s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.237s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Updating instance_info_cache with network_info: [{"id": "5b7af5ad-622c-41e2-a119-90373684cf5b", "address": "fa:16:3e:f8:8f:ff", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b7af5ad-62", "ovs_interfaceid": "5b7af5ad-622c-41e2-a119-90373684cf5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Releasing lock "refresh_cache-088f3f0c-2895-46f9-9697-a48d35a1f6f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Instance network_info: |[{"id": "5b7af5ad-622c-41e2-a119-90373684cf5b", "address": "fa:16:3e:f8:8f:ff", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b7af5ad-62", "ovs_interfaceid": "5b7af5ad-622c-41e2-a119-90373684cf5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4c0f3b8e-9855-4f63-b33a-294b4028c45b req-f13c7602-dc24-4a63-8a9b-94352977822f service nova] Acquired lock "refresh_cache-088f3f0c-2895-46f9-9697-a48d35a1f6f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.network.neutron [req-4c0f3b8e-9855-4f63-b33a-294b4028c45b req-f13c7602-dc24-4a63-8a9b-94352977822f service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Refreshing network info cache for port 5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Start _get_guest_xml network_info=[{"id": "5b7af5ad-622c-41e2-a119-90373684cf5b", "address": "fa:16:3e:f8:8f:ff", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b7af5ad-62", "ovs_interfaceid": "5b7af5ad-622c-41e2-a119-90373684cf5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:36:49 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:36:49 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-257372102',display_name='tempest-VolumesAdminNegativeTest-server-257372102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-257372102',id=3,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgUcdoVWAcvPBZ+dc6nsBHB90VLo6JfjCA06Cky09pTVFthdIM2RwEB1nq9ZPo4SwgON4K8u77ijWOBMbbzLj0G3Xg24Oc6wK02UQIwqnDDKq4aVQ5I5JcNlNH9756Ncg==',key_name='tempest-keypair-1711966757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='633ac01a07914222b8d881ce54802dbd',ramdisk_id='',reservation_id='r-6386qqyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1252348372',owner_user_name='tempest-VolumesAdminNegativeTest-1252348372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:36:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74bb613cf57414b8495c3391821442e',uuid=088f3f0c-2895-46f9-9697-a48d35a1f6f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b7af5ad-622c-41e2-a119-90373684cf5b", "address": "fa:16:3e:f8:8f:ff", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b7af5ad-62", "ovs_interfaceid": "5b7af5ad-622c-41e2-a119-90373684cf5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Converting VIF {"id": "5b7af5ad-622c-41e2-a119-90373684cf5b", "address": "fa:16:3e:f8:8f:ff", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b7af5ad-62", "ovs_interfaceid": "5b7af5ad-622c-41e2-a119-90373684cf5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:8f:ff,bridge_name='br-int',has_traffic_filtering=True,id=5b7af5ad-622c-41e2-a119-90373684cf5b,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b7af5ad-62') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.objects.instance [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lazy-loading 'pci_devices' on Instance uuid 088f3f0c-2895-46f9-9697-a48d35a1f6f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Cannot resize image /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Ensure instance console log exists: /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:36:49 user nova-compute[75210]:   <uuid>088f3f0c-2895-46f9-9697-a48d35a1f6f6</uuid>
Nov 29 01:36:49 user nova-compute[75210]:   <name>instance-00000003</name>
Nov 29 01:36:49 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:36:49 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:36:49 user nova-compute[75210]:   <metadata>
Nov 29 01:36:49 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:36:49 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:36:49 user nova-compute[75210]:       <nova:name>tempest-VolumesAdminNegativeTest-server-257372102</nova:name>
Nov 29 01:36:49 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:36:49</nova:creationTime>
Nov 29 01:36:49 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:36:49 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:36:49 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:36:49 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:36:49 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:36:49 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:36:49 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:36:49 user nova-compute[75210]:       <nova:owner>
Nov 29 01:36:49 user nova-compute[75210]:         <nova:user uuid="b74bb613cf57414b8495c3391821442e">tempest-VolumesAdminNegativeTest-1252348372-project-member</nova:user>
Nov 29 01:36:49 user nova-compute[75210]:         <nova:project uuid="633ac01a07914222b8d881ce54802dbd">tempest-VolumesAdminNegativeTest-1252348372</nova:project>
Nov 29 01:36:49 user nova-compute[75210]:       </nova:owner>
Nov 29 01:36:49 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:36:49 user nova-compute[75210]:       <nova:ports>
Nov 29 01:36:49 user nova-compute[75210]:         <nova:port uuid="5b7af5ad-622c-41e2-a119-90373684cf5b">
Nov 29 01:36:49 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 01:36:49 user nova-compute[75210]:         </nova:port>
Nov 29 01:36:49 user nova-compute[75210]:       </nova:ports>
Nov 29 01:36:49 user nova-compute[75210]:     </nova:instance>
Nov 29 01:36:49 user nova-compute[75210]:   </metadata>
Nov 29 01:36:49 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:36:49 user nova-compute[75210]:     <system>
Nov 29 01:36:49 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:36:49 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:36:49 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:36:49 user nova-compute[75210]:       <entry name="serial">088f3f0c-2895-46f9-9697-a48d35a1f6f6</entry>
Nov 29 01:36:49 user nova-compute[75210]:       <entry name="uuid">088f3f0c-2895-46f9-9697-a48d35a1f6f6</entry>
Nov 29 01:36:49 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:36:49 user nova-compute[75210]:     </system>
Nov 29 01:36:49 user nova-compute[75210]:   </sysinfo>
Nov 29 01:36:49 user nova-compute[75210]:   <os>
Nov 29 01:36:49 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:36:49 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:36:49 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:36:49 user nova-compute[75210]:   </os>
Nov 29 01:36:49 user nova-compute[75210]:   <features>
Nov 29 01:36:49 user nova-compute[75210]:     <acpi/>
Nov 29 01:36:49 user nova-compute[75210]:     <apic/>
Nov 29 01:36:49 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:36:49 user nova-compute[75210]:   </features>
Nov 29 01:36:49 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:36:49 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:36:49 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:36:49 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:36:49 user nova-compute[75210]:   </clock>
Nov 29 01:36:49 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:36:49 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:36:49 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:36:49 user nova-compute[75210]:   </cpu>
Nov 29 01:36:49 user nova-compute[75210]:   <devices>
Nov 29 01:36:49 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:36:49 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:36:49 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk"/>
Nov 29 01:36:49 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:36:49 user nova-compute[75210]:     </disk>
Nov 29 01:36:49 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:36:49 user nova-compute[75210]:       <mac address="fa:16:3e:f8:8f:ff"/>
Nov 29 01:36:49 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:36:49 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:36:49 user nova-compute[75210]:       <target dev="tap5b7af5ad-62"/>
Nov 29 01:36:49 user nova-compute[75210]:     </interface>
Nov 29 01:36:49 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:36:49 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/console.log" append="off"/>
Nov 29 01:36:49 user nova-compute[75210]:     </serial>
Nov 29 01:36:49 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:36:49 user nova-compute[75210]:     <video>
Nov 29 01:36:49 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:36:49 user nova-compute[75210]:     </video>
Nov 29 01:36:49 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:36:49 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:36:49 user nova-compute[75210]:     </rng>
Nov 29 01:36:49 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:36:49 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:36:49 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:36:49 user nova-compute[75210]:     </memballoon>
Nov 29 01:36:49 user nova-compute[75210]:   </devices>
Nov 29 01:36:49 user nova-compute[75210]: </domain>
Nov 29 01:36:49 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-257372102',display_name='tempest-VolumesAdminNegativeTest-server-257372102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-257372102',id=3,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgUcdoVWAcvPBZ+dc6nsBHB90VLo6JfjCA06Cky09pTVFthdIM2RwEB1nq9ZPo4SwgON4K8u77ijWOBMbbzLj0G3Xg24Oc6wK02UQIwqnDDKq4aVQ5I5JcNlNH9756Ncg==',key_name='tempest-keypair-1711966757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='633ac01a07914222b8d881ce54802dbd',ramdisk_id='',reservation_id='r-6386qqyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1252348372',owner_user_name='tempest-VolumesAdminNegativeTest-1252348372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:36:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74bb613cf57414b8495c3391821442e',uuid=088f3f0c-2895-46f9-9697-a48d35a1f6f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b7af5ad-622c-41e2-a119-90373684cf5b", "address": "fa:16:3e:f8:8f:ff", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b7af5ad-62", "ovs_interfaceid": "5b7af5ad-622c-41e2-a119-90373684cf5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Converting VIF {"id": "5b7af5ad-622c-41e2-a119-90373684cf5b", "address": "fa:16:3e:f8:8f:ff", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b7af5ad-62", "ovs_interfaceid": "5b7af5ad-622c-41e2-a119-90373684cf5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:8f:ff,bridge_name='br-int',has_traffic_filtering=True,id=5b7af5ad-622c-41e2-a119-90373684cf5b,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b7af5ad-62') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG os_vif [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:8f:ff,bridge_name='br-int',has_traffic_filtering=True,id=5b7af5ad-622c-41e2-a119-90373684cf5b,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b7af5ad-62') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fff11440-1742-54e3-9cde-207851f24bfd', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b7af5ad-62, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b7af5ad-62, col_values=(('qos', UUID('04d6b9ef-7ac0-4768-90a9-d3c1149b0dc2')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b7af5ad-62, col_values=(('external_ids', {'iface-id': '5b7af5ad-622c-41e2-a119-90373684cf5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:8f:ff', 'vm-uuid': '088f3f0c-2895-46f9-9697-a48d35a1f6f6'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:50 user nova-compute[75210]: INFO os_vif [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:8f:ff,bridge_name='br-int',has_traffic_filtering=True,id=5b7af5ad-622c-41e2-a119-90373684cf5b,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b7af5ad-62')
Nov 29 01:36:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] No VIF found with MAC fa:16:3e:f8:8f:ff, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-1a983098-4a3c-4aff-95ce-251378cddb7b req-52447da5-a3aa-44f3-81cd-72bc044978df service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Received event network-vif-plugged-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a983098-4a3c-4aff-95ce-251378cddb7b req-52447da5-a3aa-44f3-81cd-72bc044978df service nova] Acquiring lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a983098-4a3c-4aff-95ce-251378cddb7b req-52447da5-a3aa-44f3-81cd-72bc044978df service nova] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a983098-4a3c-4aff-95ce-251378cddb7b req-52447da5-a3aa-44f3-81cd-72bc044978df service nova] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-1a983098-4a3c-4aff-95ce-251378cddb7b req-52447da5-a3aa-44f3-81cd-72bc044978df service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] No waiting events found dispatching network-vif-plugged-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:36:50 user nova-compute[75210]: WARNING nova.compute.manager [req-1a983098-4a3c-4aff-95ce-251378cddb7b req-52447da5-a3aa-44f3-81cd-72bc044978df service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Received unexpected event network-vif-plugged-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e for instance with vm_state active and task_state None.
Nov 29 01:36:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-1a983098-4a3c-4aff-95ce-251378cddb7b req-52447da5-a3aa-44f3-81cd-72bc044978df service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Received event network-vif-plugged-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a983098-4a3c-4aff-95ce-251378cddb7b req-52447da5-a3aa-44f3-81cd-72bc044978df service nova] Acquiring lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a983098-4a3c-4aff-95ce-251378cddb7b req-52447da5-a3aa-44f3-81cd-72bc044978df service nova] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a983098-4a3c-4aff-95ce-251378cddb7b req-52447da5-a3aa-44f3-81cd-72bc044978df service nova] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-1a983098-4a3c-4aff-95ce-251378cddb7b req-52447da5-a3aa-44f3-81cd-72bc044978df service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] No waiting events found dispatching network-vif-plugged-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:36:50 user nova-compute[75210]: WARNING nova.compute.manager [req-1a983098-4a3c-4aff-95ce-251378cddb7b req-52447da5-a3aa-44f3-81cd-72bc044978df service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Received unexpected event network-vif-plugged-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e for instance with vm_state active and task_state None.
Nov 29 01:36:51 user nova-compute[75210]: DEBUG nova.network.neutron [req-4c0f3b8e-9855-4f63-b33a-294b4028c45b req-f13c7602-dc24-4a63-8a9b-94352977822f service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Updated VIF entry in instance network info cache for port 5b7af5ad-622c-41e2-a119-90373684cf5b. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:36:51 user nova-compute[75210]: DEBUG nova.network.neutron [req-4c0f3b8e-9855-4f63-b33a-294b4028c45b req-f13c7602-dc24-4a63-8a9b-94352977822f service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Updating instance_info_cache with network_info: [{"id": "5b7af5ad-622c-41e2-a119-90373684cf5b", "address": "fa:16:3e:f8:8f:ff", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b7af5ad-62", "ovs_interfaceid": "5b7af5ad-622c-41e2-a119-90373684cf5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:36:51 user nova-compute[75210]: DEBUG nova.network.neutron [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Successfully created port: 98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:36:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4c0f3b8e-9855-4f63-b33a-294b4028c45b req-f13c7602-dc24-4a63-8a9b-94352977822f service nova] Releasing lock "refresh_cache-088f3f0c-2895-46f9-9697-a48d35a1f6f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:36:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Successfully updated port: 98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "refresh_cache-6cb707b0-aa06-42ee-abd8-f18d01c7cef9" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquired lock "refresh_cache-6cb707b0-aa06-42ee-abd8-f18d01c7cef9" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:36:52 user nova-compute[75210]: INFO nova.compute.claims [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Claim successful on node user
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Updating instance_info_cache with network_info: [{"id": "98e39171-cc87-49a9-ac90-e31419ea55df", "address": "fa:16:3e:dc:86:85", "network": {"id": "7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815609002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ae9a24730042c7804b969aa21d7cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e39171-cc", "ovs_interfaceid": "98e39171-cc87-49a9-ac90-e31419ea55df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Releasing lock "refresh_cache-6cb707b0-aa06-42ee-abd8-f18d01c7cef9" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Instance network_info: |[{"id": "98e39171-cc87-49a9-ac90-e31419ea55df", "address": "fa:16:3e:dc:86:85", "network": {"id": "7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815609002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ae9a24730042c7804b969aa21d7cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e39171-cc", "ovs_interfaceid": "98e39171-cc87-49a9-ac90-e31419ea55df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Start _get_guest_xml network_info=[{"id": "98e39171-cc87-49a9-ac90-e31419ea55df", "address": "fa:16:3e:dc:86:85", "network": {"id": "7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815609002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ae9a24730042c7804b969aa21d7cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e39171-cc", "ovs_interfaceid": "98e39171-cc87-49a9-ac90-e31419ea55df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:36:52 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:36:52 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1250778166',display_name='tempest-TestVolumeSwap-server-1250778166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1250778166',id=4,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlK+etZe5D6/obD2kuediCpusEN1jvEHUepkxdJj5g3TkbOCUd0+tuiCW22XL1PWipKmFLQy4qMvev2/jGysNJeOZ5MedcpVJ1CJWgY4dJQNza6unhMRYsTFA2V2GfHag==',key_name='tempest-keypair-1839542723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ae9a24730042c7804b969aa21d7cbd',ramdisk_id='',reservation_id='r-r6m13lk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-6984957',owner_user_name='tempest-TestVolumeSwap-6984957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bd0a0fcbaa47deac0d46734d73eea1',uuid=6cb707b0-aa06-42ee-abd8-f18d01c7cef9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98e39171-cc87-49a9-ac90-e31419ea55df", "address": "fa:16:3e:dc:86:85", "network": {"id": "7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815609002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ae9a24730042c7804b969aa21d7cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e39171-cc", "ovs_interfaceid": "98e39171-cc87-49a9-ac90-e31419ea55df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Converting VIF {"id": "98e39171-cc87-49a9-ac90-e31419ea55df", "address": "fa:16:3e:dc:86:85", "network": {"id": "7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815609002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ae9a24730042c7804b969aa21d7cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e39171-cc", "ovs_interfaceid": "98e39171-cc87-49a9-ac90-e31419ea55df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:85,bridge_name='br-int',has_traffic_filtering=True,id=98e39171-cc87-49a9-ac90-e31419ea55df,network=Network(7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e39171-cc') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.objects.instance [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-6ea08cb8-84de-4b1c-88d3-77540b8157d6 req-b0d993f2-a8bf-46fc-8234-c266271baa3b service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Received event network-changed-98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-6ea08cb8-84de-4b1c-88d3-77540b8157d6 req-b0d993f2-a8bf-46fc-8234-c266271baa3b service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Refreshing instance network info cache due to event network-changed-98e39171-cc87-49a9-ac90-e31419ea55df. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6ea08cb8-84de-4b1c-88d3-77540b8157d6 req-b0d993f2-a8bf-46fc-8234-c266271baa3b service nova] Acquiring lock "refresh_cache-6cb707b0-aa06-42ee-abd8-f18d01c7cef9" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6ea08cb8-84de-4b1c-88d3-77540b8157d6 req-b0d993f2-a8bf-46fc-8234-c266271baa3b service nova] Acquired lock "refresh_cache-6cb707b0-aa06-42ee-abd8-f18d01c7cef9" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.network.neutron [req-6ea08cb8-84de-4b1c-88d3-77540b8157d6 req-b0d993f2-a8bf-46fc-8234-c266271baa3b service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Refreshing network info cache for port 98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:36:52 user nova-compute[75210]:   <uuid>6cb707b0-aa06-42ee-abd8-f18d01c7cef9</uuid>
Nov 29 01:36:52 user nova-compute[75210]:   <name>instance-00000004</name>
Nov 29 01:36:52 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:36:52 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:36:52 user nova-compute[75210]:   <metadata>
Nov 29 01:36:52 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:36:52 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:36:52 user nova-compute[75210]:       <nova:name>tempest-TestVolumeSwap-server-1250778166</nova:name>
Nov 29 01:36:52 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:36:52</nova:creationTime>
Nov 29 01:36:52 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:36:52 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:36:52 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:36:52 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:36:52 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:36:52 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:36:52 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:36:52 user nova-compute[75210]:       <nova:owner>
Nov 29 01:36:52 user nova-compute[75210]:         <nova:user uuid="40bd0a0fcbaa47deac0d46734d73eea1">tempest-TestVolumeSwap-6984957-project-member</nova:user>
Nov 29 01:36:52 user nova-compute[75210]:         <nova:project uuid="68ae9a24730042c7804b969aa21d7cbd">tempest-TestVolumeSwap-6984957</nova:project>
Nov 29 01:36:52 user nova-compute[75210]:       </nova:owner>
Nov 29 01:36:52 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:36:52 user nova-compute[75210]:       <nova:ports>
Nov 29 01:36:52 user nova-compute[75210]:         <nova:port uuid="98e39171-cc87-49a9-ac90-e31419ea55df">
Nov 29 01:36:52 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 01:36:52 user nova-compute[75210]:         </nova:port>
Nov 29 01:36:52 user nova-compute[75210]:       </nova:ports>
Nov 29 01:36:52 user nova-compute[75210]:     </nova:instance>
Nov 29 01:36:52 user nova-compute[75210]:   </metadata>
Nov 29 01:36:52 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:36:52 user nova-compute[75210]:     <system>
Nov 29 01:36:52 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:36:52 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:36:52 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:36:52 user nova-compute[75210]:       <entry name="serial">6cb707b0-aa06-42ee-abd8-f18d01c7cef9</entry>
Nov 29 01:36:52 user nova-compute[75210]:       <entry name="uuid">6cb707b0-aa06-42ee-abd8-f18d01c7cef9</entry>
Nov 29 01:36:52 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:36:52 user nova-compute[75210]:     </system>
Nov 29 01:36:52 user nova-compute[75210]:   </sysinfo>
Nov 29 01:36:52 user nova-compute[75210]:   <os>
Nov 29 01:36:52 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:36:52 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:36:52 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:36:52 user nova-compute[75210]:   </os>
Nov 29 01:36:52 user nova-compute[75210]:   <features>
Nov 29 01:36:52 user nova-compute[75210]:     <acpi/>
Nov 29 01:36:52 user nova-compute[75210]:     <apic/>
Nov 29 01:36:52 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:36:52 user nova-compute[75210]:   </features>
Nov 29 01:36:52 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:36:52 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:36:52 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:36:52 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:36:52 user nova-compute[75210]:   </clock>
Nov 29 01:36:52 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:36:52 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:36:52 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:36:52 user nova-compute[75210]:   </cpu>
Nov 29 01:36:52 user nova-compute[75210]:   <devices>
Nov 29 01:36:52 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:36:52 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:36:52 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk"/>
Nov 29 01:36:52 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:36:52 user nova-compute[75210]:     </disk>
Nov 29 01:36:52 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:36:52 user nova-compute[75210]:       <mac address="fa:16:3e:dc:86:85"/>
Nov 29 01:36:52 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:36:52 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:36:52 user nova-compute[75210]:       <target dev="tap98e39171-cc"/>
Nov 29 01:36:52 user nova-compute[75210]:     </interface>
Nov 29 01:36:52 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:36:52 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/console.log" append="off"/>
Nov 29 01:36:52 user nova-compute[75210]:     </serial>
Nov 29 01:36:52 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:36:52 user nova-compute[75210]:     <video>
Nov 29 01:36:52 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:36:52 user nova-compute[75210]:     </video>
Nov 29 01:36:52 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:36:52 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:36:52 user nova-compute[75210]:     </rng>
Nov 29 01:36:52 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:36:52 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:36:52 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:36:52 user nova-compute[75210]:     </memballoon>
Nov 29 01:36:52 user nova-compute[75210]:   </devices>
Nov 29 01:36:52 user nova-compute[75210]: </domain>
Nov 29 01:36:52 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1250778166',display_name='tempest-TestVolumeSwap-server-1250778166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1250778166',id=4,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlK+etZe5D6/obD2kuediCpusEN1jvEHUepkxdJj5g3TkbOCUd0+tuiCW22XL1PWipKmFLQy4qMvev2/jGysNJeOZ5MedcpVJ1CJWgY4dJQNza6unhMRYsTFA2V2GfHag==',key_name='tempest-keypair-1839542723',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68ae9a24730042c7804b969aa21d7cbd',ramdisk_id='',reservation_id='r-r6m13lk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-6984957',owner_user_name='tempest-TestVolumeSwap-6984957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bd0a0fcbaa47deac0d46734d73eea1',uuid=6cb707b0-aa06-42ee-abd8-f18d01c7cef9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98e39171-cc87-49a9-ac90-e31419ea55df", "address": "fa:16:3e:dc:86:85", "network": {"id": "7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815609002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ae9a24730042c7804b969aa21d7cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e39171-cc", "ovs_interfaceid": "98e39171-cc87-49a9-ac90-e31419ea55df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Converting VIF {"id": "98e39171-cc87-49a9-ac90-e31419ea55df", "address": "fa:16:3e:dc:86:85", "network": {"id": "7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815609002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ae9a24730042c7804b969aa21d7cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e39171-cc", "ovs_interfaceid": "98e39171-cc87-49a9-ac90-e31419ea55df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:85,bridge_name='br-int',has_traffic_filtering=True,id=98e39171-cc87-49a9-ac90-e31419ea55df,network=Network(7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e39171-cc') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG os_vif [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:85,bridge_name='br-int',has_traffic_filtering=True,id=98e39171-cc87-49a9-ac90-e31419ea55df,network=Network(7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e39171-cc') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbb28a28-c99b-5816-83d1-5622e4ce6e0e', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98e39171-cc, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98e39171-cc, col_values=(('qos', UUID('e3984de9-6403-4c73-965e-e66dfaebcc10')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98e39171-cc, col_values=(('external_ids', {'iface-id': '98e39171-cc87-49a9-ac90-e31419ea55df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:86:85', 'vm-uuid': '6cb707b0-aa06-42ee-abd8-f18d01c7cef9'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:52 user nova-compute[75210]: INFO os_vif [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:86:85,bridge_name='br-int',has_traffic_filtering=True,id=98e39171-cc87-49a9-ac90-e31419ea55df,network=Network(7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e39171-cc')
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:36:52 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.786s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] No VIF found with MAC fa:16:3e:dc:86:85, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG nova.network.neutron [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:36:53 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 29 01:36:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG nova.policy [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4403a299971f4f6d9135bb92daa308e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f485dbe16514b79afba40741584e0eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:36:53 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Creating image(s)
Nov 29 01:36:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "/opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "/opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "/opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "11977382a99d9d182e0fc0150fea834ea7f9ccdb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "11977382a99d9d182e0fc0150fea834ea7f9ccdb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb.part --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.compute.manager [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:36:54 user nova-compute[75210]: INFO nova.compute.claims [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Claim successful on node user
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb.part --force-share --output=json" returned: 0 in 0.222s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.virt.images [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] 81ed5433-d1d5-4122-98bd-e514cef509b4 was qcow2, converting to raw {{(pid=75210) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb.part /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb.converted {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb.part /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb.converted" returned: 0 in 0.267s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb.converted --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:36:54 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Instance spawned successfully.
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.network.neutron [req-6ea08cb8-84de-4b1c-88d3-77540b8157d6 req-b0d993f2-a8bf-46fc-8234-c266271baa3b service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Updated VIF entry in instance network info cache for port 98e39171-cc87-49a9-ac90-e31419ea55df. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.network.neutron [req-6ea08cb8-84de-4b1c-88d3-77540b8157d6 req-b0d993f2-a8bf-46fc-8234-c266271baa3b service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Updating instance_info_cache with network_info: [{"id": "98e39171-cc87-49a9-ac90-e31419ea55df", "address": "fa:16:3e:dc:86:85", "network": {"id": "7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815609002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ae9a24730042c7804b969aa21d7cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e39171-cc", "ovs_interfaceid": "98e39171-cc87-49a9-ac90-e31419ea55df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6ea08cb8-84de-4b1c-88d3-77540b8157d6 req-b0d993f2-a8bf-46fc-8234-c266271baa3b service nova] Releasing lock "refresh_cache-6cb707b0-aa06-42ee-abd8-f18d01c7cef9" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "11977382a99d9d182e0fc0150fea834ea7f9ccdb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.261s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:54 user nova-compute[75210]: INFO nova.compute.manager [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Took 10.22 seconds to spawn the instance on the hypervisor.
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.713s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.compute.manager [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG nova.network.neutron [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Successfully created port: a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb --force-share --output=json" returned: 0 in 0.271s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "11977382a99d9d182e0fc0150fea834ea7f9ccdb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "11977382a99d9d182e0fc0150fea834ea7f9ccdb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG nova.network.neutron [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:36:55 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:36:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:55 user nova-compute[75210]: INFO nova.compute.manager [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Took 11.71 seconds to build instance.
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e24464a5-1bed-42b5-9314-51f70312d95a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.951s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb --force-share --output=json" returned: 0 in 0.279s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb,backing_fmt=raw /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG nova.policy [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '413fdbcc401e4fd99a537e93fea9eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d017f83b2449c18c70e3dbed78af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb,backing_fmt=raw /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk 1073741824" returned: 0 in 0.083s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "11977382a99d9d182e0fc0150fea834ea7f9ccdb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.369s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG nova.compute.manager [req-af1c5e72-82ca-46c8-888c-5e2acb88bd36 req-88c5654c-ed79-4e1c-a9fd-fdebf4433e80 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Received event network-vif-plugged-98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-af1c5e72-82ca-46c8-888c-5e2acb88bd36 req-88c5654c-ed79-4e1c-a9fd-fdebf4433e80 service nova] Acquiring lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-af1c5e72-82ca-46c8-888c-5e2acb88bd36 req-88c5654c-ed79-4e1c-a9fd-fdebf4433e80 service nova] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-af1c5e72-82ca-46c8-888c-5e2acb88bd36 req-88c5654c-ed79-4e1c-a9fd-fdebf4433e80 service nova] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG nova.compute.manager [req-af1c5e72-82ca-46c8-888c-5e2acb88bd36 req-88c5654c-ed79-4e1c-a9fd-fdebf4433e80 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] No waiting events found dispatching network-vif-plugged-98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:36:55 user nova-compute[75210]: WARNING nova.compute.manager [req-af1c5e72-82ca-46c8-888c-5e2acb88bd36 req-88c5654c-ed79-4e1c-a9fd-fdebf4433e80 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Received unexpected event network-vif-plugged-98e39171-cc87-49a9-ac90-e31419ea55df for instance with vm_state building and task_state spawning.
Nov 29 01:36:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:36:55 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Creating image(s)
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb --force-share --output=json" returned: 0 in 0.342s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.350s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json" returned: 0 in 0.321s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Cannot resize image /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Ensure instance console log exists: /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.364s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk 1073741824" returned: 0 in 0.083s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.457s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.276s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG nova.network.neutron [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Successfully updated port: a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "refresh_cache-fff9790b-6b08-43f9-8a71-577e9f1bf04c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquired lock "refresh_cache-fff9790b-6b08-43f9-8a71-577e9f1bf04c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG nova.network.neutron [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-0a214cac-81e6-4ee9-9c23-acd73561cc49 req-80b759d8-909a-4fee-bff2-8ffd4eef085c service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Received event network-changed-a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-0a214cac-81e6-4ee9-9c23-acd73561cc49 req-80b759d8-909a-4fee-bff2-8ffd4eef085c service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Refreshing instance network info cache due to event network-changed-a997a159-ff47-43b7-8aac-104013bc4db3. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0a214cac-81e6-4ee9-9c23-acd73561cc49 req-80b759d8-909a-4fee-bff2-8ffd4eef085c service nova] Acquiring lock "refresh_cache-fff9790b-6b08-43f9-8a71-577e9f1bf04c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Cannot resize image /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Ensure instance console log exists: /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.network.neutron [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.network.neutron [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Successfully created port: bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.compute.manager [req-d2c4cc40-81c8-43d2-8a13-f80ac3c3a6c5 req-8b69a6e6-bfce-4f6f-8c27-a836f523ff91 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Received event network-vif-plugged-98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d2c4cc40-81c8-43d2-8a13-f80ac3c3a6c5 req-8b69a6e6-bfce-4f6f-8c27-a836f523ff91 service nova] Acquiring lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d2c4cc40-81c8-43d2-8a13-f80ac3c3a6c5 req-8b69a6e6-bfce-4f6f-8c27-a836f523ff91 service nova] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d2c4cc40-81c8-43d2-8a13-f80ac3c3a6c5 req-8b69a6e6-bfce-4f6f-8c27-a836f523ff91 service nova] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.compute.manager [req-d2c4cc40-81c8-43d2-8a13-f80ac3c3a6c5 req-8b69a6e6-bfce-4f6f-8c27-a836f523ff91 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] No waiting events found dispatching network-vif-plugged-98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:36:57 user nova-compute[75210]: WARNING nova.compute.manager [req-d2c4cc40-81c8-43d2-8a13-f80ac3c3a6c5 req-8b69a6e6-bfce-4f6f-8c27-a836f523ff91 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Received unexpected event network-vif-plugged-98e39171-cc87-49a9-ac90-e31419ea55df for instance with vm_state building and task_state spawning.
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.network.neutron [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Updating instance_info_cache with network_info: [{"id": "a997a159-ff47-43b7-8aac-104013bc4db3", "address": "fa:16:3e:31:67:14", "network": {"id": "a9818bde-1a8a-4799-abfb-1a4c20f0a05f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-814349716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f485dbe16514b79afba40741584e0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa997a159-ff", "ovs_interfaceid": "a997a159-ff47-43b7-8aac-104013bc4db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:36:57 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Instance spawned successfully.
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Releasing lock "refresh_cache-fff9790b-6b08-43f9-8a71-577e9f1bf04c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Instance network_info: |[{"id": "a997a159-ff47-43b7-8aac-104013bc4db3", "address": "fa:16:3e:31:67:14", "network": {"id": "a9818bde-1a8a-4799-abfb-1a4c20f0a05f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-814349716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f485dbe16514b79afba40741584e0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa997a159-ff", "ovs_interfaceid": "a997a159-ff47-43b7-8aac-104013bc4db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0a214cac-81e6-4ee9-9c23-acd73561cc49 req-80b759d8-909a-4fee-bff2-8ffd4eef085c service nova] Acquired lock "refresh_cache-fff9790b-6b08-43f9-8a71-577e9f1bf04c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.network.neutron [req-0a214cac-81e6-4ee9-9c23-acd73561cc49 req-80b759d8-909a-4fee-bff2-8ffd4eef085c service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Refreshing network info cache for port a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Start _get_guest_xml network_info=[{"id": "a997a159-ff47-43b7-8aac-104013bc4db3", "address": "fa:16:3e:31:67:14", "network": {"id": "a9818bde-1a8a-4799-abfb-1a4c20f0a05f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-814349716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f485dbe16514b79afba40741584e0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa997a159-ff", "ovs_interfaceid": "a997a159-ff47-43b7-8aac-104013bc4db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:36:41Z,direct_url=<?>,disk_format='qcow2',id=81ed5433-d1d5-4122-98bd-e514cef509b4,min_disk=0,min_ram=0,name='',owner='e9f8f406eba7489d8962d4dc3bc90642',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:36:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'scsi', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'size': 0, 'image_id': '81ed5433-d1d5-4122-98bd-e514cef509b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:57 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:36:57 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:36:41Z,direct_url=<?>,disk_format='qcow2',id=81ed5433-d1d5-4122-98bd-e514cef509b4,min_disk=0,min_ram=0,name='',owner='e9f8f406eba7489d8962d4dc3bc90642',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:36:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:36:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-326911359',display_name='tempest-AttachSCSIVolumeTestJSON-server-326911359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-326911359',id=5,image_ref='81ed5433-d1d5-4122-98bd-e514cef509b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2JmJWyjNgeYuVAuu+BrREwnKnjcO2boWE/fkfGL//2RktkhREIpUCSdfmGv5pyvtTl6gCyspkZ68bgvgTG7IHBilYv0p8kdbTuoCqpvOw/Wpnij9d3/C5cPgtJBzf3YQ==',key_name='tempest-keypair-169331701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f485dbe16514b79afba40741584e0eb',ramdisk_id='',reservation_id='r-4zufkff3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='81ed5433-d1d5-4122-98bd-e514cef509b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1912120829',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1912120829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:36:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4403a299971f4f6d9135bb92daa308e9',uuid=fff9790b-6b08-43f9-8a71-577e9f1bf04c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a997a159-ff47-43b7-8aac-104013bc4db3", "address": "fa:16:3e:31:67:14", "network": {"id": "a9818bde-1a8a-4799-abfb-1a4c20f0a05f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-814349716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f485dbe16514b79afba40741584e0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa997a159-ff", "ovs_interfaceid": "a997a159-ff47-43b7-8aac-104013bc4db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Converting VIF {"id": "a997a159-ff47-43b7-8aac-104013bc4db3", "address": "fa:16:3e:31:67:14", "network": {"id": "a9818bde-1a8a-4799-abfb-1a4c20f0a05f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-814349716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f485dbe16514b79afba40741584e0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa997a159-ff", "ovs_interfaceid": "a997a159-ff47-43b7-8aac-104013bc4db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:67:14,bridge_name='br-int',has_traffic_filtering=True,id=a997a159-ff47-43b7-8aac-104013bc4db3,network=Network(a9818bde-1a8a-4799-abfb-1a4c20f0a05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa997a159-ff') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG nova.objects.instance [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lazy-loading 'pci_devices' on Instance uuid fff9790b-6b08-43f9-8a71-577e9f1bf04c {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:36:58 user nova-compute[75210]:   <uuid>fff9790b-6b08-43f9-8a71-577e9f1bf04c</uuid>
Nov 29 01:36:58 user nova-compute[75210]:   <name>instance-00000005</name>
Nov 29 01:36:58 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:36:58 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:36:58 user nova-compute[75210]:   <metadata>
Nov 29 01:36:58 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:36:58 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:36:58 user nova-compute[75210]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-326911359</nova:name>
Nov 29 01:36:58 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:36:57</nova:creationTime>
Nov 29 01:36:58 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:36:58 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:36:58 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:36:58 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:36:58 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:36:58 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:36:58 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:36:58 user nova-compute[75210]:       <nova:owner>
Nov 29 01:36:58 user nova-compute[75210]:         <nova:user uuid="4403a299971f4f6d9135bb92daa308e9">tempest-AttachSCSIVolumeTestJSON-1912120829-project-member</nova:user>
Nov 29 01:36:58 user nova-compute[75210]:         <nova:project uuid="4f485dbe16514b79afba40741584e0eb">tempest-AttachSCSIVolumeTestJSON-1912120829</nova:project>
Nov 29 01:36:58 user nova-compute[75210]:       </nova:owner>
Nov 29 01:36:58 user nova-compute[75210]:       <nova:root type="image" uuid="81ed5433-d1d5-4122-98bd-e514cef509b4"/>
Nov 29 01:36:58 user nova-compute[75210]:       <nova:ports>
Nov 29 01:36:58 user nova-compute[75210]:         <nova:port uuid="a997a159-ff47-43b7-8aac-104013bc4db3">
Nov 29 01:36:58 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 01:36:58 user nova-compute[75210]:         </nova:port>
Nov 29 01:36:58 user nova-compute[75210]:       </nova:ports>
Nov 29 01:36:58 user nova-compute[75210]:     </nova:instance>
Nov 29 01:36:58 user nova-compute[75210]:   </metadata>
Nov 29 01:36:58 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:36:58 user nova-compute[75210]:     <system>
Nov 29 01:36:58 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:36:58 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:36:58 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:36:58 user nova-compute[75210]:       <entry name="serial">fff9790b-6b08-43f9-8a71-577e9f1bf04c</entry>
Nov 29 01:36:58 user nova-compute[75210]:       <entry name="uuid">fff9790b-6b08-43f9-8a71-577e9f1bf04c</entry>
Nov 29 01:36:58 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:36:58 user nova-compute[75210]:     </system>
Nov 29 01:36:58 user nova-compute[75210]:   </sysinfo>
Nov 29 01:36:58 user nova-compute[75210]:   <os>
Nov 29 01:36:58 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:36:58 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:36:58 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:36:58 user nova-compute[75210]:   </os>
Nov 29 01:36:58 user nova-compute[75210]:   <features>
Nov 29 01:36:58 user nova-compute[75210]:     <acpi/>
Nov 29 01:36:58 user nova-compute[75210]:     <apic/>
Nov 29 01:36:58 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:36:58 user nova-compute[75210]:   </features>
Nov 29 01:36:58 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:36:58 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:36:58 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:36:58 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:36:58 user nova-compute[75210]:   </clock>
Nov 29 01:36:58 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:36:58 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:36:58 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:36:58 user nova-compute[75210]:   </cpu>
Nov 29 01:36:58 user nova-compute[75210]:   <devices>
Nov 29 01:36:58 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:36:58 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:36:58 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk"/>
Nov 29 01:36:58 user nova-compute[75210]:       <target dev="sda" bus="scsi"/>
Nov 29 01:36:58 user nova-compute[75210]:       <address type="drive" controller="0" unit="0"/>
Nov 29 01:36:58 user nova-compute[75210]:     </disk>
Nov 29 01:36:58 user nova-compute[75210]:     <disk type="file" device="cdrom">
Nov 29 01:36:58 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 01:36:58 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk.config"/>
Nov 29 01:36:58 user nova-compute[75210]:       <target dev="sdb" bus="scsi"/>
Nov 29 01:36:58 user nova-compute[75210]:       <address type="drive" controller="0" unit="1"/>
Nov 29 01:36:58 user nova-compute[75210]:     </disk>
Nov 29 01:36:58 user nova-compute[75210]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 29 01:36:58 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:36:58 user nova-compute[75210]:       <mac address="fa:16:3e:31:67:14"/>
Nov 29 01:36:58 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:36:58 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:36:58 user nova-compute[75210]:       <target dev="tapa997a159-ff"/>
Nov 29 01:36:58 user nova-compute[75210]:     </interface>
Nov 29 01:36:58 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:36:58 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/console.log" append="off"/>
Nov 29 01:36:58 user nova-compute[75210]:     </serial>
Nov 29 01:36:58 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:36:58 user nova-compute[75210]:     <video>
Nov 29 01:36:58 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:36:58 user nova-compute[75210]:     </video>
Nov 29 01:36:58 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:36:58 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:36:58 user nova-compute[75210]:     </rng>
Nov 29 01:36:58 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:36:58 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:36:58 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:36:58 user nova-compute[75210]:     </memballoon>
Nov 29 01:36:58 user nova-compute[75210]:   </devices>
Nov 29 01:36:58 user nova-compute[75210]: </domain>
Nov 29 01:36:58 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-326911359',display_name='tempest-AttachSCSIVolumeTestJSON-server-326911359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-326911359',id=5,image_ref='81ed5433-d1d5-4122-98bd-e514cef509b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2JmJWyjNgeYuVAuu+BrREwnKnjcO2boWE/fkfGL//2RktkhREIpUCSdfmGv5pyvtTl6gCyspkZ68bgvgTG7IHBilYv0p8kdbTuoCqpvOw/Wpnij9d3/C5cPgtJBzf3YQ==',key_name='tempest-keypair-169331701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f485dbe16514b79afba40741584e0eb',ramdisk_id='',reservation_id='r-4zufkff3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='81ed5433-d1d5-4122-98bd-e514cef509b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1912120829',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1912120829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:36:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4403a299971f4f6d9135bb92daa308e9',uuid=fff9790b-6b08-43f9-8a71-577e9f1bf04c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a997a159-ff47-43b7-8aac-104013bc4db3", "address": "fa:16:3e:31:67:14", "network": {"id": "a9818bde-1a8a-4799-abfb-1a4c20f0a05f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-814349716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f485dbe16514b79afba40741584e0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa997a159-ff", "ovs_interfaceid": "a997a159-ff47-43b7-8aac-104013bc4db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Converting VIF {"id": "a997a159-ff47-43b7-8aac-104013bc4db3", "address": "fa:16:3e:31:67:14", "network": {"id": "a9818bde-1a8a-4799-abfb-1a4c20f0a05f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-814349716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f485dbe16514b79afba40741584e0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa997a159-ff", "ovs_interfaceid": "a997a159-ff47-43b7-8aac-104013bc4db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:67:14,bridge_name='br-int',has_traffic_filtering=True,id=a997a159-ff47-43b7-8aac-104013bc4db3,network=Network(a9818bde-1a8a-4799-abfb-1a4c20f0a05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa997a159-ff') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG os_vif [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:67:14,bridge_name='br-int',has_traffic_filtering=True,id=a997a159-ff47-43b7-8aac-104013bc4db3,network=Network(a9818bde-1a8a-4799-abfb-1a4c20f0a05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa997a159-ff') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c77ef4e1-8bee-5e1d-8276-89a184b3b489', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa997a159-ff, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa997a159-ff, col_values=(('qos', UUID('7101ef6b-9ea8-479e-b8d5-f16e6e700ae4')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa997a159-ff, col_values=(('external_ids', {'iface-id': 'a997a159-ff47-43b7-8aac-104013bc4db3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:67:14', 'vm-uuid': 'fff9790b-6b08-43f9-8a71-577e9f1bf04c'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:58 user nova-compute[75210]: INFO nova.compute.manager [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Took 9.28 seconds to spawn the instance on the hypervisor.
Nov 29 01:36:58 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:36:58 user nova-compute[75210]: INFO os_vif [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:67:14,bridge_name='br-int',has_traffic_filtering=True,id=a997a159-ff47-43b7-8aac-104013bc4db3,network=Network(a9818bde-1a8a-4799-abfb-1a4c20f0a05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa997a159-ff')
Nov 29 01:36:58 user nova-compute[75210]: INFO nova.compute.manager [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Took 11.13 seconds to build instance.
Nov 29 01:36:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] No BDM found with device name sda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] No VIF found with MAC fa:16:3e:31:67:14, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:36:58 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Using config drive
Nov 29 01:36:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bee9c73e-ad99-4134-839c-72461f4d81d1 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.288s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:36:58 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Creating config drive at /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk.config
Nov 29 01:36:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzo31tu35 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:36:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzo31tu35" returned: 0 in 0.059s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG nova.network.neutron [req-0a214cac-81e6-4ee9-9c23-acd73561cc49 req-80b759d8-909a-4fee-bff2-8ffd4eef085c service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Updated VIF entry in instance network info cache for port a997a159-ff47-43b7-8aac-104013bc4db3. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG nova.network.neutron [req-0a214cac-81e6-4ee9-9c23-acd73561cc49 req-80b759d8-909a-4fee-bff2-8ffd4eef085c service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Updating instance_info_cache with network_info: [{"id": "a997a159-ff47-43b7-8aac-104013bc4db3", "address": "fa:16:3e:31:67:14", "network": {"id": "a9818bde-1a8a-4799-abfb-1a4c20f0a05f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-814349716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f485dbe16514b79afba40741584e0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa997a159-ff", "ovs_interfaceid": "a997a159-ff47-43b7-8aac-104013bc4db3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0a214cac-81e6-4ee9-9c23-acd73561cc49 req-80b759d8-909a-4fee-bff2-8ffd4eef085c service nova] Releasing lock "refresh_cache-fff9790b-6b08-43f9-8a71-577e9f1bf04c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG nova.network.neutron [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Successfully updated port: bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquired lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG nova.network.neutron [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG nova.compute.manager [req-70b4044a-9ef2-486a-876f-d1a1337c5100 req-3b3d995a-d474-4e8d-981f-b72c30cc6dcb service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-changed-bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG nova.compute.manager [req-70b4044a-9ef2-486a-876f-d1a1337c5100 req-3b3d995a-d474-4e8d-981f-b72c30cc6dcb service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Refreshing instance network info cache due to event network-changed-bddbec43-276a-4a46-a083-2aa153ccd4db. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-70b4044a-9ef2-486a-876f-d1a1337c5100 req-3b3d995a-d474-4e8d-981f-b72c30cc6dcb service nova] Acquiring lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Acquiring lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG nova.network.neutron [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:36:59 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:36:59 user nova-compute[75210]: INFO nova.compute.claims [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Claim successful on node user
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.network.neutron [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Updating instance_info_cache with network_info: [{"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Releasing lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.compute.manager [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Instance network_info: |[{"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-70b4044a-9ef2-486a-876f-d1a1337c5100 req-3b3d995a-d474-4e8d-981f-b72c30cc6dcb service nova] Acquired lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.network.neutron [req-70b4044a-9ef2-486a-876f-d1a1337c5100 req-3b3d995a-d474-4e8d-981f-b72c30cc6dcb service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Refreshing network info cache for port bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Start _get_guest_xml network_info=[{"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:37:00 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:37:00 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:36:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906023654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906023654',id=6,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmtm9Y/rL28hHvUP7150cqzO8TBgS/8Pwq7X/7Gtilm5Sd870B/ZK7bsEtY2wPDo+rNSG8X+Tp2Avrz3QbtDNgCJe0acCKnqRj8bkYwO8r/0na0wbSxh0PaL89RzsH/pA==',key_name='tempest-keypair-1039804411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08d017f83b2449c18c70e3dbed78af01',ramdisk_id='',reservation_id='r-c01u2q0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1153284446',owner_user_name='tempest-TaggedAttachmentsTest-1153284446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413fdbcc401e4fd99a537e93fea9eaa4',uuid=0d7f5bf7-edc1-465f-b24f-171d1481ffa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converting VIF {"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=bddbec43-276a-4a46-a083-2aa153ccd4db,network=Network(84bcba04-97bf-40de-b5c5-68a41a393f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddbec43-27') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.objects.instance [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:37:00 user nova-compute[75210]:   <uuid>0d7f5bf7-edc1-465f-b24f-171d1481ffa0</uuid>
Nov 29 01:37:00 user nova-compute[75210]:   <name>instance-00000006</name>
Nov 29 01:37:00 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:37:00 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:37:00 user nova-compute[75210]:   <metadata>
Nov 29 01:37:00 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:37:00 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:37:00 user nova-compute[75210]:       <nova:name>tempest-device-tagging-server-1906023654</nova:name>
Nov 29 01:37:00 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:37:00</nova:creationTime>
Nov 29 01:37:00 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:37:00 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:37:00 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:37:00 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:37:00 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:37:00 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:37:00 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:37:00 user nova-compute[75210]:       <nova:owner>
Nov 29 01:37:00 user nova-compute[75210]:         <nova:user uuid="413fdbcc401e4fd99a537e93fea9eaa4">tempest-TaggedAttachmentsTest-1153284446-project-member</nova:user>
Nov 29 01:37:00 user nova-compute[75210]:         <nova:project uuid="08d017f83b2449c18c70e3dbed78af01">tempest-TaggedAttachmentsTest-1153284446</nova:project>
Nov 29 01:37:00 user nova-compute[75210]:       </nova:owner>
Nov 29 01:37:00 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:37:00 user nova-compute[75210]:       <nova:ports>
Nov 29 01:37:00 user nova-compute[75210]:         <nova:port uuid="bddbec43-276a-4a46-a083-2aa153ccd4db">
Nov 29 01:37:00 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:37:00 user nova-compute[75210]:         </nova:port>
Nov 29 01:37:00 user nova-compute[75210]:       </nova:ports>
Nov 29 01:37:00 user nova-compute[75210]:     </nova:instance>
Nov 29 01:37:00 user nova-compute[75210]:   </metadata>
Nov 29 01:37:00 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:37:00 user nova-compute[75210]:     <system>
Nov 29 01:37:00 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:37:00 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:37:00 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:37:00 user nova-compute[75210]:       <entry name="serial">0d7f5bf7-edc1-465f-b24f-171d1481ffa0</entry>
Nov 29 01:37:00 user nova-compute[75210]:       <entry name="uuid">0d7f5bf7-edc1-465f-b24f-171d1481ffa0</entry>
Nov 29 01:37:00 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:37:00 user nova-compute[75210]:     </system>
Nov 29 01:37:00 user nova-compute[75210]:   </sysinfo>
Nov 29 01:37:00 user nova-compute[75210]:   <os>
Nov 29 01:37:00 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:37:00 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:37:00 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:37:00 user nova-compute[75210]:   </os>
Nov 29 01:37:00 user nova-compute[75210]:   <features>
Nov 29 01:37:00 user nova-compute[75210]:     <acpi/>
Nov 29 01:37:00 user nova-compute[75210]:     <apic/>
Nov 29 01:37:00 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:37:00 user nova-compute[75210]:   </features>
Nov 29 01:37:00 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:37:00 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:37:00 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:37:00 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:37:00 user nova-compute[75210]:   </clock>
Nov 29 01:37:00 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:37:00 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:37:00 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:37:00 user nova-compute[75210]:   </cpu>
Nov 29 01:37:00 user nova-compute[75210]:   <devices>
Nov 29 01:37:00 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:37:00 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:37:00 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk"/>
Nov 29 01:37:00 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:37:00 user nova-compute[75210]:     </disk>
Nov 29 01:37:00 user nova-compute[75210]:     <disk type="file" device="cdrom">
Nov 29 01:37:00 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 01:37:00 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk.config"/>
Nov 29 01:37:00 user nova-compute[75210]:       <target dev="hda" bus="ide"/>
Nov 29 01:37:00 user nova-compute[75210]:     </disk>
Nov 29 01:37:00 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:37:00 user nova-compute[75210]:       <mac address="fa:16:3e:00:cd:81"/>
Nov 29 01:37:00 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:00 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:37:00 user nova-compute[75210]:       <target dev="tapbddbec43-27"/>
Nov 29 01:37:00 user nova-compute[75210]:     </interface>
Nov 29 01:37:00 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:37:00 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/console.log" append="off"/>
Nov 29 01:37:00 user nova-compute[75210]:     </serial>
Nov 29 01:37:00 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:37:00 user nova-compute[75210]:     <video>
Nov 29 01:37:00 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:00 user nova-compute[75210]:     </video>
Nov 29 01:37:00 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:37:00 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:37:00 user nova-compute[75210]:     </rng>
Nov 29 01:37:00 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:37:00 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:37:00 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:37:00 user nova-compute[75210]:     </memballoon>
Nov 29 01:37:00 user nova-compute[75210]:   </devices>
Nov 29 01:37:00 user nova-compute[75210]: </domain>
Nov 29 01:37:00 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:36:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906023654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906023654',id=6,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmtm9Y/rL28hHvUP7150cqzO8TBgS/8Pwq7X/7Gtilm5Sd870B/ZK7bsEtY2wPDo+rNSG8X+Tp2Avrz3QbtDNgCJe0acCKnqRj8bkYwO8r/0na0wbSxh0PaL89RzsH/pA==',key_name='tempest-keypair-1039804411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08d017f83b2449c18c70e3dbed78af01',ramdisk_id='',reservation_id='r-c01u2q0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1153284446',owner_user_name='tempest-TaggedAttachmentsTest-1153284446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413fdbcc401e4fd99a537e93fea9eaa4',uuid=0d7f5bf7-edc1-465f-b24f-171d1481ffa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converting VIF {"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=bddbec43-276a-4a46-a083-2aa153ccd4db,network=Network(84bcba04-97bf-40de-b5c5-68a41a393f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddbec43-27') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG os_vif [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=bddbec43-276a-4a46-a083-2aa153ccd4db,network=Network(84bcba04-97bf-40de-b5c5-68a41a393f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddbec43-27') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59c207c9-f822-5ae7-a691-f6cbbc558dfc', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbddbec43-27, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbddbec43-27, col_values=(('qos', UUID('8d68dda5-6d45-421b-9f53-aec0786d9fd8')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbddbec43-27, col_values=(('external_ids', {'iface-id': 'bddbec43-276a-4a46-a083-2aa153ccd4db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:cd:81', 'vm-uuid': '0d7f5bf7-edc1-465f-b24f-171d1481ffa0'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:00 user nova-compute[75210]: INFO os_vif [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=bddbec43-276a-4a46-a083-2aa153ccd4db,network=Network(84bcba04-97bf-40de-b5c5-68a41a393f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddbec43-27')
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] No BDM found with device name hda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] No VIF found with MAC fa:16:3e:00:cd:81, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:37:00 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Using config drive
Nov 29 01:37:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.810s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.network.neutron [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:37:00 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:37:00 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG nova.policy [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6244e12a3ac54a04a0070f916f3d6101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd144a64090b94fe783113062302ee8b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:37:01 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Creating config drive at /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk.config
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8aspfo4q {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:37:01 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Creating image(s)
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "/opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "/opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8aspfo4q" returned: 0 in 0.067s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "10a92792-5f02-42e5-8012-a022fc717797" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "10a92792-5f02-42e5-8012-a022fc717797" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.236s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.011s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG nova.network.neutron [req-70b4044a-9ef2-486a-876f-d1a1337c5100 req-3b3d995a-d474-4e8d-981f-b72c30cc6dcb service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Updated VIF entry in instance network info cache for port bddbec43-276a-4a46-a083-2aa153ccd4db. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG nova.network.neutron [req-70b4044a-9ef2-486a-876f-d1a1337c5100 req-3b3d995a-d474-4e8d-981f-b72c30cc6dcb service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Updating instance_info_cache with network_info: [{"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-70b4044a-9ef2-486a-876f-d1a1337c5100 req-3b3d995a-d474-4e8d-981f-b72c30cc6dcb service nova] Releasing lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:37:01 user nova-compute[75210]: INFO nova.compute.claims [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Claim successful on node user
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.352s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk 1073741824" returned: 0 in 0.075s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.433s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.264s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG nova.network.neutron [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Successfully created port: 4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Cannot resize image /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Ensure instance console log exists: /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.827s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG nova.network.neutron [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:37:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:37:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:02 user nova-compute[75210]: INFO nova.virt.block_device [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Booting with volume 9f315778-a694-4266-8fec-4d9cc29e76bb at /dev/vda
Nov 29 01:37:02 user nova-compute[75210]: DEBUG nova.policy [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed9ecba6c9944ba5804dc45e4e107f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d20161f567a4c50956fda3ec66ea74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG os_brick.utils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:37:03 user nova-compute[75210]: INFO oslo.privsep.daemon [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpnkeyklg7/privsep.sock']
Nov 29 01:37:03 user sudo[85490]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpnkeyklg7/privsep.sock
Nov 29 01:37:03 user sudo[85490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 29 01:37:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:37:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Instance spawned successfully.
Nov 29 01:37:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-fadb0229-d732-43a1-b130-402e2619bc25 req-ef6fa986-f494-4ebb-a5a5-aad51dab568a service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-vif-plugged-bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fadb0229-d732-43a1-b130-402e2619bc25 req-ef6fa986-f494-4ebb-a5a5-aad51dab568a service nova] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fadb0229-d732-43a1-b130-402e2619bc25 req-ef6fa986-f494-4ebb-a5a5-aad51dab568a service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fadb0229-d732-43a1-b130-402e2619bc25 req-ef6fa986-f494-4ebb-a5a5-aad51dab568a service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-fadb0229-d732-43a1-b130-402e2619bc25 req-ef6fa986-f494-4ebb-a5a5-aad51dab568a service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] No waiting events found dispatching network-vif-plugged-bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:03 user nova-compute[75210]: WARNING nova.compute.manager [req-fadb0229-d732-43a1-b130-402e2619bc25 req-ef6fa986-f494-4ebb-a5a5-aad51dab568a service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received unexpected event network-vif-plugged-bddbec43-276a-4a46-a083-2aa153ccd4db for instance with vm_state building and task_state spawning.
Nov 29 01:37:03 user nova-compute[75210]: INFO nova.compute.manager [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Took 10.31 seconds to spawn the instance on the hypervisor.
Nov 29 01:37:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG nova.network.neutron [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Successfully updated port: 4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Acquiring lock "refresh_cache-c8c0c1d8-5241-4204-87f2-c9c20618bb86" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Acquired lock "refresh_cache-c8c0c1d8-5241-4204-87f2-c9c20618bb86" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG nova.network.neutron [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:37:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:04 user nova-compute[75210]: INFO nova.compute.manager [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Took 11.84 seconds to build instance.
Nov 29 01:37:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-381dd173-ebad-4743-9417-f251914892a4 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.988s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.network.neutron [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.network.neutron [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Successfully created port: c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.network.neutron [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Updating instance_info_cache with network_info: [{"id": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "address": "fa:16:3e:e4:32:00", "network": {"id": "5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1723418922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d144a64090b94fe783113062302ee8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afee2bd-e2", "ovs_interfaceid": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Releasing lock "refresh_cache-c8c0c1d8-5241-4204-87f2-c9c20618bb86" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Instance network_info: |[{"id": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "address": "fa:16:3e:e4:32:00", "network": {"id": "5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1723418922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d144a64090b94fe783113062302ee8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afee2bd-e2", "ovs_interfaceid": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Start _get_guest_xml network_info=[{"id": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "address": "fa:16:3e:e4:32:00", "network": {"id": "5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1723418922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d144a64090b94fe783113062302ee8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afee2bd-e2", "ovs_interfaceid": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:37:04 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:37:04 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:37:04 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1455427633',display_name='tempest-VolumesAssistedSnapshotsTest-server-1455427633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1455427633',id=7,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjZ2Rw9fJ58hxyIeh1IORaloz/20dIrJegmglcBUdfDUw6SKV0VqUpfh1dGBabj2P8FWbFZLJgjEoCLUnGAb+2BnHOwjful4SlxVGtwW5EcyQv4yD8g/hy0F5RhLbFNiw==',key_name='tempest-keypair-1334843668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d144a64090b94fe783113062302ee8b4',ramdisk_id='',reservation_id='r-lmw3tv5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-266577102',owner_user_name='tempest-VolumesAssistedSnapshotsTest-266577102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6244e12a3ac54a04a0070f916f3d6101',uuid=c8c0c1d8-5241-4204-87f2-c9c20618bb86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "address": "fa:16:3e:e4:32:00", "network": {"id": "5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1723418922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d144a64090b94fe783113062302ee8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afee2bd-e2", "ovs_interfaceid": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Converting VIF {"id": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "address": "fa:16:3e:e4:32:00", "network": {"id": "5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1723418922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d144a64090b94fe783113062302ee8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afee2bd-e2", "ovs_interfaceid": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:32:00,bridge_name='br-int',has_traffic_filtering=True,id=4afee2bd-e2b5-4da5-8243-b5158582e51f,network=Network(5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afee2bd-e2') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.objects.instance [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lazy-loading 'pci_devices' on Instance uuid c8c0c1d8-5241-4204-87f2-c9c20618bb86 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:37:05 user nova-compute[75210]:   <uuid>c8c0c1d8-5241-4204-87f2-c9c20618bb86</uuid>
Nov 29 01:37:05 user nova-compute[75210]:   <name>instance-00000007</name>
Nov 29 01:37:05 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:37:05 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:37:05 user nova-compute[75210]:   <metadata>
Nov 29 01:37:05 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:37:05 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:37:05 user nova-compute[75210]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1455427633</nova:name>
Nov 29 01:37:05 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:37:04</nova:creationTime>
Nov 29 01:37:05 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:37:05 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:37:05 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:37:05 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:37:05 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:37:05 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:37:05 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:37:05 user nova-compute[75210]:       <nova:owner>
Nov 29 01:37:05 user nova-compute[75210]:         <nova:user uuid="6244e12a3ac54a04a0070f916f3d6101">tempest-VolumesAssistedSnapshotsTest-266577102-project-member</nova:user>
Nov 29 01:37:05 user nova-compute[75210]:         <nova:project uuid="d144a64090b94fe783113062302ee8b4">tempest-VolumesAssistedSnapshotsTest-266577102</nova:project>
Nov 29 01:37:05 user nova-compute[75210]:       </nova:owner>
Nov 29 01:37:05 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:37:05 user nova-compute[75210]:       <nova:ports>
Nov 29 01:37:05 user nova-compute[75210]:         <nova:port uuid="4afee2bd-e2b5-4da5-8243-b5158582e51f">
Nov 29 01:37:05 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 01:37:05 user nova-compute[75210]:         </nova:port>
Nov 29 01:37:05 user nova-compute[75210]:       </nova:ports>
Nov 29 01:37:05 user nova-compute[75210]:     </nova:instance>
Nov 29 01:37:05 user nova-compute[75210]:   </metadata>
Nov 29 01:37:05 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:37:05 user nova-compute[75210]:     <system>
Nov 29 01:37:05 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:37:05 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:37:05 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:37:05 user nova-compute[75210]:       <entry name="serial">c8c0c1d8-5241-4204-87f2-c9c20618bb86</entry>
Nov 29 01:37:05 user nova-compute[75210]:       <entry name="uuid">c8c0c1d8-5241-4204-87f2-c9c20618bb86</entry>
Nov 29 01:37:05 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:37:05 user nova-compute[75210]:     </system>
Nov 29 01:37:05 user nova-compute[75210]:   </sysinfo>
Nov 29 01:37:05 user nova-compute[75210]:   <os>
Nov 29 01:37:05 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:37:05 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:37:05 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:37:05 user nova-compute[75210]:   </os>
Nov 29 01:37:05 user nova-compute[75210]:   <features>
Nov 29 01:37:05 user nova-compute[75210]:     <acpi/>
Nov 29 01:37:05 user nova-compute[75210]:     <apic/>
Nov 29 01:37:05 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:37:05 user nova-compute[75210]:   </features>
Nov 29 01:37:05 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:37:05 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:37:05 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:37:05 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:37:05 user nova-compute[75210]:   </clock>
Nov 29 01:37:05 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:37:05 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:37:05 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:37:05 user nova-compute[75210]:   </cpu>
Nov 29 01:37:05 user nova-compute[75210]:   <devices>
Nov 29 01:37:05 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:37:05 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:37:05 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk"/>
Nov 29 01:37:05 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:37:05 user nova-compute[75210]:     </disk>
Nov 29 01:37:05 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:37:05 user nova-compute[75210]:       <mac address="fa:16:3e:e4:32:00"/>
Nov 29 01:37:05 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:05 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:37:05 user nova-compute[75210]:       <target dev="tap4afee2bd-e2"/>
Nov 29 01:37:05 user nova-compute[75210]:     </interface>
Nov 29 01:37:05 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:37:05 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/console.log" append="off"/>
Nov 29 01:37:05 user nova-compute[75210]:     </serial>
Nov 29 01:37:05 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:37:05 user nova-compute[75210]:     <video>
Nov 29 01:37:05 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:05 user nova-compute[75210]:     </video>
Nov 29 01:37:05 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:37:05 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:37:05 user nova-compute[75210]:     </rng>
Nov 29 01:37:05 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:37:05 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:37:05 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:37:05 user nova-compute[75210]:     </memballoon>
Nov 29 01:37:05 user nova-compute[75210]:   </devices>
Nov 29 01:37:05 user nova-compute[75210]: </domain>
Nov 29 01:37:05 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1455427633',display_name='tempest-VolumesAssistedSnapshotsTest-server-1455427633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1455427633',id=7,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjZ2Rw9fJ58hxyIeh1IORaloz/20dIrJegmglcBUdfDUw6SKV0VqUpfh1dGBabj2P8FWbFZLJgjEoCLUnGAb+2BnHOwjful4SlxVGtwW5EcyQv4yD8g/hy0F5RhLbFNiw==',key_name='tempest-keypair-1334843668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d144a64090b94fe783113062302ee8b4',ramdisk_id='',reservation_id='r-lmw3tv5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-266577102',owner_user_name='tempest-VolumesAssistedSnapshotsTest-266577102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6244e12a3ac54a04a0070f916f3d6101',uuid=c8c0c1d8-5241-4204-87f2-c9c20618bb86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "address": "fa:16:3e:e4:32:00", "network": {"id": "5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1723418922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d144a64090b94fe783113062302ee8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afee2bd-e2", "ovs_interfaceid": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Converting VIF {"id": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "address": "fa:16:3e:e4:32:00", "network": {"id": "5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1723418922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d144a64090b94fe783113062302ee8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afee2bd-e2", "ovs_interfaceid": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:32:00,bridge_name='br-int',has_traffic_filtering=True,id=4afee2bd-e2b5-4da5-8243-b5158582e51f,network=Network(5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afee2bd-e2') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG os_vif [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:32:00,bridge_name='br-int',has_traffic_filtering=True,id=4afee2bd-e2b5-4da5-8243-b5158582e51f,network=Network(5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afee2bd-e2') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c2611c28-1402-53d1-97d8-d2b084dc78be', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4afee2bd-e2, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4afee2bd-e2, col_values=(('qos', UUID('fbbc440f-76e0-4d0a-a1f3-60e7ed4236bf')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4afee2bd-e2, col_values=(('external_ids', {'iface-id': '4afee2bd-e2b5-4da5-8243-b5158582e51f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:32:00', 'vm-uuid': 'c8c0c1d8-5241-4204-87f2-c9c20618bb86'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:05 user nova-compute[75210]: INFO os_vif [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:32:00,bridge_name='br-int',has_traffic_filtering=True,id=4afee2bd-e2b5-4da5-8243-b5158582e51f,network=Network(5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afee2bd-e2')
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] No VIF found with MAC fa:16:3e:e4:32:00, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:37:05 user sudo[85490]: pam_unix(sudo:session): session closed for user root
Nov 29 01:37:05 user nova-compute[75210]: INFO oslo.privsep.daemon [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Spawned new privsep daemon via rootwrap
Nov 29 01:37:05 user nova-compute[75210]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 29 01:37:05 user nova-compute[75210]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 29 01:37:05 user nova-compute[75210]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 29 01:37:05 user nova-compute[75210]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85542
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-72924e91-5958-49a8-9f64-002d4b31028d req-bef1db17-d3c3-428a-94be-5be126e7da89 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Received event network-vif-plugged-5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-72924e91-5958-49a8-9f64-002d4b31028d req-bef1db17-d3c3-428a-94be-5be126e7da89 service nova] Acquiring lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-72924e91-5958-49a8-9f64-002d4b31028d req-bef1db17-d3c3-428a-94be-5be126e7da89 service nova] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-72924e91-5958-49a8-9f64-002d4b31028d req-bef1db17-d3c3-428a-94be-5be126e7da89 service nova] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-72924e91-5958-49a8-9f64-002d4b31028d req-bef1db17-d3c3-428a-94be-5be126e7da89 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] No waiting events found dispatching network-vif-plugged-5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:05 user nova-compute[75210]: WARNING nova.compute.manager [req-72924e91-5958-49a8-9f64-002d4b31028d req-bef1db17-d3c3-428a-94be-5be126e7da89 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Received unexpected event network-vif-plugged-5b7af5ad-622c-41e2-a119-90373684cf5b for instance with vm_state active and task_state None.
Nov 29 01:37:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0045be-b9b7-4339-bfac-a9ff7d58b98f]: (2,) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Successfully updated port: c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Received event network-changed-4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Refreshing instance network info cache due to event network-changed-4afee2bd-e2b5-4da5-8243-b5158582e51f. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] Acquiring lock "refresh_cache-c8c0c1d8-5241-4204-87f2-c9c20618bb86" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] Acquired lock "refresh_cache-c8c0c1d8-5241-4204-87f2-c9c20618bb86" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.network.neutron [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Refreshing network info cache for port 4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "refresh_cache-10a92792-5f02-42e5-8012-a022fc717797" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquired lock "refresh_cache-10a92792-5f02-42e5-8012-a022fc717797" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG nova.compute.manager [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[021c193d-b676-4b2e-b26f-2a26f16ea0c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:06 user nova-compute[75210]: WARNING os_brick.initiator.connectors.nvmeof [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG nova.network.neutron [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c867ff-802e-4ff7-bbe1-15f22c77325f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:06 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Instance spawned successfully.
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c51433-1abc-4fdb-b0ed-4816d459438e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d5937c-bdae-4e51-9399-2940343882e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:37:06 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:37:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e152c1d6-0133-421d-91fb-768e79cc277a]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG os_brick.utils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] <== get_connector_properties: return (3242ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Updating existing volume attachment record: a5c9e904-8280-4e85-9537-b0f6476aadd8 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:06 user nova-compute[75210]: INFO nova.compute.manager [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Took 11.32 seconds to spawn the instance on the hypervisor.
Nov 29 01:37:06 user nova-compute[75210]: DEBUG nova.compute.manager [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:07 user nova-compute[75210]: INFO nova.compute.manager [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Took 12.90 seconds to build instance.
Nov 29 01:37:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-92c442ff-c0fc-43ab-ac03-a8f7ed79eb1e tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.082s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:07 user nova-compute[75210]: DEBUG nova.network.neutron [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Updating instance_info_cache with network_info: [{"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Releasing lock "refresh_cache-10a92792-5f02-42e5-8012-a022fc717797" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Instance network_info: |[{"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:37:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:07 user nova-compute[75210]: DEBUG nova.network.neutron [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Updated VIF entry in instance network info cache for port 4afee2bd-e2b5-4da5-8243-b5158582e51f. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:37:07 user nova-compute[75210]: DEBUG nova.network.neutron [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Updating instance_info_cache with network_info: [{"id": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "address": "fa:16:3e:e4:32:00", "network": {"id": "5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1723418922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d144a64090b94fe783113062302ee8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afee2bd-e2", "ovs_interfaceid": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] Releasing lock "refresh_cache-c8c0c1d8-5241-4204-87f2-c9c20618bb86" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-vif-plugged-bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] No waiting events found dispatching network-vif-plugged-bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:07 user nova-compute[75210]: WARNING nova.compute.manager [req-875f9089-b832-4765-9ac3-649f05505caf req-df5fead5-b7a9-47f5-a8ee-0b8db98290c7 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received unexpected event network-vif-plugged-bddbec43-276a-4a46-a083-2aa153ccd4db for instance with vm_state building and task_state spawning.
Nov 29 01:37:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-600862e7-2467-433f-ad6f-b4706abacbc7 req-5da5e287-3dbe-4edf-b48b-ae8578a2c84b service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Received event network-vif-plugged-4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-600862e7-2467-433f-ad6f-b4706abacbc7 req-5da5e287-3dbe-4edf-b48b-ae8578a2c84b service nova] Acquiring lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-600862e7-2467-433f-ad6f-b4706abacbc7 req-5da5e287-3dbe-4edf-b48b-ae8578a2c84b service nova] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-600862e7-2467-433f-ad6f-b4706abacbc7 req-5da5e287-3dbe-4edf-b48b-ae8578a2c84b service nova] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-600862e7-2467-433f-ad6f-b4706abacbc7 req-5da5e287-3dbe-4edf-b48b-ae8578a2c84b service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] No waiting events found dispatching network-vif-plugged-4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:08 user nova-compute[75210]: WARNING nova.compute.manager [req-600862e7-2467-433f-ad6f-b4706abacbc7 req-5da5e287-3dbe-4edf-b48b-ae8578a2c84b service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Received unexpected event network-vif-plugged-4afee2bd-e2b5-4da5-8243-b5158582e51f for instance with vm_state building and task_state spawning.
Nov 29 01:37:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received event network-changed-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Refreshing instance network info cache due to event network-changed-c0fd23c3-6145-4950-ac75-4af31b96ed5e. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] Acquiring lock "refresh_cache-10a92792-5f02-42e5-8012-a022fc717797" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] Acquired lock "refresh_cache-10a92792-5f02-42e5-8012-a022fc717797" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG nova.network.neutron [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Refreshing network info cache for port c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG nova.network.neutron [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Updated VIF entry in instance network info cache for port c0fd23c3-6145-4950-ac75-4af31b96ed5e. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG nova.network.neutron [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Updating instance_info_cache with network_info: [{"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] Releasing lock "refresh_cache-10a92792-5f02-42e5-8012-a022fc717797" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Received event network-vif-plugged-5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] Acquiring lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] No waiting events found dispatching network-vif-plugged-5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:08 user nova-compute[75210]: WARNING nova.compute.manager [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Received unexpected event network-vif-plugged-5b7af5ad-622c-41e2-a119-90373684cf5b for instance with vm_state active and task_state None.
Nov 29 01:37:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Received event network-vif-plugged-a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] Acquiring lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] No waiting events found dispatching network-vif-plugged-a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:08 user nova-compute[75210]: WARNING nova.compute.manager [req-e4d0e3b8-7f8f-4754-a44a-f3c1ee8f7d4a req-d078056b-6f7f-4c7c-9978-687929cd06f5 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Received unexpected event network-vif-plugged-a997a159-ff47-43b7-8aac-104013bc4db3 for instance with vm_state active and task_state None.
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-ef8870b2-cb4f-43f0-bf14-cedfc15117ef req-0464f23a-3b2d-49e0-ad41-f00cf9eb39a5 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Received event network-vif-plugged-4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ef8870b2-cb4f-43f0-bf14-cedfc15117ef req-0464f23a-3b2d-49e0-ad41-f00cf9eb39a5 service nova] Acquiring lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ef8870b2-cb4f-43f0-bf14-cedfc15117ef req-0464f23a-3b2d-49e0-ad41-f00cf9eb39a5 service nova] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ef8870b2-cb4f-43f0-bf14-cedfc15117ef req-0464f23a-3b2d-49e0-ad41-f00cf9eb39a5 service nova] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-ef8870b2-cb4f-43f0-bf14-cedfc15117ef req-0464f23a-3b2d-49e0-ad41-f00cf9eb39a5 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] No waiting events found dispatching network-vif-plugged-4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:10 user nova-compute[75210]: WARNING nova.compute.manager [req-ef8870b2-cb4f-43f0-bf14-cedfc15117ef req-0464f23a-3b2d-49e0-ad41-f00cf9eb39a5 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Received unexpected event network-vif-plugged-4afee2bd-e2b5-4da5-8243-b5158582e51f for instance with vm_state building and task_state spawning.
Nov 29 01:37:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:37:10 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Instance spawned successfully.
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 01:37:10 user nova-compute[75210]: INFO nova.compute.manager [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Took 9.29 seconds to spawn the instance on the hypervisor.
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] There are 0 instances to clean {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances with incomplete migration  {{(pid=75210) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-696d348d-727c-44f6-a098-c8b9f784b5f4 req-cb631d4f-af82-412c-acef-709998bfd570 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Received event network-vif-plugged-a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-696d348d-727c-44f6-a098-c8b9f784b5f4 req-cb631d4f-af82-412c-acef-709998bfd570 service nova] Acquiring lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-696d348d-727c-44f6-a098-c8b9f784b5f4 req-cb631d4f-af82-412c-acef-709998bfd570 service nova] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-696d348d-727c-44f6-a098-c8b9f784b5f4 req-cb631d4f-af82-412c-acef-709998bfd570 service nova] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-696d348d-727c-44f6-a098-c8b9f784b5f4 req-cb631d4f-af82-412c-acef-709998bfd570 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] No waiting events found dispatching network-vif-plugged-a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:10 user nova-compute[75210]: WARNING nova.compute.manager [req-696d348d-727c-44f6-a098-c8b9f784b5f4 req-cb631d4f-af82-412c-acef-709998bfd570 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Received unexpected event network-vif-plugged-a997a159-ff47-43b7-8aac-104013bc4db3 for instance with vm_state active and task_state None.
Nov 29 01:37:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:37:10 user nova-compute[75210]: INFO nova.compute.manager [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Took 10.89 seconds to build instance.
Nov 29 01:37:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cb12993d-727f-4db8-90f1-b54aeb063654 tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.054s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:37:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:37:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 01:37:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Skipping network cache update for instance because it is Building. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 01:37:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-18aa0259-a720-42aa-be33-4a676dd4d0e7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-18aa0259-a720-42aa-be33-4a676dd4d0e7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:12 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:37:12 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid 18aa0259-a720-42aa-be33-4a676dd4d0e7 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Updating instance_info_cache with network_info: [{"id": "d660481b-c417-49b9-9efe-9a11b09edc5b", "address": "fa:16:3e:69:ed:7f", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd660481b-c4", "ovs_interfaceid": "d660481b-c417-49b9-9efe-9a11b09edc5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-18aa0259-a720-42aa-be33-4a676dd4d0e7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:37:17 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Creating image(s)
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Ensure instance console log exists: /opt/stack/data/nova/instances/10a92792-5f02-42e5-8012-a022fc717797/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Start _get_guest_xml network_info=[{"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'a5c9e904-8280-4e85-9537-b0f6476aadd8', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUIVBpEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10a92792-5f02-42e5-8012-a022fc717797', 'attached_at': '', 'detached_at': '', 'volume_id': '9f315778-a694-4266-8fec-4d9cc29e76bb', 'serial': '9f315778-a694-4266-8fec-4d9cc29e76bb'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:37:17 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:37:17 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connector [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Factory for ISCSI on None {{(pid=75210) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUIVBpEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:37:17 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:37:17 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:37:17 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6920657b-5235-4b39-87ad-0a67f3d781bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:37:17 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a059cb52-aea0-4daf-b6d7-3a8e553d6330]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb] added
Nov 29 01:37:17 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[954c6928-90ea-47cd-b036-86c23af8b9d2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b801a60-2b61-49cd-a255-e796d26f6bd1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUIVBpEv {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUIVBpEv" returned: 0 in 0.032s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29a6914-e7d6-403e-aeae-c43ba612364b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AUIVBpEv'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9375b197-080e-403e-b0f3-75b6f6cb149f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe56be44-4573-4f1e-b7d2-36110aa50fa6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 01:37:17 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 01:37:17 user nova-compute[75210]:  {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:37:17 user nova-compute[75210]: WARNING os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 01:37:17 user nova-compute[75210]: 
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e008c2f-90f4-46ab-8da2-0a6a8bc5dde1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260]
Nov 29 01:37:17 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260] successful.
Nov 29 01:37:17 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e9d95c-231b-4703-a7c9-da7e9250ed6f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0eb8e1-16ad-4fec-95c2-df3ef52df67d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:17 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:17 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[560a1a3c-cc2c-4a4e-a432-a1637b34a101]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:18 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:37:18 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7879MB free_disk=25.678333282470703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUIVBpEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23036663136316430', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036663136316430', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-270978347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-270978347',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGU0DOtHsgsIIlh0yZXrpDNtdGQqQOnDnHoYuM6y1g9Epjtm7yg8pFsSH/xmwlmyR3J6FK80EjbFlCtWmdPs07pGLRnJSll8hIizePLsEmCf5a2RfdkfGukgo+XphH4Xw==',key_name='tempest-keypair-496495817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d20161f567a4c50956fda3ec66ea74b',ramdisk_id='',reservation_id='r-eq4oj3h7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-974565393',owner_user_name='tempest-ServerActionsV293TestJSON-974565393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed9ecba6c9944ba5804dc45e4e107f08',uuid=10a92792-5f02-42e5-8012-a022fc717797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Converting VIF {"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.objects.instance [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lazy-loading 'pci_devices' on Instance uuid 10a92792-5f02-42e5-8012-a022fc717797 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:37:18 user nova-compute[75210]:   <uuid>10a92792-5f02-42e5-8012-a022fc717797</uuid>
Nov 29 01:37:18 user nova-compute[75210]:   <name>instance-00000008</name>
Nov 29 01:37:18 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:37:18 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:37:18 user nova-compute[75210]:   <metadata>
Nov 29 01:37:18 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:37:18 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:37:18 user nova-compute[75210]:       <nova:name>tempest-ServerActionsV293TestJSON-server-270978347</nova:name>
Nov 29 01:37:18 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:37:17</nova:creationTime>
Nov 29 01:37:18 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:37:18 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:37:18 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:37:18 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:37:18 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:37:18 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:37:18 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:37:18 user nova-compute[75210]:       <nova:owner>
Nov 29 01:37:18 user nova-compute[75210]:         <nova:user uuid="ed9ecba6c9944ba5804dc45e4e107f08">tempest-ServerActionsV293TestJSON-974565393-project-member</nova:user>
Nov 29 01:37:18 user nova-compute[75210]:         <nova:project uuid="9d20161f567a4c50956fda3ec66ea74b">tempest-ServerActionsV293TestJSON-974565393</nova:project>
Nov 29 01:37:18 user nova-compute[75210]:       </nova:owner>
Nov 29 01:37:18 user nova-compute[75210]:       <nova:ports>
Nov 29 01:37:18 user nova-compute[75210]:         <nova:port uuid="c0fd23c3-6145-4950-ac75-4af31b96ed5e">
Nov 29 01:37:18 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 01:37:18 user nova-compute[75210]:         </nova:port>
Nov 29 01:37:18 user nova-compute[75210]:       </nova:ports>
Nov 29 01:37:18 user nova-compute[75210]:     </nova:instance>
Nov 29 01:37:18 user nova-compute[75210]:   </metadata>
Nov 29 01:37:18 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:37:18 user nova-compute[75210]:     <system>
Nov 29 01:37:18 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:37:18 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:37:18 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:37:18 user nova-compute[75210]:       <entry name="serial">10a92792-5f02-42e5-8012-a022fc717797</entry>
Nov 29 01:37:18 user nova-compute[75210]:       <entry name="uuid">10a92792-5f02-42e5-8012-a022fc717797</entry>
Nov 29 01:37:18 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:37:18 user nova-compute[75210]:     </system>
Nov 29 01:37:18 user nova-compute[75210]:   </sysinfo>
Nov 29 01:37:18 user nova-compute[75210]:   <os>
Nov 29 01:37:18 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:37:18 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:37:18 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:37:18 user nova-compute[75210]:   </os>
Nov 29 01:37:18 user nova-compute[75210]:   <features>
Nov 29 01:37:18 user nova-compute[75210]:     <acpi/>
Nov 29 01:37:18 user nova-compute[75210]:     <apic/>
Nov 29 01:37:18 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:37:18 user nova-compute[75210]:   </features>
Nov 29 01:37:18 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:37:18 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:37:18 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:37:18 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:37:18 user nova-compute[75210]:   </clock>
Nov 29 01:37:18 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:37:18 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:37:18 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:37:18 user nova-compute[75210]:   </cpu>
Nov 29 01:37:18 user nova-compute[75210]:   <devices>
Nov 29 01:37:18 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:37:18 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:37:18 user nova-compute[75210]:       <source dev="/dev/sdb"/>
Nov 29 01:37:18 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:37:18 user nova-compute[75210]:       <serial>9f315778-a694-4266-8fec-4d9cc29e76bb</serial>
Nov 29 01:37:18 user nova-compute[75210]:     </disk>
Nov 29 01:37:18 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:37:18 user nova-compute[75210]:       <mac address="fa:16:3e:2a:a4:15"/>
Nov 29 01:37:18 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:18 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:37:18 user nova-compute[75210]:       <target dev="tapc0fd23c3-61"/>
Nov 29 01:37:18 user nova-compute[75210]:     </interface>
Nov 29 01:37:18 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:37:18 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/10a92792-5f02-42e5-8012-a022fc717797/console.log" append="off"/>
Nov 29 01:37:18 user nova-compute[75210]:     </serial>
Nov 29 01:37:18 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:37:18 user nova-compute[75210]:     <video>
Nov 29 01:37:18 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:18 user nova-compute[75210]:     </video>
Nov 29 01:37:18 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:37:18 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:37:18 user nova-compute[75210]:     </rng>
Nov 29 01:37:18 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:37:18 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:37:18 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:37:18 user nova-compute[75210]:     </memballoon>
Nov 29 01:37:18 user nova-compute[75210]:   </devices>
Nov 29 01:37:18 user nova-compute[75210]: </domain>
Nov 29 01:37:18 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-270978347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-270978347',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGU0DOtHsgsIIlh0yZXrpDNtdGQqQOnDnHoYuM6y1g9Epjtm7yg8pFsSH/xmwlmyR3J6FK80EjbFlCtWmdPs07pGLRnJSll8hIizePLsEmCf5a2RfdkfGukgo+XphH4Xw==',key_name='tempest-keypair-496495817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d20161f567a4c50956fda3ec66ea74b',ramdisk_id='',reservation_id='r-eq4oj3h7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-974565393',owner_user_name='tempest-ServerActionsV293TestJSON-974565393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed9ecba6c9944ba5804dc45e4e107f08',uuid=10a92792-5f02-42e5-8012-a022fc717797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Converting VIF {"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG os_vif [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54283a51-3442-5b04-9ae7-c8481c3c0eb0', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0fd23c3-61, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0fd23c3-61, col_values=(('qos', UUID('5a6b8a61-14ba-477b-b1ab-2a83afc61e88')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0fd23c3-61, col_values=(('external_ids', {'iface-id': 'c0fd23c3-6145-4950-ac75-4af31b96ed5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:a4:15', 'vm-uuid': '10a92792-5f02-42e5-8012-a022fc717797'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:18 user nova-compute[75210]: INFO os_vif [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61')
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 18aa0259-a720-42aa-be33-4a676dd4d0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 42760d1a-1d14-47bb-a602-6eb3ed5205d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 088f3f0c-2895-46f9-9697-a48d35a1f6f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fff9790b-6b08-43f9-8a71-577e9f1bf04c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c8c0c1d8-5241-4204-87f2-c9c20618bb86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 10a92792-5f02-42e5-8012-a022fc717797 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:37:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] No VIF found with MAC fa:16:3e:2a:a4:15, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:37:19 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:37:19 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:37:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:37:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.929s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Acquiring lock "059d2d1e-75ba-4672-be7a-3d1ac186a609" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:19 user nova-compute[75210]: DEBUG nova.compute.manager [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:37:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:37:19 user nova-compute[75210]: INFO nova.compute.claims [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Claim successful on node user
Nov 29 01:37:19 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Refreshing inventories for resource provider 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 01:37:19 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Updating ProviderTree inventory for provider 28871a06-d5c8-43d0-87af-3689cd143011 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 01:37:19 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Updating inventory in ProviderTree for provider 28871a06-d5c8-43d0-87af-3689cd143011 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 01:37:19 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Refreshing aggregate associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, aggregates: None {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Refreshing trait associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, traits: HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.834s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG nova.network.neutron [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:37:20 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:37:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG nova.policy [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '234b019000e241e3b0f80000d7f2eb11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3256c43b9ae54d2cb4069d76f24e56b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:37:20 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Creating image(s)
Nov 29 01:37:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Acquiring lock "/opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "/opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "/opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.305s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.213s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk 1073741824" returned: 0 in 0.111s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG nova.network.neutron [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Successfully created port: 9a495ef6-de86-4b5d-ad22-9c627ae8505c {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.214s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Checking if we can resize image /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:37:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Cannot resize image /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Ensure instance console log exists: /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Successfully updated port: 9a495ef6-de86-4b5d-ad22-9c627ae8505c {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Acquiring lock "refresh_cache-059d2d1e-75ba-4672-be7a-3d1ac186a609" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Acquired lock "refresh_cache-059d2d1e-75ba-4672-be7a-3d1ac186a609" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-b61b93be-3ac5-4270-8c5a-4de7eeff7097 req-1d7eb00d-5ff6-428b-ab56-e3f1e39d568c service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Received event network-changed-9a495ef6-de86-4b5d-ad22-9c627ae8505c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-b61b93be-3ac5-4270-8c5a-4de7eeff7097 req-1d7eb00d-5ff6-428b-ab56-e3f1e39d568c service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Refreshing instance network info cache due to event network-changed-9a495ef6-de86-4b5d-ad22-9c627ae8505c. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b61b93be-3ac5-4270-8c5a-4de7eeff7097 req-1d7eb00d-5ff6-428b-ab56-e3f1e39d568c service nova] Acquiring lock "refresh_cache-059d2d1e-75ba-4672-be7a-3d1ac186a609" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:37:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Updating instance_info_cache with network_info: [{"id": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "address": "fa:16:3e:f2:52:55", "network": {"id": "1c2fd584-5b23-4e0e-9ea7-5de99891edc7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1025036948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3256c43b9ae54d2cb4069d76f24e56b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a495ef6-de", "ovs_interfaceid": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Releasing lock "refresh_cache-059d2d1e-75ba-4672-be7a-3d1ac186a609" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Instance network_info: |[{"id": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "address": "fa:16:3e:f2:52:55", "network": {"id": "1c2fd584-5b23-4e0e-9ea7-5de99891edc7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1025036948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3256c43b9ae54d2cb4069d76f24e56b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a495ef6-de", "ovs_interfaceid": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b61b93be-3ac5-4270-8c5a-4de7eeff7097 req-1d7eb00d-5ff6-428b-ab56-e3f1e39d568c service nova] Acquired lock "refresh_cache-059d2d1e-75ba-4672-be7a-3d1ac186a609" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-b61b93be-3ac5-4270-8c5a-4de7eeff7097 req-1d7eb00d-5ff6-428b-ab56-e3f1e39d568c service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Refreshing network info cache for port 9a495ef6-de86-4b5d-ad22-9c627ae8505c {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Start _get_guest_xml network_info=[{"id": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "address": "fa:16:3e:f2:52:55", "network": {"id": "1c2fd584-5b23-4e0e-9ea7-5de99891edc7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1025036948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3256c43b9ae54d2cb4069d76f24e56b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a495ef6-de", "ovs_interfaceid": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:37:23 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Instance spawned successfully.
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:37:23 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:37:23 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:37:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2015942200',display_name='tempest-VolumesActionsTest-instance-2015942200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2015942200',id=9,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3256c43b9ae54d2cb4069d76f24e56b1',ramdisk_id='',reservation_id='r-9lbbvfcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-876555301',owner_user_name='tempest-VolumesActionsTest-876555301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:21Z,user_data=None,user_id='234b019000e241e3b0f80000d7f2eb11',uuid=059d2d1e-75ba-4672-be7a-3d1ac186a609,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "address": "fa:16:3e:f2:52:55", "network": {"id": "1c2fd584-5b23-4e0e-9ea7-5de99891edc7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1025036948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3256c43b9ae54d2cb4069d76f24e56b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a495ef6-de", "ovs_interfaceid": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Converting VIF {"id": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "address": "fa:16:3e:f2:52:55", "network": {"id": "1c2fd584-5b23-4e0e-9ea7-5de99891edc7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1025036948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3256c43b9ae54d2cb4069d76f24e56b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a495ef6-de", "ovs_interfaceid": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:52:55,bridge_name='br-int',has_traffic_filtering=True,id=9a495ef6-de86-4b5d-ad22-9c627ae8505c,network=Network(1c2fd584-5b23-4e0e-9ea7-5de99891edc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a495ef6-de') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.objects.instance [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lazy-loading 'pci_devices' on Instance uuid 059d2d1e-75ba-4672-be7a-3d1ac186a609 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:37:23 user nova-compute[75210]:   <uuid>059d2d1e-75ba-4672-be7a-3d1ac186a609</uuid>
Nov 29 01:37:23 user nova-compute[75210]:   <name>instance-00000009</name>
Nov 29 01:37:23 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:37:23 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:37:23 user nova-compute[75210]:   <metadata>
Nov 29 01:37:23 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:37:23 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:37:23 user nova-compute[75210]:       <nova:name>tempest-VolumesActionsTest-instance-2015942200</nova:name>
Nov 29 01:37:23 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:37:23</nova:creationTime>
Nov 29 01:37:23 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:37:23 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:37:23 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:37:23 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:37:23 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:37:23 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:37:23 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:37:23 user nova-compute[75210]:       <nova:owner>
Nov 29 01:37:23 user nova-compute[75210]:         <nova:user uuid="234b019000e241e3b0f80000d7f2eb11">tempest-VolumesActionsTest-876555301-project-member</nova:user>
Nov 29 01:37:23 user nova-compute[75210]:         <nova:project uuid="3256c43b9ae54d2cb4069d76f24e56b1">tempest-VolumesActionsTest-876555301</nova:project>
Nov 29 01:37:23 user nova-compute[75210]:       </nova:owner>
Nov 29 01:37:23 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:37:23 user nova-compute[75210]:       <nova:ports>
Nov 29 01:37:23 user nova-compute[75210]:         <nova:port uuid="9a495ef6-de86-4b5d-ad22-9c627ae8505c">
Nov 29 01:37:23 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 01:37:23 user nova-compute[75210]:         </nova:port>
Nov 29 01:37:23 user nova-compute[75210]:       </nova:ports>
Nov 29 01:37:23 user nova-compute[75210]:     </nova:instance>
Nov 29 01:37:23 user nova-compute[75210]:   </metadata>
Nov 29 01:37:23 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:37:23 user nova-compute[75210]:     <system>
Nov 29 01:37:23 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:37:23 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:37:23 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:37:23 user nova-compute[75210]:       <entry name="serial">059d2d1e-75ba-4672-be7a-3d1ac186a609</entry>
Nov 29 01:37:23 user nova-compute[75210]:       <entry name="uuid">059d2d1e-75ba-4672-be7a-3d1ac186a609</entry>
Nov 29 01:37:23 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:37:23 user nova-compute[75210]:     </system>
Nov 29 01:37:23 user nova-compute[75210]:   </sysinfo>
Nov 29 01:37:23 user nova-compute[75210]:   <os>
Nov 29 01:37:23 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:37:23 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:37:23 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:37:23 user nova-compute[75210]:   </os>
Nov 29 01:37:23 user nova-compute[75210]:   <features>
Nov 29 01:37:23 user nova-compute[75210]:     <acpi/>
Nov 29 01:37:23 user nova-compute[75210]:     <apic/>
Nov 29 01:37:23 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:37:23 user nova-compute[75210]:   </features>
Nov 29 01:37:23 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:37:23 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:37:23 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:37:23 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:37:23 user nova-compute[75210]:   </clock>
Nov 29 01:37:23 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:37:23 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:37:23 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:37:23 user nova-compute[75210]:   </cpu>
Nov 29 01:37:23 user nova-compute[75210]:   <devices>
Nov 29 01:37:23 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:37:23 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:37:23 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk"/>
Nov 29 01:37:23 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:37:23 user nova-compute[75210]:     </disk>
Nov 29 01:37:23 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:37:23 user nova-compute[75210]:       <mac address="fa:16:3e:f2:52:55"/>
Nov 29 01:37:23 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:23 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:37:23 user nova-compute[75210]:       <target dev="tap9a495ef6-de"/>
Nov 29 01:37:23 user nova-compute[75210]:     </interface>
Nov 29 01:37:23 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:37:23 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/console.log" append="off"/>
Nov 29 01:37:23 user nova-compute[75210]:     </serial>
Nov 29 01:37:23 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:37:23 user nova-compute[75210]:     <video>
Nov 29 01:37:23 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:23 user nova-compute[75210]:     </video>
Nov 29 01:37:23 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:37:23 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:37:23 user nova-compute[75210]:     </rng>
Nov 29 01:37:23 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:37:23 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:37:23 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:37:23 user nova-compute[75210]:     </memballoon>
Nov 29 01:37:23 user nova-compute[75210]:   </devices>
Nov 29 01:37:23 user nova-compute[75210]: </domain>
Nov 29 01:37:23 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:37:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2015942200',display_name='tempest-VolumesActionsTest-instance-2015942200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2015942200',id=9,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3256c43b9ae54d2cb4069d76f24e56b1',ramdisk_id='',reservation_id='r-9lbbvfcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-876555301',owner_user_name='tempest-VolumesActionsTest-876555301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:21Z,user_data=None,user_id='234b019000e241e3b0f80000d7f2eb11',uuid=059d2d1e-75ba-4672-be7a-3d1ac186a609,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "address": "fa:16:3e:f2:52:55", "network": {"id": "1c2fd584-5b23-4e0e-9ea7-5de99891edc7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1025036948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3256c43b9ae54d2cb4069d76f24e56b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a495ef6-de", "ovs_interfaceid": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Converting VIF {"id": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "address": "fa:16:3e:f2:52:55", "network": {"id": "1c2fd584-5b23-4e0e-9ea7-5de99891edc7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1025036948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3256c43b9ae54d2cb4069d76f24e56b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a495ef6-de", "ovs_interfaceid": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:52:55,bridge_name='br-int',has_traffic_filtering=True,id=9a495ef6-de86-4b5d-ad22-9c627ae8505c,network=Network(1c2fd584-5b23-4e0e-9ea7-5de99891edc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a495ef6-de') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG os_vif [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:52:55,bridge_name='br-int',has_traffic_filtering=True,id=9a495ef6-de86-4b5d-ad22-9c627ae8505c,network=Network(1c2fd584-5b23-4e0e-9ea7-5de99891edc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a495ef6-de') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '066294c9-c7f5-5329-832a-0d103310cce6', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a495ef6-de, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a495ef6-de, col_values=(('qos', UUID('2fc17a6e-8aa6-4632-a89f-fa728892f73b')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a495ef6-de, col_values=(('external_ids', {'iface-id': '9a495ef6-de86-4b5d-ad22-9c627ae8505c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:52:55', 'vm-uuid': '059d2d1e-75ba-4672-be7a-3d1ac186a609'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:23 user nova-compute[75210]: INFO os_vif [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:52:55,bridge_name='br-int',has_traffic_filtering=True,id=9a495ef6-de86-4b5d-ad22-9c627ae8505c,network=Network(1c2fd584-5b23-4e0e-9ea7-5de99891edc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a495ef6-de')
Nov 29 01:37:23 user nova-compute[75210]: INFO nova.compute.manager [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] No VIF found with MAC fa:16:3e:f2:52:55, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:37:23 user nova-compute[75210]: INFO nova.compute.manager [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Took 21.61 seconds to build instance.
Nov 29 01:37:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0a077963-4d71-458b-b39d-03b9040fd567 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "10a92792-5f02-42e5-8012-a022fc717797" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.878s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-b61b93be-3ac5-4270-8c5a-4de7eeff7097 req-1d7eb00d-5ff6-428b-ab56-e3f1e39d568c service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Updated VIF entry in instance network info cache for port 9a495ef6-de86-4b5d-ad22-9c627ae8505c. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-b61b93be-3ac5-4270-8c5a-4de7eeff7097 req-1d7eb00d-5ff6-428b-ab56-e3f1e39d568c service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Updating instance_info_cache with network_info: [{"id": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "address": "fa:16:3e:f2:52:55", "network": {"id": "1c2fd584-5b23-4e0e-9ea7-5de99891edc7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1025036948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3256c43b9ae54d2cb4069d76f24e56b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a495ef6-de", "ovs_interfaceid": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b61b93be-3ac5-4270-8c5a-4de7eeff7097 req-1d7eb00d-5ff6-428b-ab56-e3f1e39d568c service nova] Releasing lock "refresh_cache-059d2d1e-75ba-4672-be7a-3d1ac186a609" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:37:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-84e1b367-f40d-4245-b89e-023caae748cc req-9f7d6a20-f16c-4fdb-8355-c1a489f50c0c service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received event network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-84e1b367-f40d-4245-b89e-023caae748cc req-9f7d6a20-f16c-4fdb-8355-c1a489f50c0c service nova] Acquiring lock "10a92792-5f02-42e5-8012-a022fc717797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-84e1b367-f40d-4245-b89e-023caae748cc req-9f7d6a20-f16c-4fdb-8355-c1a489f50c0c service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-84e1b367-f40d-4245-b89e-023caae748cc req-9f7d6a20-f16c-4fdb-8355-c1a489f50c0c service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-84e1b367-f40d-4245-b89e-023caae748cc req-9f7d6a20-f16c-4fdb-8355-c1a489f50c0c service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] No waiting events found dispatching network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:24 user nova-compute[75210]: WARNING nova.compute.manager [req-84e1b367-f40d-4245-b89e-023caae748cc req-9f7d6a20-f16c-4fdb-8355-c1a489f50c0c service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received unexpected event network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e for instance with vm_state active and task_state None.
Nov 29 01:37:25 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:37:25 user nova-compute[75210]: INFO nova.compute.claims [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Claim successful on node user
Nov 29 01:37:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:25 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:37:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:25 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:37:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.044s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:37:26 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:37:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:37:26 user nova-compute[75210]: INFO nova.virt.block_device [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Booting with volume 6a26e42f-306c-4267-bf3f-b6d0430d4ee1 at /dev/vda
Nov 29 01:37:26 user nova-compute[75210]: DEBUG nova.policy [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f0e9ad031e14048afd31e194ae57127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd274f767ed724eb2927863bcfc0ecfc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG os_brick.utils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[798571a6-2408-49c7-aa16-ecade711c508]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f099ce07-3cfe-43de-8db6-000c08b5323c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[947c689b-bd6f-4c54-ac82-5706794bc1f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed5812d-73da-43e6-9201-7902441c2195]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:37:26 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:37:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d86d6f-4f9b-4103-89a8-73fe752176a7]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG os_brick.utils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:37:26 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating existing volume attachment record: e77bf7be-5dbe-45f1-a682-a216422fd7cb {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Successfully created port: f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received event network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] Acquiring lock "10a92792-5f02-42e5-8012-a022fc717797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] No waiting events found dispatching network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:27 user nova-compute[75210]: WARNING nova.compute.manager [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received unexpected event network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e for instance with vm_state active and task_state None.
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Received event network-vif-plugged-9a495ef6-de86-4b5d-ad22-9c627ae8505c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] Acquiring lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] No waiting events found dispatching network-vif-plugged-9a495ef6-de86-4b5d-ad22-9c627ae8505c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:27 user nova-compute[75210]: WARNING nova.compute.manager [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Received unexpected event network-vif-plugged-9a495ef6-de86-4b5d-ad22-9c627ae8505c for instance with vm_state building and task_state spawning.
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Received event network-vif-plugged-9a495ef6-de86-4b5d-ad22-9c627ae8505c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] Acquiring lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] No waiting events found dispatching network-vif-plugged-9a495ef6-de86-4b5d-ad22-9c627ae8505c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:27 user nova-compute[75210]: WARNING nova.compute.manager [req-ab182222-6318-40b0-a287-52643db19dac req-26453f40-7ee9-4d80-a007-d1b26327a801 service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Received unexpected event network-vif-plugged-9a495ef6-de86-4b5d-ad22-9c627ae8505c for instance with vm_state building and task_state spawning.
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.compute.manager [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:37:27 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Instance spawned successfully.
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Successfully created port: 2d450923-2a6b-4299-9be1-0af909115502 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:37:27 user nova-compute[75210]: INFO nova.compute.manager [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Took 6.67 seconds to spawn the instance on the hypervisor.
Nov 29 01:37:27 user nova-compute[75210]: DEBUG nova.compute.manager [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:37:27 user nova-compute[75210]: INFO nova.compute.manager [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Took 8.01 seconds to build instance.
Nov 29 01:37:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-42343999-a630-4e30-bdfd-fdc032bd4f6d tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.151s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:28 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Successfully created port: d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:37:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:29 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Successfully created port: 7a08bcf2-ad02-4ba4-8caf-a38790d8c493 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:37:29 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Successfully created port: e7ea6535-38e6-4481-b759-db9710f14ccb {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:37:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Successfully updated port: f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:37:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-13938ab2-1390-4a01-a321-729b558d4144 req-44827c24-2044-4851-9d1d-26b7a0bee327 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-changed-f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-13938ab2-1390-4a01-a321-729b558d4144 req-44827c24-2044-4851-9d1d-26b7a0bee327 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing instance network info cache due to event network-changed-f3b667a4-01d3-4aee-a486-30b1ca2d868d. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:37:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-13938ab2-1390-4a01-a321-729b558d4144 req-44827c24-2044-4851-9d1d-26b7a0bee327 service nova] Acquiring lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-13938ab2-1390-4a01-a321-729b558d4144 req-44827c24-2044-4851-9d1d-26b7a0bee327 service nova] Acquired lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:30 user nova-compute[75210]: DEBUG nova.network.neutron [req-13938ab2-1390-4a01-a321-729b558d4144 req-44827c24-2044-4851-9d1d-26b7a0bee327 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing network info cache for port f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:37:30 user nova-compute[75210]: DEBUG nova.network.neutron [req-13938ab2-1390-4a01-a321-729b558d4144 req-44827c24-2044-4851-9d1d-26b7a0bee327 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:37:31 user nova-compute[75210]: DEBUG nova.network.neutron [req-13938ab2-1390-4a01-a321-729b558d4144 req-44827c24-2044-4851-9d1d-26b7a0bee327 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-13938ab2-1390-4a01-a321-729b558d4144 req-44827c24-2044-4851-9d1d-26b7a0bee327 service nova] Releasing lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:31 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Successfully updated port: c5881b8e-634d-4969-8e69-b5e3e65adc3d {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:37:32 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Successfully updated port: 518be547-e0f3-44c9-9cf6-83fa8f7a2a10 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:37:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-changed-c5881b8e-634d-4969-8e69-b5e3e65adc3d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing instance network info cache due to event network-changed-c5881b8e-634d-4969-8e69-b5e3e65adc3d. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:37:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] Acquiring lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] Acquired lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:32 user nova-compute[75210]: DEBUG nova.network.neutron [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing network info cache for port c5881b8e-634d-4969-8e69-b5e3e65adc3d {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:37:32 user nova-compute[75210]: DEBUG nova.network.neutron [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:37:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:33 user nova-compute[75210]: DEBUG nova.network.neutron [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] Releasing lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:33 user nova-compute[75210]: DEBUG nova.compute.manager [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-changed-518be547-e0f3-44c9-9cf6-83fa8f7a2a10 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:33 user nova-compute[75210]: DEBUG nova.compute.manager [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing instance network info cache due to event network-changed-518be547-e0f3-44c9-9cf6-83fa8f7a2a10. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:37:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] Acquiring lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] Acquired lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:33 user nova-compute[75210]: DEBUG nova.network.neutron [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing network info cache for port 518be547-e0f3-44c9-9cf6-83fa8f7a2a10 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:37:33 user nova-compute[75210]: DEBUG nova.network.neutron [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:37:33 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Successfully updated port: 2d450923-2a6b-4299-9be1-0af909115502 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:37:33 user nova-compute[75210]: DEBUG nova.network.neutron [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-44b83106-e642-4da3-90c1-2fcf38dbd661 req-0bd42469-4c2b-4318-b5e4-b37a2fe5cb98 service nova] Releasing lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:34 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Successfully updated port: d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:37:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-changed-2d450923-2a6b-4299-9be1-0af909115502 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing instance network info cache due to event network-changed-2d450923-2a6b-4299-9be1-0af909115502. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:37:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] Acquiring lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] Acquired lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:34 user nova-compute[75210]: DEBUG nova.network.neutron [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing network info cache for port 2d450923-2a6b-4299-9be1-0af909115502 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:37:34 user nova-compute[75210]: DEBUG nova.network.neutron [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG nova.network.neutron [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] Releasing lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-changed-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing instance network info cache due to event network-changed-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] Acquiring lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] Acquired lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG nova.network.neutron [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing network info cache for port d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG nova.network.neutron [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Successfully updated port: 7a08bcf2-ad02-4ba4-8caf-a38790d8c493 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG nova.network.neutron [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1170554e-a84c-4267-ae02-9029522a94c4 req-31eefddb-905f-4b63-9144-63e2235a1a7a service nova] Releasing lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:35 user nova-compute[75210]: INFO nova.virt.block_device [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Booting with volume d4637c52-9dbb-492a-949a-0de9d3b7af97 at /dev/vdb
Nov 29 01:37:35 user nova-compute[75210]: DEBUG os_brick.utils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd58847-1b22-44a4-b015-ded4c597b685]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0fb070-0fba-4902-9c4f-7f17fcf44071]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4198ae43-24f5-42ec-b29e-200783ce7d15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9987e4-83c7-410c-a658-bc9d2d0b6795]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:37:35 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:37:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[612881f0-f41d-4122-9298-b681ee131057]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG os_brick.utils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:37:35 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating existing volume attachment record: 022e29ed-f085-4cc9-afe1-d8c3e0ce8e9a {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:37:36 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Successfully updated port: e7ea6535-38e6-4481-b759-db9710f14ccb {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:37:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquired lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:36 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:37:36 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:37:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-changed-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing instance network info cache due to event network-changed-7a08bcf2-ad02-4ba4-8caf-a38790d8c493. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:37:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] Acquiring lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG nova.network.neutron [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [{"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "address": "fa:16:3e:f5:ee:b0", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88bd7a4-0e", "ovs_interfaceid": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "address": "fa:16:3e:14:f7:95", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a08bcf2-ad", "ovs_interfaceid": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Releasing lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG nova.compute.manager [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Instance network_info: |[{"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "address": "fa:16:3e:f5:ee:b0", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88bd7a4-0e", "ovs_interfaceid": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "address": "fa:16:3e:14:f7:95", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a08bcf2-ad", "ovs_interfaceid": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] Acquired lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG nova.network.neutron [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing network info cache for port 7a08bcf2-ad02-4ba4-8caf-a38790d8c493 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG nova.network.neutron [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updated VIF entry in instance network info cache for port 7a08bcf2-ad02-4ba4-8caf-a38790d8c493. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG nova.network.neutron [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [{"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "address": "fa:16:3e:f5:ee:b0", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88bd7a4-0e", "ovs_interfaceid": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "address": "fa:16:3e:14:f7:95", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a08bcf2-ad", "ovs_interfaceid": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] Releasing lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-changed-e7ea6535-38e6-4481-b759-db9710f14ccb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing instance network info cache due to event network-changed-e7ea6535-38e6-4481-b759-db9710f14ccb. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] Acquiring lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] Acquired lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:37:38 user nova-compute[75210]: DEBUG nova.network.neutron [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing network info cache for port e7ea6535-38e6-4481-b759-db9710f14ccb {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:37:39 user nova-compute[75210]: DEBUG nova.network.neutron [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updated VIF entry in instance network info cache for port e7ea6535-38e6-4481-b759-db9710f14ccb. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:37:39 user nova-compute[75210]: DEBUG nova.network.neutron [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [{"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "address": "fa:16:3e:f5:ee:b0", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88bd7a4-0e", "ovs_interfaceid": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "address": "fa:16:3e:14:f7:95", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a08bcf2-ad", "ovs_interfaceid": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:37:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bab429ca-31f5-4ac6-84b8-cdb311e6dad9 req-83c2f47b-d36b-4bce-b1fe-198a4315e5cc service nova] Releasing lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:37:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:44 user nova-compute[75210]: INFO nova.virt.block_device [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Booting with volume 07f14d03-17ff-4f4c-a95d-5067ccfb60f8 at /dev/vdc
Nov 29 01:37:44 user nova-compute[75210]: DEBUG os_brick.utils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a7395e-2951-422c-9368-b4b60fa396f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefb6d4e-4c9c-4620-afb5-221e4a09b0e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7b7c45-b553-4c1d-8938-6d9e1dadc742]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bca157-2eb7-4174-8d84-b7a2d5997b51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:37:44 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:37:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ba0080-f893-4f03-abd6-c5caa6df8698]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG os_brick.utils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:37:44 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating existing volume attachment record: 5ac4e573-3655-444b-8ea8-ecc93395cc38 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:37:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:37:52 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Creating image(s)
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Ensure instance console log exists: /opt/stack/data/nova/instances/061f89f7-91f0-4046-b5dc-b5ef7acfaf30/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Start _get_guest_xml network_info=[{"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "address": "fa:16:3e:f5:ee:b0", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88bd7a4-0e", "ovs_interfaceid": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "address": "fa:16:3e:14:f7:95", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a08bcf2-ad", "ovs_interfaceid": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'e77bf7be-5dbe-45f1-a682-a216422fd7cb', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxCWYkBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '061f89f7-91f0-4046-b5dc-b5ef7acfaf30', 'attached_at': '', 'detached_at': '', 'volume_id': '6a26e42f-306c-4267-bf3f-b6d0430d4ee1', 'serial': '6a26e42f-306c-4267-bf3f-b6d0430d4ee1'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'attachment_id': '022e29ed-f085-4cc9-afe1-d8c3e0ce8e9a', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ldKLYpvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '061f89f7-91f0-4046-b5dc-b5ef7acfaf30', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4637c52-9dbb-492a-949a-0de9d3b7af97', 'serial': 'd4637c52-9dbb-492a-949a-0de9d3b7af97'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'attachment_id': '5ac4e573-3655-444b-8ea8-ecc93395cc38', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWEOADlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '061f89f7-91f0-4046-b5dc-b5ef7acfaf30', 'attached_at': '', 'detached_at': '', 'volume_id': '07f14d03-17ff-4f4c-a95d-5067ccfb60f8', 'serial': '07f14d03-17ff-4f4c-a95d-5067ccfb60f8'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:37:52 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:37:52 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxCWYkBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:37:52 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:37:52 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:37:52 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[54932fff-76c5-4fad-bd3b-f3df9f41e48e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:37:52 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[af91bfff-3087-4e16-86e3-eed7162dac2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1] added
Nov 29 01:37:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ff04e5-150a-4ff4-a9f3-f06301d3482e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a7d74d-9b29-4d79-92ee-5aad288b98d7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxCWYkBU {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxCWYkBU" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[54395c94-d5e2-4183-87dd-be014702dff0]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jxCWYkBU'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb17eb6-a212-4ea0-9397-b98fcf0f7c1f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da53e2b-8506-4ef8-9f60-7ed16a8df4a6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a09e0a4-b2c3-4dfc-a935-282aec7cd15c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1, portal: 172.16.0.220,3260]
Nov 29 01:37:52 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1, portal: 172.16.0.220,3260] successful.
Nov 29 01:37:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[337aacc2-0707-44d4-aacc-ad1caa3a949c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[433dc991-05fa-453b-a39f-9aecadd0d1a1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:52 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:37:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:52 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:37:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d520191-de23-4256-bb57-11b8bf9799a1]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:37:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxCWYkBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23738653634386366', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738653634386366', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ldKLYpvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:37:53 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:37:53 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:37:53 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b228442-88ed-4142-ae00-b9aac16e35cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:37:53 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.086s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[470084a0-fe4b-4079-a16f-c723f336434c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97] added
Nov 29 01:37:53 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6463c8eb-41b5-4376-9a26-ffc662400fb8]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13ff4fb-e830-47da-af8c-393eaf7c76f5]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ldKLYpvI {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ldKLYpvI" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3805d218-2ecd-446b-8d83-3ff378b694a7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ldKLYpvI'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce60fda1-f189-45fd-904d-8e464fd18331]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ce56e9-f4a1-4b36-8459-d9e2c3644bf2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:53 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:37:53 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:53 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:37:53 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:37:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f47af3-b528-45b2-85ed-baba22cb3764]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97, portal: 172.16.0.220,3260]
Nov 29 01:37:54 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97, portal: 172.16.0.220,3260] successful.
Nov 29 01:37:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b932f5a2-346f-4ca2-a77d-883cbf155735]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cec8d7-3139-4dbb-840a-7db5554d065e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:54 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:37:54 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:37:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:54 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:37:54 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:37:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30a3341-af18-4407-b4fb-63d5afef3470]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ldKLYpvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26533643035353539', 'path': '/dev/sdd'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533643035353539', 'path': '/dev/sdd'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWEOADlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:37:55 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:37:55 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:37:55 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9430886f-cbe4-4235-afdc-762343c212c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:37:55 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a9e25c-262b-438e-a336-518fa00bf570]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8] added
Nov 29 01:37:55 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac58250a-6ea9-4b88-aff6-a5a29a51a37c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f608fe-e23d-455f-958a-0f4c5ed2beba]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWEOADlo {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWEOADlo" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[737d86a3-87ae-4061-88af-fd49c6e130a3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HWEOADlo'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb170d5-0bf8-4b03-bcc6-eede5ec62da3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[85156680-02b5-48c5-b6f8-f8bc7a51fbb7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:55 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:37:55 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:37:55 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:55 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:37:55 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:37:55 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[462f5762-e7c7-4daf-8135-13ead59637cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8, portal: 172.16.0.220,3260]
Nov 29 01:37:55 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8, portal: 172.16.0.220,3260] successful.
Nov 29 01:37:55 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a923b7c9-5050-4b6d-afa0-609a5c3eecd1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8f6ec6-6ad6-4658-b0fa-55dd8cb7de9c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:55 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:37:55 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:37:55 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:37:55 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:37:55 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:37:55 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:37:55 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:37:55 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11b8a2e-8120-4606-9854-790348a96d15]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:37:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWEOADlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23566363663333063', 'path': '/dev/sde'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566363663333063', 'path': '/dev/sde'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:85:c8,bridge_name='br-int',has_traffic_filtering=True,id=f3b667a4-01d3-4aee-a486-30b1ca2d868d,network=Network(f1e9724b-5ea5-47c8-84e7-7cc6a123c702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b667a4-01') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:31:ab,bridge_name='br-int',has_traffic_filtering=True,id=c5881b8e-634d-4969-8e69-b5e3e65adc3d,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5881b8e-63') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:a2:05,bridge_name='br-int',has_traffic_filtering=True,id=518be547-e0f3-44c9-9cf6-83fa8f7a2a10,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap518be547-e0') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:1c:51,bridge_name='br-int',has_traffic_filtering=True,id=2d450923-2a6b-4299-9be1-0af909115502,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d450923-2a') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "address": "fa:16:3e:f5:ee:b0", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88bd7a4-0e", "ovs_interfaceid": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "address": "fa:16:3e:f5:ee:b0", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88bd7a4-0e", "ovs_interfaceid": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88bd7a4-0e') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "address": "fa:16:3e:14:f7:95", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a08bcf2-ad", "ovs_interfaceid": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "address": "fa:16:3e:14:f7:95", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a08bcf2-ad", "ovs_interfaceid": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:f7:95,bridge_name='br-int',has_traffic_filtering=True,id=7a08bcf2-ad02-4ba4-8caf-a38790d8c493,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a08bcf2-ad') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:35:33,bridge_name='br-int',has_traffic_filtering=True,id=e7ea6535-38e6-4481-b759-db9710f14ccb,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ea6535-38') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.objects.instance [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lazy-loading 'pci_devices' on Instance uuid 061f89f7-91f0-4046-b5dc-b5ef7acfaf30 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:37:56 user nova-compute[75210]:   <uuid>061f89f7-91f0-4046-b5dc-b5ef7acfaf30</uuid>
Nov 29 01:37:56 user nova-compute[75210]:   <name>instance-0000000a</name>
Nov 29 01:37:56 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:37:56 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:37:56 user nova-compute[75210]:   <metadata>
Nov 29 01:37:56 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:37:56 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:37:56 user nova-compute[75210]:       <nova:name>tempest-device-tagging-server-450311638</nova:name>
Nov 29 01:37:56 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:37:52</nova:creationTime>
Nov 29 01:37:56 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:37:56 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:37:56 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:37:56 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:37:56 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:37:56 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:37:56 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:37:56 user nova-compute[75210]:       <nova:owner>
Nov 29 01:37:56 user nova-compute[75210]:         <nova:user uuid="4f0e9ad031e14048afd31e194ae57127">tempest-TaggedBootDevicesTest_v242-1709736932-project-member</nova:user>
Nov 29 01:37:56 user nova-compute[75210]:         <nova:project uuid="d274f767ed724eb2927863bcfc0ecfc6">tempest-TaggedBootDevicesTest_v242-1709736932</nova:project>
Nov 29 01:37:56 user nova-compute[75210]:       </nova:owner>
Nov 29 01:37:56 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:37:56 user nova-compute[75210]:       <nova:ports>
Nov 29 01:37:56 user nova-compute[75210]:         <nova:port uuid="f3b667a4-01d3-4aee-a486-30b1ca2d868d">
Nov 29 01:37:56 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 01:37:56 user nova-compute[75210]:         </nova:port>
Nov 29 01:37:56 user nova-compute[75210]:         <nova:port uuid="c5881b8e-634d-4969-8e69-b5e3e65adc3d">
Nov 29 01:37:56 user nova-compute[75210]:           <nova:ip type="fixed" address="10.1.1.75" ipVersion="4"/>
Nov 29 01:37:56 user nova-compute[75210]:         </nova:port>
Nov 29 01:37:56 user nova-compute[75210]:         <nova:port uuid="518be547-e0f3-44c9-9cf6-83fa8f7a2a10">
Nov 29 01:37:56 user nova-compute[75210]:           <nova:ip type="fixed" address="10.1.1.77" ipVersion="4"/>
Nov 29 01:37:56 user nova-compute[75210]:         </nova:port>
Nov 29 01:37:56 user nova-compute[75210]:         <nova:port uuid="2d450923-2a6b-4299-9be1-0af909115502">
Nov 29 01:37:56 user nova-compute[75210]:           <nova:ip type="fixed" address="10.1.1.130" ipVersion="4"/>
Nov 29 01:37:56 user nova-compute[75210]:         </nova:port>
Nov 29 01:37:56 user nova-compute[75210]:         <nova:port uuid="d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba">
Nov 29 01:37:56 user nova-compute[75210]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Nov 29 01:37:56 user nova-compute[75210]:         </nova:port>
Nov 29 01:37:56 user nova-compute[75210]:         <nova:port uuid="7a08bcf2-ad02-4ba4-8caf-a38790d8c493">
Nov 29 01:37:56 user nova-compute[75210]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 01:37:56 user nova-compute[75210]:         </nova:port>
Nov 29 01:37:56 user nova-compute[75210]:         <nova:port uuid="e7ea6535-38e6-4481-b759-db9710f14ccb">
Nov 29 01:37:56 user nova-compute[75210]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 01:37:56 user nova-compute[75210]:         </nova:port>
Nov 29 01:37:56 user nova-compute[75210]:       </nova:ports>
Nov 29 01:37:56 user nova-compute[75210]:     </nova:instance>
Nov 29 01:37:56 user nova-compute[75210]:   </metadata>
Nov 29 01:37:56 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:37:56 user nova-compute[75210]:     <system>
Nov 29 01:37:56 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:37:56 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:37:56 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:37:56 user nova-compute[75210]:       <entry name="serial">061f89f7-91f0-4046-b5dc-b5ef7acfaf30</entry>
Nov 29 01:37:56 user nova-compute[75210]:       <entry name="uuid">061f89f7-91f0-4046-b5dc-b5ef7acfaf30</entry>
Nov 29 01:37:56 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:37:56 user nova-compute[75210]:     </system>
Nov 29 01:37:56 user nova-compute[75210]:   </sysinfo>
Nov 29 01:37:56 user nova-compute[75210]:   <os>
Nov 29 01:37:56 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:37:56 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:37:56 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:37:56 user nova-compute[75210]:   </os>
Nov 29 01:37:56 user nova-compute[75210]:   <features>
Nov 29 01:37:56 user nova-compute[75210]:     <acpi/>
Nov 29 01:37:56 user nova-compute[75210]:     <apic/>
Nov 29 01:37:56 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:37:56 user nova-compute[75210]:   </features>
Nov 29 01:37:56 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:37:56 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:37:56 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:37:56 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:37:56 user nova-compute[75210]:   </clock>
Nov 29 01:37:56 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:37:56 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:37:56 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:37:56 user nova-compute[75210]:   </cpu>
Nov 29 01:37:56 user nova-compute[75210]:   <devices>
Nov 29 01:37:56 user nova-compute[75210]:     <disk type="file" device="cdrom">
Nov 29 01:37:56 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 01:37:56 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/061f89f7-91f0-4046-b5dc-b5ef7acfaf30/disk.config"/>
Nov 29 01:37:56 user nova-compute[75210]:       <target dev="hda" bus="ide"/>
Nov 29 01:37:56 user nova-compute[75210]:     </disk>
Nov 29 01:37:56 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:37:56 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:37:56 user nova-compute[75210]:       <source dev="/dev/sdc"/>
Nov 29 01:37:56 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:37:56 user nova-compute[75210]:       <serial>6a26e42f-306c-4267-bf3f-b6d0430d4ee1</serial>
Nov 29 01:37:56 user nova-compute[75210]:     </disk>
Nov 29 01:37:56 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:37:56 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:37:56 user nova-compute[75210]:       <source dev="/dev/sdd"/>
Nov 29 01:37:56 user nova-compute[75210]:       <target dev="vdb" bus="virtio"/>
Nov 29 01:37:56 user nova-compute[75210]:       <serial>d4637c52-9dbb-492a-949a-0de9d3b7af97</serial>
Nov 29 01:37:56 user nova-compute[75210]:     </disk>
Nov 29 01:37:56 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:37:56 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:37:56 user nova-compute[75210]:       <source dev="/dev/sde"/>
Nov 29 01:37:56 user nova-compute[75210]:       <target dev="vdc" bus="virtio"/>
Nov 29 01:37:56 user nova-compute[75210]:       <serial>07f14d03-17ff-4f4c-a95d-5067ccfb60f8</serial>
Nov 29 01:37:56 user nova-compute[75210]:     </disk>
Nov 29 01:37:56 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:37:56 user nova-compute[75210]:       <mac address="fa:16:3e:c5:85:c8"/>
Nov 29 01:37:56 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:56 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:37:56 user nova-compute[75210]:       <target dev="tapf3b667a4-01"/>
Nov 29 01:37:56 user nova-compute[75210]:     </interface>
Nov 29 01:37:56 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:37:56 user nova-compute[75210]:       <mac address="fa:16:3e:63:31:ab"/>
Nov 29 01:37:56 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:56 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:37:56 user nova-compute[75210]:       <target dev="tapc5881b8e-63"/>
Nov 29 01:37:56 user nova-compute[75210]:     </interface>
Nov 29 01:37:56 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:37:56 user nova-compute[75210]:       <mac address="fa:16:3e:15:a2:05"/>
Nov 29 01:37:56 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:56 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:37:56 user nova-compute[75210]:       <target dev="tap518be547-e0"/>
Nov 29 01:37:56 user nova-compute[75210]:     </interface>
Nov 29 01:37:56 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:37:56 user nova-compute[75210]:       <mac address="fa:16:3e:96:1c:51"/>
Nov 29 01:37:56 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:56 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:37:56 user nova-compute[75210]:       <target dev="tap2d450923-2a"/>
Nov 29 01:37:56 user nova-compute[75210]:     </interface>
Nov 29 01:37:56 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:37:56 user nova-compute[75210]:       <mac address="fa:16:3e:f5:ee:b0"/>
Nov 29 01:37:56 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:56 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:37:56 user nova-compute[75210]:       <target dev="tapd88bd7a4-0e"/>
Nov 29 01:37:56 user nova-compute[75210]:     </interface>
Nov 29 01:37:56 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:37:56 user nova-compute[75210]:       <mac address="fa:16:3e:14:f7:95"/>
Nov 29 01:37:56 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:56 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:37:56 user nova-compute[75210]:       <target dev="tap7a08bcf2-ad"/>
Nov 29 01:37:56 user nova-compute[75210]:     </interface>
Nov 29 01:37:56 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:37:56 user nova-compute[75210]:       <mac address="fa:16:3e:74:35:33"/>
Nov 29 01:37:56 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:56 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:37:56 user nova-compute[75210]:       <target dev="tape7ea6535-38"/>
Nov 29 01:37:56 user nova-compute[75210]:     </interface>
Nov 29 01:37:56 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:37:56 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/061f89f7-91f0-4046-b5dc-b5ef7acfaf30/console.log" append="off"/>
Nov 29 01:37:56 user nova-compute[75210]:     </serial>
Nov 29 01:37:56 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:37:56 user nova-compute[75210]:     <video>
Nov 29 01:37:56 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:37:56 user nova-compute[75210]:     </video>
Nov 29 01:37:56 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:37:56 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:37:56 user nova-compute[75210]:     </rng>
Nov 29 01:37:56 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:37:56 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:37:56 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:37:56 user nova-compute[75210]:     </memballoon>
Nov 29 01:37:56 user nova-compute[75210]:   </devices>
Nov 29 01:37:56 user nova-compute[75210]: </domain>
Nov 29 01:37:56 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:85:c8,bridge_name='br-int',has_traffic_filtering=True,id=f3b667a4-01d3-4aee-a486-30b1ca2d868d,network=Network(f1e9724b-5ea5-47c8-84e7-7cc6a123c702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b667a4-01') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:85:c8,bridge_name='br-int',has_traffic_filtering=True,id=f3b667a4-01d3-4aee-a486-30b1ca2d868d,network=Network(f1e9724b-5ea5-47c8-84e7-7cc6a123c702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b667a4-01') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f87df9b8-246d-53a4-a91a-d1ca8bbe92da', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3b667a4-01, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3b667a4-01, col_values=(('qos', UUID('2e8d4573-f70e-49e4-a0e0-79bc6a9d44c2')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3b667a4-01, col_values=(('external_ids', {'iface-id': 'f3b667a4-01d3-4aee-a486-30b1ca2d868d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:85:c8', 'vm-uuid': '061f89f7-91f0-4046-b5dc-b5ef7acfaf30'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: INFO os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:85:c8,bridge_name='br-int',has_traffic_filtering=True,id=f3b667a4-01d3-4aee-a486-30b1ca2d868d,network=Network(f1e9724b-5ea5-47c8-84e7-7cc6a123c702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b667a4-01')
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:31:ab,bridge_name='br-int',has_traffic_filtering=True,id=c5881b8e-634d-4969-8e69-b5e3e65adc3d,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5881b8e-63') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:31:ab,bridge_name='br-int',has_traffic_filtering=True,id=c5881b8e-634d-4969-8e69-b5e3e65adc3d,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5881b8e-63') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b4caa34-0edc-5dd0-a4a6-336c13460fa5', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5881b8e-63, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5881b8e-63, col_values=(('qos', UUID('e80e3ef6-3669-43e1-8726-86d3783a4330')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5881b8e-63, col_values=(('external_ids', {'iface-id': 'c5881b8e-634d-4969-8e69-b5e3e65adc3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:31:ab', 'vm-uuid': '061f89f7-91f0-4046-b5dc-b5ef7acfaf30'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: INFO os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:31:ab,bridge_name='br-int',has_traffic_filtering=True,id=c5881b8e-634d-4969-8e69-b5e3e65adc3d,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5881b8e-63')
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:a2:05,bridge_name='br-int',has_traffic_filtering=True,id=518be547-e0f3-44c9-9cf6-83fa8f7a2a10,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap518be547-e0') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a2:05,bridge_name='br-int',has_traffic_filtering=True,id=518be547-e0f3-44c9-9cf6-83fa8f7a2a10,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap518be547-e0') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '417a3f6e-8cba-518f-9d0c-1a8e7ca73814', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap518be547-e0, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap518be547-e0, col_values=(('qos', UUID('70c9be42-74e4-4102-86f8-54c958f91bcb')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap518be547-e0, col_values=(('external_ids', {'iface-id': '518be547-e0f3-44c9-9cf6-83fa8f7a2a10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:a2:05', 'vm-uuid': '061f89f7-91f0-4046-b5dc-b5ef7acfaf30'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: INFO os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a2:05,bridge_name='br-int',has_traffic_filtering=True,id=518be547-e0f3-44c9-9cf6-83fa8f7a2a10,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap518be547-e0')
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:1c:51,bridge_name='br-int',has_traffic_filtering=True,id=2d450923-2a6b-4299-9be1-0af909115502,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d450923-2a') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:1c:51,bridge_name='br-int',has_traffic_filtering=True,id=2d450923-2a6b-4299-9be1-0af909115502,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d450923-2a') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33e986c3-0176-53da-84f8-d844421de3d3', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d450923-2a, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d450923-2a, col_values=(('qos', UUID('0db8af38-06d7-441c-a6a7-ce237953c202')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d450923-2a, col_values=(('external_ids', {'iface-id': '2d450923-2a6b-4299-9be1-0af909115502', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:1c:51', 'vm-uuid': '061f89f7-91f0-4046-b5dc-b5ef7acfaf30'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: INFO os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:1c:51,bridge_name='br-int',has_traffic_filtering=True,id=2d450923-2a6b-4299-9be1-0af909115502,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d450923-2a')
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "address": "fa:16:3e:f5:ee:b0", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88bd7a4-0e", "ovs_interfaceid": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "address": "fa:16:3e:f5:ee:b0", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88bd7a4-0e", "ovs_interfaceid": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88bd7a4-0e') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88bd7a4-0e') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3cdfa49-a3b3-5e20-b5ee-912e8aeb323d', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd88bd7a4-0e, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd88bd7a4-0e, col_values=(('qos', UUID('3b2ac952-ef86-4f0b-936d-c3ff1396b41e')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd88bd7a4-0e, col_values=(('external_ids', {'iface-id': 'd88bd7a4-0ef0-4508-a2f4-9fc0af9abdba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:ee:b0', 'vm-uuid': '061f89f7-91f0-4046-b5dc-b5ef7acfaf30'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: INFO os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88bd7a4-0e')
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "address": "fa:16:3e:14:f7:95", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a08bcf2-ad", "ovs_interfaceid": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "address": "fa:16:3e:14:f7:95", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a08bcf2-ad", "ovs_interfaceid": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:f7:95,bridge_name='br-int',has_traffic_filtering=True,id=7a08bcf2-ad02-4ba4-8caf-a38790d8c493,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a08bcf2-ad') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:f7:95,bridge_name='br-int',has_traffic_filtering=True,id=7a08bcf2-ad02-4ba4-8caf-a38790d8c493,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a08bcf2-ad') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e872fc18-b4da-534b-ad96-66a8caf79e1c', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a08bcf2-ad, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a08bcf2-ad, col_values=(('qos', UUID('2a59a16f-fbf8-4a7a-94d3-07010f73fbf7')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a08bcf2-ad, col_values=(('external_ids', {'iface-id': '7a08bcf2-ad02-4ba4-8caf-a38790d8c493', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:f7:95', 'vm-uuid': '061f89f7-91f0-4046-b5dc-b5ef7acfaf30'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: INFO os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:f7:95,bridge_name='br-int',has_traffic_filtering=True,id=7a08bcf2-ad02-4ba4-8caf-a38790d8c493,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a08bcf2-ad')
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:35:33,bridge_name='br-int',has_traffic_filtering=True,id=e7ea6535-38e6-4481-b759-db9710f14ccb,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ea6535-38') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:35:33,bridge_name='br-int',has_traffic_filtering=True,id=e7ea6535-38e6-4481-b759-db9710f14ccb,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ea6535-38') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e93d5d41-9b55-53ca-a189-53a26b1d2d26', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7ea6535-38, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7ea6535-38, col_values=(('qos', UUID('153bf1f9-7955-46d8-983f-7c189184f6e7')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7ea6535-38, col_values=(('external_ids', {'iface-id': 'e7ea6535-38e6-4481-b759-db9710f14ccb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:35:33', 'vm-uuid': '061f89f7-91f0-4046-b5dc-b5ef7acfaf30'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:37:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:37:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:57 user nova-compute[75210]: INFO os_vif [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:35:33,bridge_name='br-int',has_traffic_filtering=True,id=e7ea6535-38e6-4481-b759-db9710f14ccb,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ea6535-38')
Nov 29 01:37:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] No BDM found with device name hda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:37:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:37:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] No VIF found with MAC fa:16:3e:c5:85:c8, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:37:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] No VIF found with MAC fa:16:3e:f5:ee:b0, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:37:57 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Using config drive
Nov 29 01:37:57 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Creating config drive at /opt/stack/data/nova/instances/061f89f7-91f0-4046-b5dc-b5ef7acfaf30/disk.config
Nov 29 01:37:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/061f89f7-91f0-4046-b5dc-b5ef7acfaf30/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpactluh_m {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:37:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/061f89f7-91f0-4046-b5dc-b5ef7acfaf30/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpactluh_m" returned: 0 in 0.050s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:37:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG nova.compute.manager [req-82a0a83d-5efb-4f00-a9ac-65e222fe2b8b req-d7cc24fc-5d20-4e65-bfc8-315e59bd11dc service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-82a0a83d-5efb-4f00-a9ac-65e222fe2b8b req-d7cc24fc-5d20-4e65-bfc8-315e59bd11dc service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-82a0a83d-5efb-4f00-a9ac-65e222fe2b8b req-d7cc24fc-5d20-4e65-bfc8-315e59bd11dc service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-82a0a83d-5efb-4f00-a9ac-65e222fe2b8b req-d7cc24fc-5d20-4e65-bfc8-315e59bd11dc service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG nova.compute.manager [req-82a0a83d-5efb-4f00-a9ac-65e222fe2b8b req-d7cc24fc-5d20-4e65-bfc8-315e59bd11dc service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:59 user nova-compute[75210]: WARNING nova.compute.manager [req-82a0a83d-5efb-4f00-a9ac-65e222fe2b8b req-d7cc24fc-5d20-4e65-bfc8-315e59bd11dc service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-f3b667a4-01d3-4aee-a486-30b1ca2d868d for instance with vm_state building and task_state spawning.
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG nova.compute.manager [req-b2f39e78-96e7-4197-859c-e1fe8ac4a84c req-1afaef82-6e06-4f05-96db-a9ef9719afc0 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-2d450923-2a6b-4299-9be1-0af909115502 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b2f39e78-96e7-4197-859c-e1fe8ac4a84c req-1afaef82-6e06-4f05-96db-a9ef9719afc0 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b2f39e78-96e7-4197-859c-e1fe8ac4a84c req-1afaef82-6e06-4f05-96db-a9ef9719afc0 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b2f39e78-96e7-4197-859c-e1fe8ac4a84c req-1afaef82-6e06-4f05-96db-a9ef9719afc0 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:37:59 user nova-compute[75210]: DEBUG nova.compute.manager [req-b2f39e78-96e7-4197-859c-e1fe8ac4a84c req-1afaef82-6e06-4f05-96db-a9ef9719afc0 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-2d450923-2a6b-4299-9be1-0af909115502 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:37:59 user nova-compute[75210]: WARNING nova.compute.manager [req-b2f39e78-96e7-4197-859c-e1fe8ac4a84c req-1afaef82-6e06-4f05-96db-a9ef9719afc0 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-2d450923-2a6b-4299-9be1-0af909115502 for instance with vm_state building and task_state spawning.
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-8dee0ed1-1d91-402a-b4e8-651fcbfa0f7d req-cb4d691c-8e55-46cd-893a-87af90be599f service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8dee0ed1-1d91-402a-b4e8-651fcbfa0f7d req-cb4d691c-8e55-46cd-893a-87af90be599f service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8dee0ed1-1d91-402a-b4e8-651fcbfa0f7d req-cb4d691c-8e55-46cd-893a-87af90be599f service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8dee0ed1-1d91-402a-b4e8-651fcbfa0f7d req-cb4d691c-8e55-46cd-893a-87af90be599f service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-8dee0ed1-1d91-402a-b4e8-651fcbfa0f7d req-cb4d691c-8e55-46cd-893a-87af90be599f service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:00 user nova-compute[75210]: WARNING nova.compute.manager [req-8dee0ed1-1d91-402a-b4e8-651fcbfa0f7d req-cb4d691c-8e55-46cd-893a-87af90be599f service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 for instance with vm_state building and task_state spawning.
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:01 user nova-compute[75210]: WARNING nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-f3b667a4-01d3-4aee-a486-30b1ca2d868d for instance with vm_state building and task_state spawning.
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-c5881b8e-634d-4969-8e69-b5e3e65adc3d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-c5881b8e-634d-4969-8e69-b5e3e65adc3d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:01 user nova-compute[75210]: WARNING nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-c5881b8e-634d-4969-8e69-b5e3e65adc3d for instance with vm_state building and task_state spawning.
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-c5881b8e-634d-4969-8e69-b5e3e65adc3d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-c5881b8e-634d-4969-8e69-b5e3e65adc3d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:01 user nova-compute[75210]: WARNING nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-c5881b8e-634d-4969-8e69-b5e3e65adc3d for instance with vm_state building and task_state spawning.
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-518be547-e0f3-44c9-9cf6-83fa8f7a2a10 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-518be547-e0f3-44c9-9cf6-83fa8f7a2a10 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:01 user nova-compute[75210]: WARNING nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-518be547-e0f3-44c9-9cf6-83fa8f7a2a10 for instance with vm_state building and task_state spawning.
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-518be547-e0f3-44c9-9cf6-83fa8f7a2a10 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-518be547-e0f3-44c9-9cf6-83fa8f7a2a10 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:01 user nova-compute[75210]: WARNING nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-518be547-e0f3-44c9-9cf6-83fa8f7a2a10 for instance with vm_state building and task_state spawning.
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:01 user nova-compute[75210]: WARNING nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba for instance with vm_state building and task_state spawning.
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:01 user nova-compute[75210]: WARNING nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba for instance with vm_state building and task_state spawning.
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-e7ea6535-38e6-4481-b759-db9710f14ccb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-e7ea6535-38e6-4481-b759-db9710f14ccb {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:01 user nova-compute[75210]: WARNING nova.compute.manager [req-0e62c5db-59a2-4fe4-9cdf-33c70252bece req-155ed20e-07c2-493b-bdb5-ed7cbac2a805 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-e7ea6535-38e6-4481-b759-db9710f14ccb for instance with vm_state building and task_state spawning.
Nov 29 01:38:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-9e9ccb1e-c7b4-447a-857f-ade2514c1f04 req-45c0bd7b-2fc2-48d0-a7d9-94beeacef0eb service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-2d450923-2a6b-4299-9be1-0af909115502 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9e9ccb1e-c7b4-447a-857f-ade2514c1f04 req-45c0bd7b-2fc2-48d0-a7d9-94beeacef0eb service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9e9ccb1e-c7b4-447a-857f-ade2514c1f04 req-45c0bd7b-2fc2-48d0-a7d9-94beeacef0eb service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9e9ccb1e-c7b4-447a-857f-ade2514c1f04 req-45c0bd7b-2fc2-48d0-a7d9-94beeacef0eb service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-9e9ccb1e-c7b4-447a-857f-ade2514c1f04 req-45c0bd7b-2fc2-48d0-a7d9-94beeacef0eb service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-2d450923-2a6b-4299-9be1-0af909115502 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:01 user nova-compute[75210]: WARNING nova.compute.manager [req-9e9ccb1e-c7b4-447a-857f-ade2514c1f04 req-45c0bd7b-2fc2-48d0-a7d9-94beeacef0eb service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-2d450923-2a6b-4299-9be1-0af909115502 for instance with vm_state building and task_state spawning.
Nov 29 01:38:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:38:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:38:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Instance spawned successfully.
Nov 29 01:38:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-f1900937-523e-49da-90d4-41b010693262 req-865316bb-ee6f-45fd-9822-08953b69cfbb service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f1900937-523e-49da-90d4-41b010693262 req-865316bb-ee6f-45fd-9822-08953b69cfbb service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f1900937-523e-49da-90d4-41b010693262 req-865316bb-ee6f-45fd-9822-08953b69cfbb service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f1900937-523e-49da-90d4-41b010693262 req-865316bb-ee6f-45fd-9822-08953b69cfbb service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-f1900937-523e-49da-90d4-41b010693262 req-865316bb-ee6f-45fd-9822-08953b69cfbb service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:03 user nova-compute[75210]: WARNING nova.compute.manager [req-f1900937-523e-49da-90d4-41b010693262 req-865316bb-ee6f-45fd-9822-08953b69cfbb service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 for instance with vm_state building and task_state spawning.
Nov 29 01:38:03 user nova-compute[75210]: INFO nova.compute.manager [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Took 10.79 seconds to spawn the instance on the hypervisor.
Nov 29 01:38:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-e5d0b1ec-3c8b-412f-bad6-fb208208b3b9 req-6611ec03-9872-4467-80df-2b4d51ae5717 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-e7ea6535-38e6-4481-b759-db9710f14ccb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e5d0b1ec-3c8b-412f-bad6-fb208208b3b9 req-6611ec03-9872-4467-80df-2b4d51ae5717 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e5d0b1ec-3c8b-412f-bad6-fb208208b3b9 req-6611ec03-9872-4467-80df-2b4d51ae5717 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e5d0b1ec-3c8b-412f-bad6-fb208208b3b9 req-6611ec03-9872-4467-80df-2b4d51ae5717 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-e5d0b1ec-3c8b-412f-bad6-fb208208b3b9 req-6611ec03-9872-4467-80df-2b4d51ae5717 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-e7ea6535-38e6-4481-b759-db9710f14ccb {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:03 user nova-compute[75210]: WARNING nova.compute.manager [req-e5d0b1ec-3c8b-412f-bad6-fb208208b3b9 req-6611ec03-9872-4467-80df-2b4d51ae5717 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-e7ea6535-38e6-4481-b759-db9710f14ccb for instance with vm_state building and task_state spawning.
Nov 29 01:38:03 user nova-compute[75210]: INFO nova.compute.manager [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Took 38.27 seconds to build instance.
Nov 29 01:38:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-00dcd988-8f4f-46e0-9075-68a05be8d47d tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.453s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:38:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:38:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:38:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "0aa70e63-acd6-4aae-8c8d-167dba11168b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:14 user nova-compute[75210]: DEBUG nova.compute.manager [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:38:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:14 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:38:14 user nova-compute[75210]: INFO nova.compute.claims [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Claim successful on node user
Nov 29 01:38:14 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:38:14 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:38:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-42760d1a-1d14-47bb-a602-6eb3ed5205d4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-42760d1a-1d14-47bb-a602-6eb3ed5205d4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:14 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:38:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:14 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:38:14 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG nova.network.neutron [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:38:15 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:38:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:38:15 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Creating image(s)
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "/opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "/opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "/opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG nova.policy [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '654b0e70c6334fa3906a6e1d9023320f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faba7aca2be7400e98500e02035788de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Updating instance_info_cache with network_info: [{"id": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "address": "fa:16:3e:1d:ad:ca", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb15f2-12", "ovs_interfaceid": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-42760d1a-1d14-47bb-a602-6eb3ed5205d4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk 1073741824" returned: 0 in 0.050s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.224s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:38:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Cannot resize image /opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Ensure instance console log exists: /opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG nova.network.neutron [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Successfully created port: 91f654f9-64a8-4b8c-a298-f847cc840003 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-1d5643ff-fa82-48a2-b1e3-2c6e43c6d3e8 req-dcb52b35-0730-4826-a800-d33f493e17a2 service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Received event network-changed-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-1d5643ff-fa82-48a2-b1e3-2c6e43c6d3e8 req-dcb52b35-0730-4826-a800-d33f493e17a2 service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Refreshing instance network info cache due to event network-changed-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1d5643ff-fa82-48a2-b1e3-2c6e43c6d3e8 req-dcb52b35-0730-4826-a800-d33f493e17a2 service nova] Acquiring lock "refresh_cache-42760d1a-1d14-47bb-a602-6eb3ed5205d4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1d5643ff-fa82-48a2-b1e3-2c6e43c6d3e8 req-dcb52b35-0730-4826-a800-d33f493e17a2 service nova] Acquired lock "refresh_cache-42760d1a-1d14-47bb-a602-6eb3ed5205d4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-1d5643ff-fa82-48a2-b1e3-2c6e43c6d3e8 req-dcb52b35-0730-4826-a800-d33f493e17a2 service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Refreshing network info cache for port c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-1d5643ff-fa82-48a2-b1e3-2c6e43c6d3e8 req-dcb52b35-0730-4826-a800-d33f493e17a2 service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Updated VIF entry in instance network info cache for port c4bb15f2-129e-4c14-bc47-ebe84aec2d7e. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-1d5643ff-fa82-48a2-b1e3-2c6e43c6d3e8 req-dcb52b35-0730-4826-a800-d33f493e17a2 service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Updating instance_info_cache with network_info: [{"id": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "address": "fa:16:3e:1d:ad:ca", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb15f2-12", "ovs_interfaceid": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1d5643ff-fa82-48a2-b1e3-2c6e43c6d3e8 req-dcb52b35-0730-4826-a800-d33f493e17a2 service nova] Releasing lock "refresh_cache-42760d1a-1d14-47bb-a602-6eb3ed5205d4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG nova.network.neutron [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Successfully updated port: 91f654f9-64a8-4b8c-a298-f847cc840003 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-90b0e10d-f4da-4e49-a1eb-65c16c7f3f41 req-e0881230-9089-4bfd-9fb1-1cc249a7a15c service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Received event network-changed-91f654f9-64a8-4b8c-a298-f847cc840003 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-90b0e10d-f4da-4e49-a1eb-65c16c7f3f41 req-e0881230-9089-4bfd-9fb1-1cc249a7a15c service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Refreshing instance network info cache due to event network-changed-91f654f9-64a8-4b8c-a298-f847cc840003. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-90b0e10d-f4da-4e49-a1eb-65c16c7f3f41 req-e0881230-9089-4bfd-9fb1-1cc249a7a15c service nova] Acquiring lock "refresh_cache-0aa70e63-acd6-4aae-8c8d-167dba11168b" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-90b0e10d-f4da-4e49-a1eb-65c16c7f3f41 req-e0881230-9089-4bfd-9fb1-1cc249a7a15c service nova] Acquired lock "refresh_cache-0aa70e63-acd6-4aae-8c8d-167dba11168b" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG nova.network.neutron [req-90b0e10d-f4da-4e49-a1eb-65c16c7f3f41 req-e0881230-9089-4bfd-9fb1-1cc249a7a15c service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Refreshing network info cache for port 91f654f9-64a8-4b8c-a298-f847cc840003 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "refresh_cache-0aa70e63-acd6-4aae-8c8d-167dba11168b" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG nova.network.neutron [req-90b0e10d-f4da-4e49-a1eb-65c16c7f3f41 req-e0881230-9089-4bfd-9fb1-1cc249a7a15c service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG nova.network.neutron [req-90b0e10d-f4da-4e49-a1eb-65c16c7f3f41 req-e0881230-9089-4bfd-9fb1-1cc249a7a15c service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-90b0e10d-f4da-4e49-a1eb-65c16c7f3f41 req-e0881230-9089-4bfd-9fb1-1cc249a7a15c service nova] Releasing lock "refresh_cache-0aa70e63-acd6-4aae-8c8d-167dba11168b" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquired lock "refresh_cache-0aa70e63-acd6-4aae-8c8d-167dba11168b" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG nova.network.neutron [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG nova.network.neutron [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.network.neutron [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Updating instance_info_cache with network_info: [{"id": "91f654f9-64a8-4b8c-a298-f847cc840003", "address": "fa:16:3e:11:ba:37", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f654f9-64", "ovs_interfaceid": "91f654f9-64a8-4b8c-a298-f847cc840003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:19 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:38:19 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7057MB free_disk=25.520896911621094GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Releasing lock "refresh_cache-0aa70e63-acd6-4aae-8c8d-167dba11168b" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.manager [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Instance network_info: |[{"id": "91f654f9-64a8-4b8c-a298-f847cc840003", "address": "fa:16:3e:11:ba:37", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f654f9-64", "ovs_interfaceid": "91f654f9-64a8-4b8c-a298-f847cc840003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Start _get_guest_xml network_info=[{"id": "91f654f9-64a8-4b8c-a298-f847cc840003", "address": "fa:16:3e:11:ba:37", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f654f9-64", "ovs_interfaceid": "91f654f9-64a8-4b8c-a298-f847cc840003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:38:19 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:38:19 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-810025350',display_name='tempest-ServersNegativeTestJSON-server-810025350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-810025350',id=11,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faba7aca2be7400e98500e02035788de',ramdisk_id='',reservation_id='r-wabj81tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1979179804',owner_user_name='tempest-ServersNegativeTestJSON-1979179804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:38:15Z,user_data=None,user_id='654b0e70c6334fa3906a6e1d9023320f',uuid=0aa70e63-acd6-4aae-8c8d-167dba11168b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91f654f9-64a8-4b8c-a298-f847cc840003", "address": "fa:16:3e:11:ba:37", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f654f9-64", "ovs_interfaceid": "91f654f9-64a8-4b8c-a298-f847cc840003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Converting VIF {"id": "91f654f9-64a8-4b8c-a298-f847cc840003", "address": "fa:16:3e:11:ba:37", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f654f9-64", "ovs_interfaceid": "91f654f9-64a8-4b8c-a298-f847cc840003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:37,bridge_name='br-int',has_traffic_filtering=True,id=91f654f9-64a8-4b8c-a298-f847cc840003,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f654f9-64') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.objects.instance [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lazy-loading 'pci_devices' on Instance uuid 0aa70e63-acd6-4aae-8c8d-167dba11168b {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:38:19 user nova-compute[75210]:   <uuid>0aa70e63-acd6-4aae-8c8d-167dba11168b</uuid>
Nov 29 01:38:19 user nova-compute[75210]:   <name>instance-0000000b</name>
Nov 29 01:38:19 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:38:19 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:38:19 user nova-compute[75210]:   <metadata>
Nov 29 01:38:19 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:38:19 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:38:19 user nova-compute[75210]:       <nova:name>tempest-ServersNegativeTestJSON-server-810025350</nova:name>
Nov 29 01:38:19 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:38:19</nova:creationTime>
Nov 29 01:38:19 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:38:19 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:38:19 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:38:19 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:38:19 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:38:19 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:38:19 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:38:19 user nova-compute[75210]:       <nova:owner>
Nov 29 01:38:19 user nova-compute[75210]:         <nova:user uuid="654b0e70c6334fa3906a6e1d9023320f">tempest-ServersNegativeTestJSON-1979179804-project-member</nova:user>
Nov 29 01:38:19 user nova-compute[75210]:         <nova:project uuid="faba7aca2be7400e98500e02035788de">tempest-ServersNegativeTestJSON-1979179804</nova:project>
Nov 29 01:38:19 user nova-compute[75210]:       </nova:owner>
Nov 29 01:38:19 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:38:19 user nova-compute[75210]:       <nova:ports>
Nov 29 01:38:19 user nova-compute[75210]:         <nova:port uuid="91f654f9-64a8-4b8c-a298-f847cc840003">
Nov 29 01:38:19 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 01:38:19 user nova-compute[75210]:         </nova:port>
Nov 29 01:38:19 user nova-compute[75210]:       </nova:ports>
Nov 29 01:38:19 user nova-compute[75210]:     </nova:instance>
Nov 29 01:38:19 user nova-compute[75210]:   </metadata>
Nov 29 01:38:19 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:38:19 user nova-compute[75210]:     <system>
Nov 29 01:38:19 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:38:19 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:38:19 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:38:19 user nova-compute[75210]:       <entry name="serial">0aa70e63-acd6-4aae-8c8d-167dba11168b</entry>
Nov 29 01:38:19 user nova-compute[75210]:       <entry name="uuid">0aa70e63-acd6-4aae-8c8d-167dba11168b</entry>
Nov 29 01:38:19 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:38:19 user nova-compute[75210]:     </system>
Nov 29 01:38:19 user nova-compute[75210]:   </sysinfo>
Nov 29 01:38:19 user nova-compute[75210]:   <os>
Nov 29 01:38:19 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:38:19 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:38:19 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:38:19 user nova-compute[75210]:   </os>
Nov 29 01:38:19 user nova-compute[75210]:   <features>
Nov 29 01:38:19 user nova-compute[75210]:     <acpi/>
Nov 29 01:38:19 user nova-compute[75210]:     <apic/>
Nov 29 01:38:19 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:38:19 user nova-compute[75210]:   </features>
Nov 29 01:38:19 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:38:19 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:38:19 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:38:19 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:38:19 user nova-compute[75210]:   </clock>
Nov 29 01:38:19 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:38:19 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:38:19 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:38:19 user nova-compute[75210]:   </cpu>
Nov 29 01:38:19 user nova-compute[75210]:   <devices>
Nov 29 01:38:19 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:38:19 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:38:19 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk"/>
Nov 29 01:38:19 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:38:19 user nova-compute[75210]:     </disk>
Nov 29 01:38:19 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:38:19 user nova-compute[75210]:       <mac address="fa:16:3e:11:ba:37"/>
Nov 29 01:38:19 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:38:19 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:38:19 user nova-compute[75210]:       <target dev="tap91f654f9-64"/>
Nov 29 01:38:19 user nova-compute[75210]:     </interface>
Nov 29 01:38:19 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:38:19 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/console.log" append="off"/>
Nov 29 01:38:19 user nova-compute[75210]:     </serial>
Nov 29 01:38:19 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:38:19 user nova-compute[75210]:     <video>
Nov 29 01:38:19 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:38:19 user nova-compute[75210]:     </video>
Nov 29 01:38:19 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:38:19 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:38:19 user nova-compute[75210]:     </rng>
Nov 29 01:38:19 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:38:19 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:38:19 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:38:19 user nova-compute[75210]:     </memballoon>
Nov 29 01:38:19 user nova-compute[75210]:   </devices>
Nov 29 01:38:19 user nova-compute[75210]: </domain>
Nov 29 01:38:19 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-810025350',display_name='tempest-ServersNegativeTestJSON-server-810025350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-810025350',id=11,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faba7aca2be7400e98500e02035788de',ramdisk_id='',reservation_id='r-wabj81tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1979179804',owner_user_name='tempest-ServersNegativeTestJSON-1979179804-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:38:15Z,user_data=None,user_id='654b0e70c6334fa3906a6e1d9023320f',uuid=0aa70e63-acd6-4aae-8c8d-167dba11168b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91f654f9-64a8-4b8c-a298-f847cc840003", "address": "fa:16:3e:11:ba:37", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f654f9-64", "ovs_interfaceid": "91f654f9-64a8-4b8c-a298-f847cc840003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Converting VIF {"id": "91f654f9-64a8-4b8c-a298-f847cc840003", "address": "fa:16:3e:11:ba:37", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f654f9-64", "ovs_interfaceid": "91f654f9-64a8-4b8c-a298-f847cc840003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:37,bridge_name='br-int',has_traffic_filtering=True,id=91f654f9-64a8-4b8c-a298-f847cc840003,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f654f9-64') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG os_vif [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:37,bridge_name='br-int',has_traffic_filtering=True,id=91f654f9-64a8-4b8c-a298-f847cc840003,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f654f9-64') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c228f3f-7a8a-5e9e-83fb-ba247af6956b', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91f654f9-64, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91f654f9-64, col_values=(('qos', UUID('2dc531fa-289c-4e0c-9f76-ce080c7d361d')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91f654f9-64, col_values=(('external_ids', {'iface-id': '91f654f9-64a8-4b8c-a298-f847cc840003', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:ba:37', 'vm-uuid': '0aa70e63-acd6-4aae-8c8d-167dba11168b'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:19 user nova-compute[75210]: INFO os_vif [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:37,bridge_name='br-int',has_traffic_filtering=True,id=91f654f9-64a8-4b8c-a298-f847cc840003,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f654f9-64')
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 18aa0259-a720-42aa-be33-4a676dd4d0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 42760d1a-1d14-47bb-a602-6eb3ed5205d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 088f3f0c-2895-46f9-9697-a48d35a1f6f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fff9790b-6b08-43f9-8a71-577e9f1bf04c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c8c0c1d8-5241-4204-87f2-c9c20618bb86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 10a92792-5f02-42e5-8012-a022fc717797 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 059d2d1e-75ba-4672-be7a-3d1ac186a609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 061f89f7-91f0-4046-b5dc-b5ef7acfaf30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 0aa70e63-acd6-4aae-8c8d-167dba11168b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:38:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:38:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] No VIF found with MAC fa:16:3e:11:ba:37, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:38:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:20 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:38:20 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:38:20 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:38:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.833s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG nova.objects.instance [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'flavor' on Instance uuid 42760d1a-1d14-47bb-a602-6eb3ed5205d4 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.129s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:21 user nova-compute[75210]: INFO nova.compute.manager [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Attaching volume 1276decd-1dec-4a6d-924e-45bdcad8896a to /dev/vdb
Nov 29 01:38:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-555e97da-7c41-423a-9474-d1e076b1f742 req-9ccb3db3-9dfe-4511-91d4-a7d08ba8a82c service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Received event network-vif-plugged-91f654f9-64a8-4b8c-a298-f847cc840003 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-555e97da-7c41-423a-9474-d1e076b1f742 req-9ccb3db3-9dfe-4511-91d4-a7d08ba8a82c service nova] Acquiring lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-555e97da-7c41-423a-9474-d1e076b1f742 req-9ccb3db3-9dfe-4511-91d4-a7d08ba8a82c service nova] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-555e97da-7c41-423a-9474-d1e076b1f742 req-9ccb3db3-9dfe-4511-91d4-a7d08ba8a82c service nova] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-555e97da-7c41-423a-9474-d1e076b1f742 req-9ccb3db3-9dfe-4511-91d4-a7d08ba8a82c service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] No waiting events found dispatching network-vif-plugged-91f654f9-64a8-4b8c-a298-f847cc840003 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:21 user nova-compute[75210]: WARNING nova.compute.manager [req-555e97da-7c41-423a-9474-d1e076b1f742 req-9ccb3db3-9dfe-4511-91d4-a7d08ba8a82c service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Received unexpected event network-vif-plugged-91f654f9-64a8-4b8c-a298-f847cc840003 for instance with vm_state building and task_state spawning.
Nov 29 01:38:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG os_brick.utils [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d868a2-0584-478e-ab18-77df1869d951]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae830f1-65a9-409a-a175-7c0808a20605]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b07fe9-d664-4384-a560-b62c5f2b6852]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a78efb3-1eb8-486d-a094-5eeec619f342]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:21 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:38:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5a42fd-4b5b-433d-8f16-d4441e55ce94]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG os_brick.utils [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:38:21 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Updating existing volume attachment record: eb3bcc4a-a4ac-4711-aff3-86f383b635bd {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:38:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:38:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:38:23 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Instance spawned successfully.
Nov 29 01:38:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:38:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-d22c5a3b-a014-4c7b-b1a1-5b33b96d7e3c req-0d66f97d-9883-492f-bbac-0ef2798016fa service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Received event network-vif-plugged-91f654f9-64a8-4b8c-a298-f847cc840003 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d22c5a3b-a014-4c7b-b1a1-5b33b96d7e3c req-0d66f97d-9883-492f-bbac-0ef2798016fa service nova] Acquiring lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d22c5a3b-a014-4c7b-b1a1-5b33b96d7e3c req-0d66f97d-9883-492f-bbac-0ef2798016fa service nova] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d22c5a3b-a014-4c7b-b1a1-5b33b96d7e3c req-0d66f97d-9883-492f-bbac-0ef2798016fa service nova] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-d22c5a3b-a014-4c7b-b1a1-5b33b96d7e3c req-0d66f97d-9883-492f-bbac-0ef2798016fa service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] No waiting events found dispatching network-vif-plugged-91f654f9-64a8-4b8c-a298-f847cc840003 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:23 user nova-compute[75210]: WARNING nova.compute.manager [req-d22c5a3b-a014-4c7b-b1a1-5b33b96d7e3c req-0d66f97d-9883-492f-bbac-0ef2798016fa service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Received unexpected event network-vif-plugged-91f654f9-64a8-4b8c-a298-f847cc840003 for instance with vm_state building and task_state spawning.
Nov 29 01:38:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:23 user nova-compute[75210]: INFO nova.compute.manager [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Took 8.59 seconds to spawn the instance on the hypervisor.
Nov 29 01:38:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:38:23 user nova-compute[75210]: INFO nova.compute.manager [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Took 9.53 seconds to build instance.
Nov 29 01:38:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-52bde815-21ba-49d8-b986-3c31f5257851 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.636s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "a6571012-7707-47bc-a057-905eef9d762a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "a6571012-7707-47bc-a057-905eef9d762a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:28 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:38:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:28 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:38:28 user nova-compute[75210]: INFO nova.compute.claims [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Claim successful on node user
Nov 29 01:38:28 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:38:28 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:38:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:28 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:38:28 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:38:28 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:38:28 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:38:28 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:38:28 user nova-compute[75210]: DEBUG nova.policy [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff068faa6b454eada6a4e1c37a3b0887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b78c3f7409946e18c85ab8bc938d53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:38:28 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:38:29 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Creating image(s)
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "/opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "/opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk 1073741824" returned: 0 in 0.055s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Successfully created port: 1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.185s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Cannot resize image /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Ensure instance console log exists: /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Successfully updated port: 1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquired lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-c3e1ead8-c0f8-4475-880f-8ac04e6dd5f2 req-50bac2f6-31ff-4db2-b81b-17ed0c3e6759 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Received event network-changed-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-c3e1ead8-c0f8-4475-880f-8ac04e6dd5f2 req-50bac2f6-31ff-4db2-b81b-17ed0c3e6759 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Refreshing instance network info cache due to event network-changed-1e0cc60f-9d89-48d2-8bf0-5de1573ee031. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c3e1ead8-c0f8-4475-880f-8ac04e6dd5f2 req-50bac2f6-31ff-4db2-b81b-17ed0c3e6759 service nova] Acquiring lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlprIUDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:38:30 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:38:30 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:38:30 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5873b6d4-7d44-42a7-b8e1-50fc7b646cd6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:38:30 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ebbc63-91e0-4ccc-9d2e-1c3bff90601d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a] added
Nov 29 01:38:30 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c54462-75ba-4ed0-80a4-356531f6ab7f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbe01b8-7fd8-401f-b81f-d2460a14b03f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jlprIUDc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jlprIUDc" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ade8ab-ad12-4ea9-ac60-c46ed6b2e8c3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jlprIUDc'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[63775eda-a80a-4339-9aac-7c4ad6d130e3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c3ab5a-e062-4c04-925f-76f2cc88b058]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:30 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:30 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d5e7aa-08f2-4c85-8081-38acd863ce4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a, portal: 172.16.0.220,3260]
Nov 29 01:38:30 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a, portal: 172.16.0.220,3260] successful.
Nov 29 01:38:30 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Updating instance_info_cache with network_info: [{"id": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "address": "fa:16:3e:ab:a3:78", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cc60f-9d", "ovs_interfaceid": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f4dba3-98a3-404d-86ed-b1a33b7b988f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Releasing lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Instance network_info: |[{"id": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "address": "fa:16:3e:ab:a3:78", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cc60f-9d", "ovs_interfaceid": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c3e1ead8-c0f8-4475-880f-8ac04e6dd5f2 req-50bac2f6-31ff-4db2-b81b-17ed0c3e6759 service nova] Acquired lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.network.neutron [req-c3e1ead8-c0f8-4475-880f-8ac04e6dd5f2 req-50bac2f6-31ff-4db2-b81b-17ed0c3e6759 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Refreshing network info cache for port 1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Start _get_guest_xml network_info=[{"id": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "address": "fa:16:3e:ab:a3:78", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cc60f-9d", "ovs_interfaceid": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:38:30 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:38:30 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbf2320-7868-4374-b0bf-c5bfa1fd0d4a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:30 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:30 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:30 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1442968796',display_name='tempest-TestStampPattern-server-1442968796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1442968796',id=12,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxZJUo/Epb5CYlFBfChMG1V1BPL8V9TPJTvnIOTNFLljvoxCnu1eTJ8d58HUXoSa4EQGvcboO4Biiz1zA+SH1SEBmtS+A0p9yWGjhjTSTNMhoJMfxAVBrvRKESIp2RgtQ==',key_name='tempest-TestStampPattern-770112348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b78c3f7409946e18c85ab8bc938d53d',ramdisk_id='',reservation_id='r-5uqywtp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1188739187',owner_user_name='tempest-TestStampPattern-1188739187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:38:29Z,user_data=None,user_id='ff068faa6b454eada6a4e1c37a3b0887',uuid=a6571012-7707-47bc-a057-905eef9d762a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "address": "fa:16:3e:ab:a3:78", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cc60f-9d", "ovs_interfaceid": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Converting VIF {"id": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "address": "fa:16:3e:ab:a3:78", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cc60f-9d", "ovs_interfaceid": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a3:78,bridge_name='br-int',has_traffic_filtering=True,id=1e0cc60f-9d89-48d2-8bf0-5de1573ee031,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cc60f-9d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.objects.instance [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lazy-loading 'pci_devices' on Instance uuid a6571012-7707-47bc-a057-905eef9d762a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1a99ba-48b7-4786-919f-624a5344adb7]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlprIUDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:38:30 user nova-compute[75210]:   <uuid>a6571012-7707-47bc-a057-905eef9d762a</uuid>
Nov 29 01:38:30 user nova-compute[75210]:   <name>instance-0000000c</name>
Nov 29 01:38:30 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:38:30 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:38:30 user nova-compute[75210]:   <metadata>
Nov 29 01:38:30 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:38:30 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:38:30 user nova-compute[75210]:       <nova:name>tempest-TestStampPattern-server-1442968796</nova:name>
Nov 29 01:38:30 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:38:30</nova:creationTime>
Nov 29 01:38:30 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:38:30 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:38:30 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:38:30 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:38:30 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:38:30 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:38:30 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:38:30 user nova-compute[75210]:       <nova:owner>
Nov 29 01:38:30 user nova-compute[75210]:         <nova:user uuid="ff068faa6b454eada6a4e1c37a3b0887">tempest-TestStampPattern-1188739187-project-member</nova:user>
Nov 29 01:38:30 user nova-compute[75210]:         <nova:project uuid="2b78c3f7409946e18c85ab8bc938d53d">tempest-TestStampPattern-1188739187</nova:project>
Nov 29 01:38:30 user nova-compute[75210]:       </nova:owner>
Nov 29 01:38:30 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:38:30 user nova-compute[75210]:       <nova:ports>
Nov 29 01:38:30 user nova-compute[75210]:         <nova:port uuid="1e0cc60f-9d89-48d2-8bf0-5de1573ee031">
Nov 29 01:38:30 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 01:38:30 user nova-compute[75210]:         </nova:port>
Nov 29 01:38:30 user nova-compute[75210]:       </nova:ports>
Nov 29 01:38:30 user nova-compute[75210]:     </nova:instance>
Nov 29 01:38:30 user nova-compute[75210]:   </metadata>
Nov 29 01:38:30 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:38:30 user nova-compute[75210]:     <system>
Nov 29 01:38:30 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:38:30 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:38:30 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:38:30 user nova-compute[75210]:       <entry name="serial">a6571012-7707-47bc-a057-905eef9d762a</entry>
Nov 29 01:38:30 user nova-compute[75210]:       <entry name="uuid">a6571012-7707-47bc-a057-905eef9d762a</entry>
Nov 29 01:38:30 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:38:30 user nova-compute[75210]:     </system>
Nov 29 01:38:30 user nova-compute[75210]:   </sysinfo>
Nov 29 01:38:30 user nova-compute[75210]:   <os>
Nov 29 01:38:30 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:38:30 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:38:30 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:38:30 user nova-compute[75210]:   </os>
Nov 29 01:38:30 user nova-compute[75210]:   <features>
Nov 29 01:38:30 user nova-compute[75210]:     <acpi/>
Nov 29 01:38:30 user nova-compute[75210]:     <apic/>
Nov 29 01:38:30 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:38:30 user nova-compute[75210]:   </features>
Nov 29 01:38:30 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:38:30 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:38:30 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:38:30 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:38:30 user nova-compute[75210]:   </clock>
Nov 29 01:38:30 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:38:30 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:38:30 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:38:30 user nova-compute[75210]:   </cpu>
Nov 29 01:38:30 user nova-compute[75210]:   <devices>
Nov 29 01:38:30 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:38:30 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:38:30 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk"/>
Nov 29 01:38:30 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:38:30 user nova-compute[75210]:     </disk>
Nov 29 01:38:30 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:38:30 user nova-compute[75210]:       <mac address="fa:16:3e:ab:a3:78"/>
Nov 29 01:38:30 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:38:30 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:38:30 user nova-compute[75210]:       <target dev="tap1e0cc60f-9d"/>
Nov 29 01:38:30 user nova-compute[75210]:     </interface>
Nov 29 01:38:30 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:38:30 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/console.log" append="off"/>
Nov 29 01:38:30 user nova-compute[75210]:     </serial>
Nov 29 01:38:30 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:38:30 user nova-compute[75210]:     <video>
Nov 29 01:38:30 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:38:30 user nova-compute[75210]:     </video>
Nov 29 01:38:30 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:38:30 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:38:30 user nova-compute[75210]:     </rng>
Nov 29 01:38:30 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:38:30 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:38:30 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:38:30 user nova-compute[75210]:     </memballoon>
Nov 29 01:38:30 user nova-compute[75210]:   </devices>
Nov 29 01:38:30 user nova-compute[75210]: </domain>
Nov 29 01:38:30 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1442968796',display_name='tempest-TestStampPattern-server-1442968796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1442968796',id=12,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxZJUo/Epb5CYlFBfChMG1V1BPL8V9TPJTvnIOTNFLljvoxCnu1eTJ8d58HUXoSa4EQGvcboO4Biiz1zA+SH1SEBmtS+A0p9yWGjhjTSTNMhoJMfxAVBrvRKESIp2RgtQ==',key_name='tempest-TestStampPattern-770112348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b78c3f7409946e18c85ab8bc938d53d',ramdisk_id='',reservation_id='r-5uqywtp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1188739187',owner_user_name='tempest-TestStampPattern-1188739187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:38:29Z,user_data=None,user_id='ff068faa6b454eada6a4e1c37a3b0887',uuid=a6571012-7707-47bc-a057-905eef9d762a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "address": "fa:16:3e:ab:a3:78", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cc60f-9d", "ovs_interfaceid": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Converting VIF {"id": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "address": "fa:16:3e:ab:a3:78", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cc60f-9d", "ovs_interfaceid": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a3:78,bridge_name='br-int',has_traffic_filtering=True,id=1e0cc60f-9d89-48d2-8bf0-5de1573ee031,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cc60f-9d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG os_vif [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a3:78,bridge_name='br-int',has_traffic_filtering=True,id=1e0cc60f-9d89-48d2-8bf0-5de1573ee031,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cc60f-9d') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '075520c5-e794-538a-851b-598474fb6a9e', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e0cc60f-9d, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e0cc60f-9d, col_values=(('qos', UUID('63a578e7-6a17-4bd5-9a95-30e453559c47')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e0cc60f-9d, col_values=(('external_ids', {'iface-id': '1e0cc60f-9d89-48d2-8bf0-5de1573ee031', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:a3:78', 'vm-uuid': 'a6571012-7707-47bc-a057-905eef9d762a'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:30 user nova-compute[75210]: INFO os_vif [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a3:78,bridge_name='br-int',has_traffic_filtering=True,id=1e0cc60f-9d89-48d2-8bf0-5de1573ee031,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cc60f-9d')
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] No VIF found with MAC fa:16:3e:ab:a3:78, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:38:31 user nova-compute[75210]: DEBUG nova.network.neutron [req-c3e1ead8-c0f8-4475-880f-8ac04e6dd5f2 req-50bac2f6-31ff-4db2-b81b-17ed0c3e6759 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Updated VIF entry in instance network info cache for port 1e0cc60f-9d89-48d2-8bf0-5de1573ee031. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:38:31 user nova-compute[75210]: DEBUG nova.network.neutron [req-c3e1ead8-c0f8-4475-880f-8ac04e6dd5f2 req-50bac2f6-31ff-4db2-b81b-17ed0c3e6759 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Updating instance_info_cache with network_info: [{"id": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "address": "fa:16:3e:ab:a3:78", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cc60f-9d", "ovs_interfaceid": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c3e1ead8-c0f8-4475-880f-8ac04e6dd5f2 req-50bac2f6-31ff-4db2-b81b-17ed0c3e6759 service nova] Releasing lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:38:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23032313537346461', 'path': '/dev/sdf'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:38:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032313537346461', 'path': '/dev/sdf'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:38:31 user nova-compute[75210]: DEBUG nova.objects.instance [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'flavor' on Instance uuid 42760d1a-1d14-47bb-a602-6eb3ed5205d4 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:38:31 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:38:31 user nova-compute[75210]:   <source dev="/dev/sdf"/>
Nov 29 01:38:31 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:38:31 user nova-compute[75210]:   <serial>1276decd-1dec-4a6d-924e-45bdcad8896a</serial>
Nov 29 01:38:31 user nova-compute[75210]: </disk>
Nov 29 01:38:31 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:38:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-0eb60834-dbec-470c-b97c-72ca80e7ed32 req-abcdaeea-1d38-4db8-bc49-50f39150d4c7 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Received event network-vif-plugged-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0eb60834-dbec-470c-b97c-72ca80e7ed32 req-abcdaeea-1d38-4db8-bc49-50f39150d4c7 service nova] Acquiring lock "a6571012-7707-47bc-a057-905eef9d762a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0eb60834-dbec-470c-b97c-72ca80e7ed32 req-abcdaeea-1d38-4db8-bc49-50f39150d4c7 service nova] Lock "a6571012-7707-47bc-a057-905eef9d762a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0eb60834-dbec-470c-b97c-72ca80e7ed32 req-abcdaeea-1d38-4db8-bc49-50f39150d4c7 service nova] Lock "a6571012-7707-47bc-a057-905eef9d762a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-0eb60834-dbec-470c-b97c-72ca80e7ed32 req-abcdaeea-1d38-4db8-bc49-50f39150d4c7 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] No waiting events found dispatching network-vif-plugged-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:32 user nova-compute[75210]: WARNING nova.compute.manager [req-0eb60834-dbec-470c-b97c-72ca80e7ed32 req-abcdaeea-1d38-4db8-bc49-50f39150d4c7 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Received unexpected event network-vif-plugged-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 for instance with vm_state building and task_state spawning.
Nov 29 01:38:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No VIF found with MAC fa:16:3e:1d:ad:ca, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:38:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4f028fa7-ea04-488b-afcc-07fcbb90921a tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.946s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Received event network-vif-plugged-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] Acquiring lock "a6571012-7707-47bc-a057-905eef9d762a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] Lock "a6571012-7707-47bc-a057-905eef9d762a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] Lock "a6571012-7707-47bc-a057-905eef9d762a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] No waiting events found dispatching network-vif-plugged-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:34 user nova-compute[75210]: WARNING nova.compute.manager [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Received unexpected event network-vif-plugged-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 for instance with vm_state building and task_state spawning.
Nov 29 01:38:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Received event network-changed-5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Refreshing instance network info cache due to event network-changed-5b7af5ad-622c-41e2-a119-90373684cf5b. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:38:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] Acquiring lock "refresh_cache-088f3f0c-2895-46f9-9697-a48d35a1f6f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] Acquired lock "refresh_cache-088f3f0c-2895-46f9-9697-a48d35a1f6f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:34 user nova-compute[75210]: DEBUG nova.network.neutron [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Refreshing network info cache for port 5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:38:34 user nova-compute[75210]: DEBUG nova.network.neutron [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Updated VIF entry in instance network info cache for port 5b7af5ad-622c-41e2-a119-90373684cf5b. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:38:34 user nova-compute[75210]: DEBUG nova.network.neutron [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Updating instance_info_cache with network_info: [{"id": "5b7af5ad-622c-41e2-a119-90373684cf5b", "address": "fa:16:3e:f8:8f:ff", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b7af5ad-62", "ovs_interfaceid": "5b7af5ad-622c-41e2-a119-90373684cf5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5dee49a4-c9d9-4e12-928a-4e0cadbabb86 req-7ccda776-4434-4688-b918-dc50d46015c5 service nova] Releasing lock "refresh_cache-088f3f0c-2895-46f9-9697-a48d35a1f6f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:35 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:38:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:38:35 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: a6571012-7707-47bc-a057-905eef9d762a] Instance spawned successfully.
Nov 29 01:38:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:38:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:35 user nova-compute[75210]: INFO nova.compute.manager [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 29 01:38:35 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:38:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:35 user nova-compute[75210]: INFO nova.compute.manager [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Took 7.07 seconds to build instance.
Nov 29 01:38:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b9a98b8d-1e44-4c3d-b8cc-952ff4186ab5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "a6571012-7707-47bc-a057-905eef9d762a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.215s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:38:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:36 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:38:36 user nova-compute[75210]: INFO nova.compute.claims [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Claim successful on node user
Nov 29 01:38:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG nova.objects.instance [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lazy-loading 'flavor' on Instance uuid 088f3f0c-2895-46f9-9697-a48d35a1f6f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:37 user nova-compute[75210]: INFO nova.compute.manager [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Attaching volume 93582a82-1839-4ff5-bfc6-fb69f81e991b to /dev/vdb
Nov 29 01:38:37 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG os_brick.utils [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdee54d-8652-4326-988f-13458a7c6936]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f19550c-d5b3-459b-ac6b-877ccfcabc73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[712ea2dd-2c2a-457a-8b0e-932ce0efc6d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c90582-9bae-43da-9160-522625362222]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG nova.network.neutron [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:37 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[494f4022-0de7-423e-a4b8-86346fad364d]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG os_brick.utils [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Updating existing volume attachment record: 6870edad-f594-4046-a860-7d61c6fb11ba {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:38:37 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:38:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:38:37 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Creating image(s)
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "/opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "/opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG nova.policy [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd39b87d15084d84983873b59f36a211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f1a3d6f5994f6eb15e0ab2294efd53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:38:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.613s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk 1073741824" returned: 0 in 0.055s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-6102cb03-e779-4432-bbfe-4a2ae9872295 req-7de9bc64-22f8-4fc1-a15b-6c2691104bb6 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Received event network-changed-98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-6102cb03-e779-4432-bbfe-4a2ae9872295 req-7de9bc64-22f8-4fc1-a15b-6c2691104bb6 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Refreshing instance network info cache due to event network-changed-98e39171-cc87-49a9-ac90-e31419ea55df. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6102cb03-e779-4432-bbfe-4a2ae9872295 req-7de9bc64-22f8-4fc1-a15b-6c2691104bb6 service nova] Acquiring lock "refresh_cache-6cb707b0-aa06-42ee-abd8-f18d01c7cef9" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6102cb03-e779-4432-bbfe-4a2ae9872295 req-7de9bc64-22f8-4fc1-a15b-6c2691104bb6 service nova] Acquired lock "refresh_cache-6cb707b0-aa06-42ee-abd8-f18d01c7cef9" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG nova.network.neutron [req-6102cb03-e779-4432-bbfe-4a2ae9872295 req-7de9bc64-22f8-4fc1-a15b-6c2691104bb6 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Refreshing network info cache for port 98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.194s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:38 user nova-compute[75210]: DEBUG nova.network.neutron [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Successfully created port: 32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Cannot resize image /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Ensure instance console log exists: /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG nova.objects.instance [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lazy-loading 'flavor' on Instance uuid 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG nova.network.neutron [req-6102cb03-e779-4432-bbfe-4a2ae9872295 req-7de9bc64-22f8-4fc1-a15b-6c2691104bb6 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Updated VIF entry in instance network info cache for port 98e39171-cc87-49a9-ac90-e31419ea55df. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG nova.network.neutron [req-6102cb03-e779-4432-bbfe-4a2ae9872295 req-7de9bc64-22f8-4fc1-a15b-6c2691104bb6 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Updating instance_info_cache with network_info: [{"id": "98e39171-cc87-49a9-ac90-e31419ea55df", "address": "fa:16:3e:dc:86:85", "network": {"id": "7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815609002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ae9a24730042c7804b969aa21d7cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e39171-cc", "ovs_interfaceid": "98e39171-cc87-49a9-ac90-e31419ea55df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6102cb03-e779-4432-bbfe-4a2ae9872295 req-7de9bc64-22f8-4fc1-a15b-6c2691104bb6 service nova] Releasing lock "refresh_cache-6cb707b0-aa06-42ee-abd8-f18d01c7cef9" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:39 user nova-compute[75210]: INFO nova.compute.manager [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Attaching volume 9fa865ad-bd63-404e-a923-56fa76acb88a to /dev/vdb
Nov 29 01:38:39 user nova-compute[75210]: DEBUG os_brick.utils [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5180555-57fc-4468-bd65-a248cb8eeeb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09f8843-3d3b-465c-9333-1f9d1dc9b1ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[642aaddc-21e3-490b-894e-ada7deae78c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0e1d51-676c-4c37-bcc8-806ba6681716]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:39 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2653c7f-6488-465f-9e90-cf32bf39d7d8]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG os_brick.utils [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Updating existing volume attachment record: 97e0dd2a-eeef-4e6e-8711-a26f14e5bb7d {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG nova.network.neutron [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Successfully updated port: 32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "refresh_cache-bf300df0-a62b-4d1d-8b72-86678e2b69fc" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquired lock "refresh_cache-bf300df0-a62b-4d1d-8b72-86678e2b69fc" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG nova.network.neutron [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG nova.network.neutron [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG nova.network.neutron [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Updating instance_info_cache with network_info: [{"id": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "address": "fa:16:3e:80:c9:38", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32791716-b2", "ovs_interfaceid": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Releasing lock "refresh_cache-bf300df0-a62b-4d1d-8b72-86678e2b69fc" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Instance network_info: |[{"id": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "address": "fa:16:3e:80:c9:38", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32791716-b2", "ovs_interfaceid": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:38:39 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Start _get_guest_xml network_info=[{"id": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "address": "fa:16:3e:80:c9:38", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32791716-b2", "ovs_interfaceid": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:38:39 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:38:39 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:38:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1852680183',display_name='tempest-AttachVolumeNegativeTest-server-1852680183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1852680183',id=13,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRigEceDDGCXedowUGOxQ2ztU6CQgKHyOtuMgWedxdMUQ55ffa2Ex/1Hn01J0G3agcvJhXEmPG6hhgONatKmZKMz1dA4StvcDEm3dEJHdNV6IZ/e6VhgbJX8nWBiCWgKA==',key_name='tempest-keypair-1413432192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18f1a3d6f5994f6eb15e0ab2294efd53',ramdisk_id='',reservation_id='r-a28gctyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-648523364',owner_user_name='tempest-AttachVolumeNegativeTest-648523364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd39b87d15084d84983873b59f36a211',uuid=bf300df0-a62b-4d1d-8b72-86678e2b69fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "address": "fa:16:3e:80:c9:38", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32791716-b2", "ovs_interfaceid": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converting VIF {"id": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "address": "fa:16:3e:80:c9:38", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32791716-b2", "ovs_interfaceid": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=32791716-b2e2-4d6f-ab3a-aba08aca4410,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32791716-b2') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.objects.instance [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'pci_devices' on Instance uuid bf300df0-a62b-4d1d-8b72-86678e2b69fc {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:38:40 user nova-compute[75210]:   <uuid>bf300df0-a62b-4d1d-8b72-86678e2b69fc</uuid>
Nov 29 01:38:40 user nova-compute[75210]:   <name>instance-0000000d</name>
Nov 29 01:38:40 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:38:40 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:38:40 user nova-compute[75210]:   <metadata>
Nov 29 01:38:40 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:38:40 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:38:40 user nova-compute[75210]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1852680183</nova:name>
Nov 29 01:38:40 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:38:39</nova:creationTime>
Nov 29 01:38:40 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:38:40 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:38:40 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:38:40 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:38:40 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:38:40 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:38:40 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:38:40 user nova-compute[75210]:       <nova:owner>
Nov 29 01:38:40 user nova-compute[75210]:         <nova:user uuid="bd39b87d15084d84983873b59f36a211">tempest-AttachVolumeNegativeTest-648523364-project-member</nova:user>
Nov 29 01:38:40 user nova-compute[75210]:         <nova:project uuid="18f1a3d6f5994f6eb15e0ab2294efd53">tempest-AttachVolumeNegativeTest-648523364</nova:project>
Nov 29 01:38:40 user nova-compute[75210]:       </nova:owner>
Nov 29 01:38:40 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:38:40 user nova-compute[75210]:       <nova:ports>
Nov 29 01:38:40 user nova-compute[75210]:         <nova:port uuid="32791716-b2e2-4d6f-ab3a-aba08aca4410">
Nov 29 01:38:40 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 01:38:40 user nova-compute[75210]:         </nova:port>
Nov 29 01:38:40 user nova-compute[75210]:       </nova:ports>
Nov 29 01:38:40 user nova-compute[75210]:     </nova:instance>
Nov 29 01:38:40 user nova-compute[75210]:   </metadata>
Nov 29 01:38:40 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:38:40 user nova-compute[75210]:     <system>
Nov 29 01:38:40 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:38:40 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:38:40 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:38:40 user nova-compute[75210]:       <entry name="serial">bf300df0-a62b-4d1d-8b72-86678e2b69fc</entry>
Nov 29 01:38:40 user nova-compute[75210]:       <entry name="uuid">bf300df0-a62b-4d1d-8b72-86678e2b69fc</entry>
Nov 29 01:38:40 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:38:40 user nova-compute[75210]:     </system>
Nov 29 01:38:40 user nova-compute[75210]:   </sysinfo>
Nov 29 01:38:40 user nova-compute[75210]:   <os>
Nov 29 01:38:40 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:38:40 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:38:40 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:38:40 user nova-compute[75210]:   </os>
Nov 29 01:38:40 user nova-compute[75210]:   <features>
Nov 29 01:38:40 user nova-compute[75210]:     <acpi/>
Nov 29 01:38:40 user nova-compute[75210]:     <apic/>
Nov 29 01:38:40 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:38:40 user nova-compute[75210]:   </features>
Nov 29 01:38:40 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:38:40 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:38:40 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:38:40 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:38:40 user nova-compute[75210]:   </clock>
Nov 29 01:38:40 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:38:40 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:38:40 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:38:40 user nova-compute[75210]:   </cpu>
Nov 29 01:38:40 user nova-compute[75210]:   <devices>
Nov 29 01:38:40 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:38:40 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:38:40 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk"/>
Nov 29 01:38:40 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:38:40 user nova-compute[75210]:     </disk>
Nov 29 01:38:40 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:38:40 user nova-compute[75210]:       <mac address="fa:16:3e:80:c9:38"/>
Nov 29 01:38:40 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:38:40 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:38:40 user nova-compute[75210]:       <target dev="tap32791716-b2"/>
Nov 29 01:38:40 user nova-compute[75210]:     </interface>
Nov 29 01:38:40 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:38:40 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/console.log" append="off"/>
Nov 29 01:38:40 user nova-compute[75210]:     </serial>
Nov 29 01:38:40 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:38:40 user nova-compute[75210]:     <video>
Nov 29 01:38:40 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:38:40 user nova-compute[75210]:     </video>
Nov 29 01:38:40 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:38:40 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:38:40 user nova-compute[75210]:     </rng>
Nov 29 01:38:40 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:38:40 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:38:40 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:38:40 user nova-compute[75210]:     </memballoon>
Nov 29 01:38:40 user nova-compute[75210]:   </devices>
Nov 29 01:38:40 user nova-compute[75210]: </domain>
Nov 29 01:38:40 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:38:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1852680183',display_name='tempest-AttachVolumeNegativeTest-server-1852680183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1852680183',id=13,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRigEceDDGCXedowUGOxQ2ztU6CQgKHyOtuMgWedxdMUQ55ffa2Ex/1Hn01J0G3agcvJhXEmPG6hhgONatKmZKMz1dA4StvcDEm3dEJHdNV6IZ/e6VhgbJX8nWBiCWgKA==',key_name='tempest-keypair-1413432192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18f1a3d6f5994f6eb15e0ab2294efd53',ramdisk_id='',reservation_id='r-a28gctyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-648523364',owner_user_name='tempest-AttachVolumeNegativeTest-648523364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:38:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd39b87d15084d84983873b59f36a211',uuid=bf300df0-a62b-4d1d-8b72-86678e2b69fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "address": "fa:16:3e:80:c9:38", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32791716-b2", "ovs_interfaceid": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converting VIF {"id": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "address": "fa:16:3e:80:c9:38", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32791716-b2", "ovs_interfaceid": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=32791716-b2e2-4d6f-ab3a-aba08aca4410,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32791716-b2') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG os_vif [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=32791716-b2e2-4d6f-ab3a-aba08aca4410,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32791716-b2') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5a2eb15-d640-5b69-b6d7-d9f669939c8f', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32791716-b2, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32791716-b2, col_values=(('qos', UUID('c11ad1e2-6f0d-4fc1-bae8-af32c8c93a9e')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32791716-b2, col_values=(('external_ids', {'iface-id': '32791716-b2e2-4d6f-ab3a-aba08aca4410', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:c9:38', 'vm-uuid': 'bf300df0-a62b-4d1d-8b72-86678e2b69fc'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:40 user nova-compute[75210]: INFO os_vif [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=32791716-b2e2-4d6f-ab3a-aba08aca4410,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32791716-b2')
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No VIF found with MAC fa:16:3e:80:c9:38, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee4cf6d8-e0ea-4c7c-a12d-2b7899fd82f7 req-24c1070d-34c2-44eb-807b-8dd11a481d8e service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Received event network-changed-32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee4cf6d8-e0ea-4c7c-a12d-2b7899fd82f7 req-24c1070d-34c2-44eb-807b-8dd11a481d8e service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Refreshing instance network info cache due to event network-changed-32791716-b2e2-4d6f-ab3a-aba08aca4410. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee4cf6d8-e0ea-4c7c-a12d-2b7899fd82f7 req-24c1070d-34c2-44eb-807b-8dd11a481d8e service nova] Acquiring lock "refresh_cache-bf300df0-a62b-4d1d-8b72-86678e2b69fc" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee4cf6d8-e0ea-4c7c-a12d-2b7899fd82f7 req-24c1070d-34c2-44eb-807b-8dd11a481d8e service nova] Acquired lock "refresh_cache-bf300df0-a62b-4d1d-8b72-86678e2b69fc" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:40 user nova-compute[75210]: DEBUG nova.network.neutron [req-ee4cf6d8-e0ea-4c7c-a12d-2b7899fd82f7 req-24c1070d-34c2-44eb-807b-8dd11a481d8e service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Refreshing network info cache for port 32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:38:41 user nova-compute[75210]: DEBUG nova.network.neutron [req-ee4cf6d8-e0ea-4c7c-a12d-2b7899fd82f7 req-24c1070d-34c2-44eb-807b-8dd11a481d8e service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Updated VIF entry in instance network info cache for port 32791716-b2e2-4d6f-ab3a-aba08aca4410. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:38:41 user nova-compute[75210]: DEBUG nova.network.neutron [req-ee4cf6d8-e0ea-4c7c-a12d-2b7899fd82f7 req-24c1070d-34c2-44eb-807b-8dd11a481d8e service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Updating instance_info_cache with network_info: [{"id": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "address": "fa:16:3e:80:c9:38", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32791716-b2", "ovs_interfaceid": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee4cf6d8-e0ea-4c7c-a12d-2b7899fd82f7 req-24c1070d-34c2-44eb-807b-8dd11a481d8e service nova] Releasing lock "refresh_cache-bf300df0-a62b-4d1d-8b72-86678e2b69fc" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-ffb86bf1-e85b-43ca-8401-af8e854a735c req-bf16f3bc-2b3c-4b3a-803e-59c842df6f59 service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Received event network-vif-plugged-32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ffb86bf1-e85b-43ca-8401-af8e854a735c req-bf16f3bc-2b3c-4b3a-803e-59c842df6f59 service nova] Acquiring lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ffb86bf1-e85b-43ca-8401-af8e854a735c req-bf16f3bc-2b3c-4b3a-803e-59c842df6f59 service nova] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ffb86bf1-e85b-43ca-8401-af8e854a735c req-bf16f3bc-2b3c-4b3a-803e-59c842df6f59 service nova] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-ffb86bf1-e85b-43ca-8401-af8e854a735c req-bf16f3bc-2b3c-4b3a-803e-59c842df6f59 service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] No waiting events found dispatching network-vif-plugged-32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:42 user nova-compute[75210]: WARNING nova.compute.manager [req-ffb86bf1-e85b-43ca-8401-af8e854a735c req-bf16f3bc-2b3c-4b3a-803e-59c842df6f59 service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Received unexpected event network-vif-plugged-32791716-b2e2-4d6f-ab3a-aba08aca4410 for instance with vm_state building and task_state spawning.
Nov 29 01:38:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-dac0ff51-6af7-4f2f-a118-3d2b1e755948 req-e86f121e-b9f3-42dd-b0b9-2da14944b5a3 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Received event network-changed-a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-dac0ff51-6af7-4f2f-a118-3d2b1e755948 req-e86f121e-b9f3-42dd-b0b9-2da14944b5a3 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Refreshing instance network info cache due to event network-changed-a997a159-ff47-43b7-8aac-104013bc4db3. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:38:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dac0ff51-6af7-4f2f-a118-3d2b1e755948 req-e86f121e-b9f3-42dd-b0b9-2da14944b5a3 service nova] Acquiring lock "refresh_cache-fff9790b-6b08-43f9-8a71-577e9f1bf04c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dac0ff51-6af7-4f2f-a118-3d2b1e755948 req-e86f121e-b9f3-42dd-b0b9-2da14944b5a3 service nova] Acquired lock "refresh_cache-fff9790b-6b08-43f9-8a71-577e9f1bf04c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:43 user nova-compute[75210]: DEBUG nova.network.neutron [req-dac0ff51-6af7-4f2f-a118-3d2b1e755948 req-e86f121e-b9f3-42dd-b0b9-2da14944b5a3 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Refreshing network info cache for port a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:38:43 user nova-compute[75210]: DEBUG nova.network.neutron [req-dac0ff51-6af7-4f2f-a118-3d2b1e755948 req-e86f121e-b9f3-42dd-b0b9-2da14944b5a3 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Updated VIF entry in instance network info cache for port a997a159-ff47-43b7-8aac-104013bc4db3. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:38:43 user nova-compute[75210]: DEBUG nova.network.neutron [req-dac0ff51-6af7-4f2f-a118-3d2b1e755948 req-e86f121e-b9f3-42dd-b0b9-2da14944b5a3 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Updating instance_info_cache with network_info: [{"id": "a997a159-ff47-43b7-8aac-104013bc4db3", "address": "fa:16:3e:31:67:14", "network": {"id": "a9818bde-1a8a-4799-abfb-1a4c20f0a05f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-814349716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f485dbe16514b79afba40741584e0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa997a159-ff", "ovs_interfaceid": "a997a159-ff47-43b7-8aac-104013bc4db3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dac0ff51-6af7-4f2f-a118-3d2b1e755948 req-e86f121e-b9f3-42dd-b0b9-2da14944b5a3 service nova] Releasing lock "refresh_cache-fff9790b-6b08-43f9-8a71-577e9f1bf04c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-52f36778-fdde-4313-9863-c128cdf931db req-0d79bff5-fd7c-4655-a08d-874347f15026 service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Received event network-vif-plugged-32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-52f36778-fdde-4313-9863-c128cdf931db req-0d79bff5-fd7c-4655-a08d-874347f15026 service nova] Acquiring lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-52f36778-fdde-4313-9863-c128cdf931db req-0d79bff5-fd7c-4655-a08d-874347f15026 service nova] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-52f36778-fdde-4313-9863-c128cdf931db req-0d79bff5-fd7c-4655-a08d-874347f15026 service nova] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-52f36778-fdde-4313-9863-c128cdf931db req-0d79bff5-fd7c-4655-a08d-874347f15026 service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] No waiting events found dispatching network-vif-plugged-32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:44 user nova-compute[75210]: WARNING nova.compute.manager [req-52f36778-fdde-4313-9863-c128cdf931db req-0d79bff5-fd7c-4655-a08d-874347f15026 service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Received unexpected event network-vif-plugged-32791716-b2e2-4d6f-ab3a-aba08aca4410 for instance with vm_state building and task_state spawning.
Nov 29 01:38:44 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:38:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:38:44 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Instance spawned successfully.
Nov 29 01:38:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:38:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:38:44 user nova-compute[75210]: INFO nova.compute.manager [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Took 6.86 seconds to spawn the instance on the hypervisor.
Nov 29 01:38:44 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:38:44 user nova-compute[75210]: INFO nova.compute.manager [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Took 8.00 seconds to build instance.
Nov 29 01:38:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9157b3ea-5e19-45fb-b5cf-f74849a99825 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.101s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG nova.compute.manager [req-78f1f9ce-8c11-4778-8c36-004735bf757a req-2bf4f107-2da3-45c1-b007-e45085e84dae service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-changed-bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG nova.compute.manager [req-78f1f9ce-8c11-4778-8c36-004735bf757a req-2bf4f107-2da3-45c1-b007-e45085e84dae service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Refreshing instance network info cache due to event network-changed-bddbec43-276a-4a46-a083-2aa153ccd4db. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-78f1f9ce-8c11-4778-8c36-004735bf757a req-2bf4f107-2da3-45c1-b007-e45085e84dae service nova] Acquiring lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-78f1f9ce-8c11-4778-8c36-004735bf757a req-2bf4f107-2da3-45c1-b007-e45085e84dae service nova] Acquired lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG nova.network.neutron [req-78f1f9ce-8c11-4778-8c36-004735bf757a req-2bf4f107-2da3-45c1-b007-e45085e84dae service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Refreshing network info cache for port bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "interface-0d7f5bf7-edc1-465f-b24f-171d1481ffa0-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "interface-0d7f5bf7-edc1-465f-b24f-171d1481ffa0-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG nova.objects.instance [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lazy-loading 'flavor' on Instance uuid 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG nova.network.neutron [req-78f1f9ce-8c11-4778-8c36-004735bf757a req-2bf4f107-2da3-45c1-b007-e45085e84dae service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Updated VIF entry in instance network info cache for port bddbec43-276a-4a46-a083-2aa153ccd4db. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG nova.network.neutron [req-78f1f9ce-8c11-4778-8c36-004735bf757a req-2bf4f107-2da3-45c1-b007-e45085e84dae service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Updating instance_info_cache with network_info: [{"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-78f1f9ce-8c11-4778-8c36-004735bf757a req-2bf4f107-2da3-45c1-b007-e45085e84dae service nova] Releasing lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG nova.objects.instance [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lazy-loading 'pci_requests' on Instance uuid 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG nova.objects.base [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Object Instance<0d7f5bf7-edc1-465f-b24f-171d1481ffa0> lazy-loaded attributes: flavor,pci_requests {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:38:45 user nova-compute[75210]: DEBUG nova.policy [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '413fdbcc401e4fd99a537e93fea9eaa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d017f83b2449c18c70e3dbed78af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:38:46 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Successfully created port: 181af4a1-3952-4c3c-b58c-c87a89a63bab {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Successfully updated port: 181af4a1-3952-4c3c-b58c-c87a89a63bab {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquired lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG nova.compute.manager [req-9a655f49-7e43-4d0b-8cf9-c6c66d19d17b req-e98fd804-e771-4630-9345-05ba4b05d75b service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-changed-181af4a1-3952-4c3c-b58c-c87a89a63bab {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG nova.compute.manager [req-9a655f49-7e43-4d0b-8cf9-c6c66d19d17b req-e98fd804-e771-4630-9345-05ba4b05d75b service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Refreshing instance network info cache due to event network-changed-181af4a1-3952-4c3c-b58c-c87a89a63bab. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9a655f49-7e43-4d0b-8cf9-c6c66d19d17b req-e98fd804-e771-4630-9345-05ba4b05d75b service nova] Acquiring lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFaQgzoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:38:47 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:38:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:38:47 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:38:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:38:47 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6800710-b8ae-4a77-90b2-8ffeafe6c300]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:38:47 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c1148f-c9d2-4e52-8e08-d24b8cb8ff2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b] added
Nov 29 01:38:47 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab23214e-8196-4033-961a-bfc2eae00151]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d4e8b1-fa52-4cf8-99d3-a42846f015de]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFaQgzoe {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFaQgzoe" returned: 0 in 0.035s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d616461-8b67-47ad-aa01-397016b2e03c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VFaQgzoe'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc7d236-b175-41c5-9833-b4d09c2fe615]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ea4778-d347-485c-990a-d96930aed3e8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:47 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:47 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:47 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:47 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:47 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:47 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:47 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:47 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:47 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:47 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:38:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[37295358-ac75-4ead-8d41-707c1717868b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b, portal: 172.16.0.220,3260]
Nov 29 01:38:48 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b, portal: 172.16.0.220,3260] successful.
Nov 29 01:38:48 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5701ef17-c5b3-43b8-818e-03384cf5980c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7f250f-c5a8-4739-bd11-2b2fc6cb573e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:48 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:48 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:48 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:48 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:48 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:38:48 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:48 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:48 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:48 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:48 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:48 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:38:48 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG nova.objects.instance [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lazy-loading 'flavor' on Instance uuid fff9790b-6b08-43f9-8a71-577e9f1bf04c {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9e69d0-809a-4660-abc9-77379aa8f588]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFaQgzoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vaeouFjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:38:48 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:48 user nova-compute[75210]: INFO nova.compute.manager [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Attaching volume 60116b9c-ddca-4d23-bf8c-a64878d0dc27 to /dev/sdc
Nov 29 01:38:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Updating instance_info_cache with network_info: [{"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Releasing lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9a655f49-7e43-4d0b-8cf9-c6c66d19d17b req-e98fd804-e771-4630-9345-05ba4b05d75b service nova] Acquired lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG nova.network.neutron [req-9a655f49-7e43-4d0b-8cf9-c6c66d19d17b req-e98fd804-e771-4630-9345-05ba4b05d75b service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Refreshing network info cache for port 181af4a1-3952-4c3c-b58c-c87a89a63bab {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:36:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906023654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906023654',id=6,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmtm9Y/rL28hHvUP7150cqzO8TBgS/8Pwq7X/7Gtilm5Sd870B/ZK7bsEtY2wPDo+rNSG8X+Tp2Avrz3QbtDNgCJe0acCKnqRj8bkYwO8r/0na0wbSxh0PaL89RzsH/pA==',key_name='tempest-keypair-1039804411',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='08d017f83b2449c18c70e3dbed78af01',ramdisk_id='',reservation_id='r-c01u2q0f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1153284446',owner_user_name='tempest-TaggedAttachmentsTest-1153284446-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413fdbcc401e4fd99a537e93fea9eaa4',uuid=0d7f5bf7-edc1-465f-b24f-171d1481ffa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converting VIF {"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:df,bridge_name='br-int',has_traffic_filtering=True,id=181af4a1-3952-4c3c-b58c-c87a89a63bab,network=Network(28cea21a-f823-40a9-8d9c-4bcbf5829b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181af4a1-39') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_vif [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:df,bridge_name='br-int',has_traffic_filtering=True,id=181af4a1-3952-4c3c-b58c-c87a89a63bab,network=Network(28cea21a-f823-40a9-8d9c-4bcbf5829b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181af4a1-39') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b0bb0c0-59e4-50da-84c5-278e2111c23e', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap181af4a1-39, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap181af4a1-39, col_values=(('qos', UUID('63e6a312-de4b-4f88-ad64-324a54ed3aa3')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap181af4a1-39, col_values=(('external_ids', {'iface-id': '181af4a1-3952-4c3c-b58c-c87a89a63bab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:09:df', 'vm-uuid': '0d7f5bf7-edc1-465f-b24f-171d1481ffa0'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:48 user nova-compute[75210]: INFO os_vif [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:df,bridge_name='br-int',has_traffic_filtering=True,id=181af4a1-3952-4c3c-b58c-c87a89a63bab,network=Network(28cea21a-f823-40a9-8d9c-4bcbf5829b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181af4a1-39')
Nov 29 01:38:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:36:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906023654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906023654',id=6,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmtm9Y/rL28hHvUP7150cqzO8TBgS/8Pwq7X/7Gtilm5Sd870B/ZK7bsEtY2wPDo+rNSG8X+Tp2Avrz3QbtDNgCJe0acCKnqRj8bkYwO8r/0na0wbSxh0PaL89RzsH/pA==',key_name='tempest-keypair-1039804411',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='08d017f83b2449c18c70e3dbed78af01',ramdisk_id='',reservation_id='r-c01u2q0f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1153284446',owner_user_name='tempest-TaggedAttachmentsTest-1153284446-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413fdbcc401e4fd99a537e93fea9eaa4',uuid=0d7f5bf7-edc1-465f-b24f-171d1481ffa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converting VIF {"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:df,bridge_name='br-int',has_traffic_filtering=True,id=181af4a1-3952-4c3c-b58c-c87a89a63bab,network=Network(28cea21a-f823-40a9-8d9c-4bcbf5829b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181af4a1-39') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] attach device xml: <interface type="ethernet">
Nov 29 01:38:48 user nova-compute[75210]:   <mac address="fa:16:3e:f0:09:df"/>
Nov 29 01:38:48 user nova-compute[75210]:   <model type="virtio"/>
Nov 29 01:38:48 user nova-compute[75210]:   <mtu size="1442"/>
Nov 29 01:38:48 user nova-compute[75210]:   <target dev="tap181af4a1-39"/>
Nov 29 01:38:48 user nova-compute[75210]: </interface>
Nov 29 01:38:48 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.utils [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b826bee-88fd-4d33-99e7-efafb8573151]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[996c30e1-df31-48fc-b4b7-231d89483ff5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62d0e1e-7612-4459-8841-ef732e96bd6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[598a7062-9587-4f6d-8373-010bb970f56c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:48 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:38:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe62eee-a302-48e7-872c-131e2efe3cb2]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG os_brick.utils [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:38:48 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Updating existing volume attachment record: 30521172-eda1-4753-ae43-5b23432c0154 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23939393234303831', 'path': '/dev/sdg'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939393234303831', 'path': '/dev/sdg'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:38:49 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.123s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:38:49 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.objects.instance [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lazy-loading 'flavor' on Instance uuid 088f3f0c-2895-46f9-9697-a48d35a1f6f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[461282ee-7f89-46ac-924c-2c71ff007410]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:38:49 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[195fad70-893c-4a13-b986-e03ca0cc9d44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a] added
Nov 29 01:38:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:38:49 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:38:49 user nova-compute[75210]:   <source dev="/dev/sdg"/>
Nov 29 01:38:49 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:38:49 user nova-compute[75210]:   <serial>93582a82-1839-4ff5-bfc6-fb69f81e991b</serial>
Nov 29 01:38:49 user nova-compute[75210]: </disk>
Nov 29 01:38:49 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2c8624-2367-4db0-9008-75f78ee20af9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] No BDM found with device name hda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] No VIF found with MAC fa:16:3e:00:cd:81, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96c2c11-f55e-4783-88db-c267e46e78be]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vaeouFjO {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.network.neutron [req-9a655f49-7e43-4d0b-8cf9-c6c66d19d17b req-e98fd804-e771-4630-9345-05ba4b05d75b service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Updated VIF entry in instance network info cache for port 181af4a1-3952-4c3c-b58c-c87a89a63bab. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.network.neutron [req-9a655f49-7e43-4d0b-8cf9-c6c66d19d17b req-e98fd804-e771-4630-9345-05ba4b05d75b service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Updating instance_info_cache with network_info: [{"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:38:49 user nova-compute[75210]:   <nova:package version="0.0.0"/>
Nov 29 01:38:49 user nova-compute[75210]:   <nova:name>tempest-device-tagging-server-1906023654</nova:name>
Nov 29 01:38:49 user nova-compute[75210]:   <nova:creationTime>2023-11-29 01:38:49</nova:creationTime>
Nov 29 01:38:49 user nova-compute[75210]:   <nova:flavor name="m1.tiny">
Nov 29 01:38:49 user nova-compute[75210]:     <nova:memory>512</nova:memory>
Nov 29 01:38:49 user nova-compute[75210]:     <nova:disk>1</nova:disk>
Nov 29 01:38:49 user nova-compute[75210]:     <nova:swap>0</nova:swap>
Nov 29 01:38:49 user nova-compute[75210]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:38:49 user nova-compute[75210]:     <nova:vcpus>1</nova:vcpus>
Nov 29 01:38:49 user nova-compute[75210]:   </nova:flavor>
Nov 29 01:38:49 user nova-compute[75210]:   <nova:owner>
Nov 29 01:38:49 user nova-compute[75210]:     <nova:user uuid="413fdbcc401e4fd99a537e93fea9eaa4">tempest-TaggedAttachmentsTest-1153284446-project-member</nova:user>
Nov 29 01:38:49 user nova-compute[75210]:     <nova:project uuid="08d017f83b2449c18c70e3dbed78af01">tempest-TaggedAttachmentsTest-1153284446</nova:project>
Nov 29 01:38:49 user nova-compute[75210]:   </nova:owner>
Nov 29 01:38:49 user nova-compute[75210]:   <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:38:49 user nova-compute[75210]:   <nova:ports>
Nov 29 01:38:49 user nova-compute[75210]:     <nova:port uuid="bddbec43-276a-4a46-a083-2aa153ccd4db">
Nov 29 01:38:49 user nova-compute[75210]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:38:49 user nova-compute[75210]:     </nova:port>
Nov 29 01:38:49 user nova-compute[75210]:     <nova:port uuid="181af4a1-3952-4c3c-b58c-c87a89a63bab">
Nov 29 01:38:49 user nova-compute[75210]:       <nova:ip type="fixed" address="10.10.10.20" ipVersion="4"/>
Nov 29 01:38:49 user nova-compute[75210]:     </nova:port>
Nov 29 01:38:49 user nova-compute[75210]:   </nova:ports>
Nov 29 01:38:49 user nova-compute[75210]: </nova:instance>
Nov 29 01:38:49 user nova-compute[75210]:  {{(pid=75210) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vaeouFjO" returned: 0 in 0.042s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[386fef28-c6cd-47b5-b618-8a027fd6ee3b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vaeouFjO'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9a655f49-7e43-4d0b-8cf9-c6c66d19d17b req-e98fd804-e771-4630-9345-05ba4b05d75b service nova] Releasing lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ec37a548-25c6-4e6e-84b4-9ca5e27b3f94 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "interface-0d7f5bf7-edc1-465f-b24f-171d1481ffa0-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.956s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[18557f00-70ee-4225-a8e1-81c709eab00a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b7c5d4-f04a-491d-bd01-aa79080db214]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:38:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:38:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e7409c-19a0-4cb8-b3d5-54961eee3b79]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260]
Nov 29 01:38:49 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260] successful.
Nov 29 01:38:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[32230e47-2f51-443b-86e7-8fe8f84ce489]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-d47c948f-6ef6-4767-be1a-78b63602cc87 req-ad01bc46-744d-4dc0-ac24-e92e9c986ad9 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-vif-plugged-181af4a1-3952-4c3c-b58c-c87a89a63bab {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d47c948f-6ef6-4767-be1a-78b63602cc87 req-ad01bc46-744d-4dc0-ac24-e92e9c986ad9 service nova] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d47c948f-6ef6-4767-be1a-78b63602cc87 req-ad01bc46-744d-4dc0-ac24-e92e9c986ad9 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d47c948f-6ef6-4767-be1a-78b63602cc87 req-ad01bc46-744d-4dc0-ac24-e92e9c986ad9 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-d47c948f-6ef6-4767-be1a-78b63602cc87 req-ad01bc46-744d-4dc0-ac24-e92e9c986ad9 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] No waiting events found dispatching network-vif-plugged-181af4a1-3952-4c3c-b58c-c87a89a63bab {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:49 user nova-compute[75210]: WARNING nova.compute.manager [req-d47c948f-6ef6-4767-be1a-78b63602cc87 req-ad01bc46-744d-4dc0-ac24-e92e9c986ad9 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received unexpected event network-vif-plugged-181af4a1-3952-4c3c-b58c-c87a89a63bab for instance with vm_state active and task_state None.
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-d47c948f-6ef6-4767-be1a-78b63602cc87 req-ad01bc46-744d-4dc0-ac24-e92e9c986ad9 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-vif-plugged-181af4a1-3952-4c3c-b58c-c87a89a63bab {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d47c948f-6ef6-4767-be1a-78b63602cc87 req-ad01bc46-744d-4dc0-ac24-e92e9c986ad9 service nova] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d47c948f-6ef6-4767-be1a-78b63602cc87 req-ad01bc46-744d-4dc0-ac24-e92e9c986ad9 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d47c948f-6ef6-4767-be1a-78b63602cc87 req-ad01bc46-744d-4dc0-ac24-e92e9c986ad9 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-d47c948f-6ef6-4767-be1a-78b63602cc87 req-ad01bc46-744d-4dc0-ac24-e92e9c986ad9 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] No waiting events found dispatching network-vif-plugged-181af4a1-3952-4c3c-b58c-c87a89a63bab {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:49 user nova-compute[75210]: WARNING nova.compute.manager [req-d47c948f-6ef6-4767-be1a-78b63602cc87 req-ad01bc46-744d-4dc0-ac24-e92e9c986ad9 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received unexpected event network-vif-plugged-181af4a1-3952-4c3c-b58c-c87a89a63bab for instance with vm_state active and task_state None.
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e859d694-bca3-42a5-a6fe-d3d9c680e068]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:38:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:38:49 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:38:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.472s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] No VIF found with MAC fa:16:3e:f8:8f:ff, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b346037-f039-4846-ba3c-fe8f44f3a466]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vaeouFjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:49 user nova-compute[75210]: DEBUG nova.objects.instance [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lazy-loading 'flavor' on Instance uuid 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-68cf75d8-8510-4aaf-bf70-23e18165a2c1 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.870s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:50 user nova-compute[75210]: INFO nova.compute.manager [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Attaching volume 889b6f62-4cd3-418c-afb8-cbf3c3d04e42 to /dev/vdb
Nov 29 01:38:50 user nova-compute[75210]: DEBUG os_brick.utils [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6475f32d-4f2b-4f22-a4d6-4b8fd8a343bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b58654-d6ed-40cf-a14b-2d1a3c08c717]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[536633a8-e81d-424f-b705-ad157b04ed4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[582dff63-f3e2-497c-97a6-ca2fe50bea1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-b5503a8e-c1a3-4dac-b90b-46635ca5f363 req-7bbf7a9d-3567-4281-a4a7-1748cc86b7aa service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Received event network-changed-4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-b5503a8e-c1a3-4dac-b90b-46635ca5f363 req-7bbf7a9d-3567-4281-a4a7-1748cc86b7aa service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Refreshing instance network info cache due to event network-changed-4afee2bd-e2b5-4da5-8243-b5158582e51f. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b5503a8e-c1a3-4dac-b90b-46635ca5f363 req-7bbf7a9d-3567-4281-a4a7-1748cc86b7aa service nova] Acquiring lock "refresh_cache-c8c0c1d8-5241-4204-87f2-c9c20618bb86" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b5503a8e-c1a3-4dac-b90b-46635ca5f363 req-7bbf7a9d-3567-4281-a4a7-1748cc86b7aa service nova] Acquired lock "refresh_cache-c8c0c1d8-5241-4204-87f2-c9c20618bb86" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG nova.network.neutron [req-b5503a8e-c1a3-4dac-b90b-46635ca5f363 req-7bbf7a9d-3567-4281-a4a7-1748cc86b7aa service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Refreshing network info cache for port 4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:50 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd731fa-786e-4ef4-b7e8-d30877b39371]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG os_brick.utils [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Updating existing volume attachment record: 055c1345-2a5a-44e8-b07b-d8e24247db2d {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Acquiring lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lazy-loading 'flavor' on Instance uuid c8c0c1d8-5241-4204-87f2-c9c20618bb86 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.647s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] <== connect_volume: return (2649ms) {'type': 'block', 'scsi_wwn': '23433313937623333', 'path': '/dev/sdh'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433313937623333', 'path': '/dev/sdh'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lazy-loading 'flavor' on Instance uuid 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:38:50 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:38:50 user nova-compute[75210]:   <source dev="/dev/sdh"/>
Nov 29 01:38:50 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:38:50 user nova-compute[75210]:   <serial>9fa865ad-bd63-404e-a923-56fa76acb88a</serial>
Nov 29 01:38:50 user nova-compute[75210]: </disk>
Nov 29 01:38:50 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:38:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Acquiring lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:51 user nova-compute[75210]: INFO nova.compute.manager [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Attaching volume aa37108f-04c4-4236-8abf-869a2b378bf0 to /dev/vdb
Nov 29 01:38:51 user nova-compute[75210]: DEBUG nova.network.neutron [req-b5503a8e-c1a3-4dac-b90b-46635ca5f363 req-7bbf7a9d-3567-4281-a4a7-1748cc86b7aa service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Updated VIF entry in instance network info cache for port 4afee2bd-e2b5-4da5-8243-b5158582e51f. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG nova.network.neutron [req-b5503a8e-c1a3-4dac-b90b-46635ca5f363 req-7bbf7a9d-3567-4281-a4a7-1748cc86b7aa service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Updating instance_info_cache with network_info: [{"id": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "address": "fa:16:3e:e4:32:00", "network": {"id": "5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1723418922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d144a64090b94fe783113062302ee8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afee2bd-e2", "ovs_interfaceid": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b5503a8e-c1a3-4dac-b90b-46635ca5f363 req-7bbf7a9d-3567-4281-a4a7-1748cc86b7aa service nova] Releasing lock "refresh_cache-c8c0c1d8-5241-4204-87f2-c9c20618bb86" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG os_brick.utils [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:51 user nova-compute[75210]: INFO nova.compute.manager [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Detaching volume 93582a82-1839-4ff5-bfc6-fb69f81e991b
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b163a5ed-a303-4c13-83f1-e49c1d1ea884]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bf11e5-ca57-40fb-84e9-d8ee26915be1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[581ac55c-1acb-4df8-98a0-7a3c5cdf367c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76e912f-3d2f-45fd-894e-728f1d2ace61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:38:51 user nova-compute[75210]: INFO nova.virt.block_device [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Attempting to driver detach volume 93582a82-1839-4ff5-bfc6-fb69f81e991b from mountpoint /dev/vdb
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:51 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:38:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b7c373-58db-4dee-a4e3-813b9793aecc]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG os_brick.utils [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Updating existing volume attachment record: 9e18e4d5-3c1a-48dc-967e-6c702e574d4a {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Attempting to detach device vdb from instance 088f3f0c-2895-46f9-9697-a48d35a1f6f6 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:38:51 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:38:51 user nova-compute[75210]:   <source dev="/dev/sdg"/>
Nov 29 01:38:51 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:38:51 user nova-compute[75210]:   <serial>93582a82-1839-4ff5-bfc6-fb69f81e991b</serial>
Nov 29 01:38:51 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:38:51 user nova-compute[75210]: </disk>
Nov 29 01:38:51 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:38:51 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Successfully detached device vdb from instance 088f3f0c-2895-46f9-9697-a48d35a1f6f6 from the persistent domain config.
Nov 29 01:38:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 088f3f0c-2895-46f9-9697-a48d35a1f6f6 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:38:51 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:38:51 user nova-compute[75210]:   <source dev="/dev/sdg"/>
Nov 29 01:38:51 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:38:51 user nova-compute[75210]:   <serial>93582a82-1839-4ff5-bfc6-fb69f81e991b</serial>
Nov 29 01:38:51 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:38:51 user nova-compute[75210]: </disk>
Nov 29 01:38:51 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] No VIF found with MAC fa:16:3e:dc:86:85, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:38:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 088f3f0c-2895-46f9-9697-a48d35a1f6f6 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:38:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-2ce7581e-d490-4bf5-bce0-777aed50ec49 req-84267409-6397-4d0b-a132-e4a744876875 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received event network-changed-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-2ce7581e-d490-4bf5-bce0-777aed50ec49 req-84267409-6397-4d0b-a132-e4a744876875 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Refreshing instance network info cache due to event network-changed-c0fd23c3-6145-4950-ac75-4af31b96ed5e. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:38:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2ce7581e-d490-4bf5-bce0-777aed50ec49 req-84267409-6397-4d0b-a132-e4a744876875 service nova] Acquiring lock "refresh_cache-10a92792-5f02-42e5-8012-a022fc717797" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:38:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2ce7581e-d490-4bf5-bce0-777aed50ec49 req-84267409-6397-4d0b-a132-e4a744876875 service nova] Acquired lock "refresh_cache-10a92792-5f02-42e5-8012-a022fc717797" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:38:52 user nova-compute[75210]: DEBUG nova.network.neutron [req-2ce7581e-d490-4bf5-bce0-777aed50ec49 req-84267409-6397-4d0b-a132-e4a744876875 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Refreshing network info cache for port c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:38:52 user nova-compute[75210]: DEBUG nova.network.neutron [req-2ce7581e-d490-4bf5-bce0-777aed50ec49 req-84267409-6397-4d0b-a132-e4a744876875 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Updated VIF entry in instance network info cache for port c0fd23c3-6145-4950-ac75-4af31b96ed5e. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:38:52 user nova-compute[75210]: DEBUG nova.network.neutron [req-2ce7581e-d490-4bf5-bce0-777aed50ec49 req-84267409-6397-4d0b-a132-e4a744876875 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Updating instance_info_cache with network_info: [{"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:38:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2ce7581e-d490-4bf5-bce0-777aed50ec49 req-84267409-6397-4d0b-a132-e4a744876875 service nova] Releasing lock "refresh_cache-10a92792-5f02-42e5-8012-a022fc717797" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:38:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDGitqsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:38:56 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:38:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:38:56 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:38:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:38:56 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa4383c-e68a-44f3-862f-24adf1b1a9f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:38:56 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b5854a-0676-45ce-9b04-2f07523f2d96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27] added
Nov 29 01:38:56 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16f2f9f-faf6-4e74-a233-0ac7e66f092f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3ab8191b-1b9c-47c3-9d96-e95bf5f5a06a tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.647s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[576c710c-db8f-4138-bc2d-5995cb082a81]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aDGitqsp {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aDGitqsp" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[05afdf08-a947-4604-919c-521d6f3735dd]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aDGitqsp'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[048ecb0b-26a3-4e26-b61c-cbf7806137df]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[533dddd5-b834-4f95-8f8f-4c3083cd2a1f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:38:57 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:38:57 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe44d8d-afe2-4edb-8aa5-b5c901993e4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27, portal: 172.16.0.220,3260]
Nov 29 01:38:57 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27, portal: 172.16.0.220,3260] successful.
Nov 29 01:38:57 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd141816-35c9-49b9-b2ed-2af6a28daed2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e2756a-8706-4350-876e-a6feda589a4e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:38:57 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:38:57 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[835a9c27-9833-4c08-a22b-548d013601d7]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDGitqsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Acquiring lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG os_brick.utils [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7925a3bb-9ed7-402f-861d-bcdb89b61606]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4797193-a5a0-4759-884b-56eacc81f040]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae64221-4717-405e-b29d-090533073cf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c027f04-dd97-4cf4-8dba-22a5e0a92243]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:38:58 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:38:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2482e25b-85bc-46a3-825e-84b1456ee5c7]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG os_brick.utils [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:38:58 user nova-compute[75210]: INFO nova.compute.manager [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Rebuilding instance
Nov 29 01:38:58 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23565326138313730', 'path': '/dev/sdi'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565326138313730', 'path': '/dev/sdi'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG nova.objects.instance [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lazy-loading 'flavor' on Instance uuid fff9790b-6b08-43f9-8a71-577e9f1bf04c {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:38:58 user nova-compute[75210]: INFO nova.compute.manager [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Swapping volume 9fa865ad-bd63-404e-a923-56fa76acb88a for cd6acc4a-acee-4240-bdf4-ea0411135bcc
Nov 29 01:38:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:38:58 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:38:58 user nova-compute[75210]:   <source dev="/dev/sdi"/>
Nov 29 01:38:58 user nova-compute[75210]:   <target dev="sdc" bus="scsi"/>
Nov 29 01:38:58 user nova-compute[75210]:   <serial>60116b9c-ddca-4d23-bf8c-a64878d0dc27</serial>
Nov 29 01:38:58 user nova-compute[75210]:   <address type="drive" controller="0" unit="2"/>
Nov 29 01:38:58 user nova-compute[75210]: </disk>
Nov 29 01:38:58 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-b825d02d-1e61-4d26-b7b7-e2ac5533179c req-6d8eaff1-5443-4fc9-814d-001599fc8c41 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received event network-vif-unplugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b825d02d-1e61-4d26-b7b7-e2ac5533179c req-6d8eaff1-5443-4fc9-814d-001599fc8c41 service nova] Acquiring lock "10a92792-5f02-42e5-8012-a022fc717797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b825d02d-1e61-4d26-b7b7-e2ac5533179c req-6d8eaff1-5443-4fc9-814d-001599fc8c41 service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b825d02d-1e61-4d26-b7b7-e2ac5533179c req-6d8eaff1-5443-4fc9-814d-001599fc8c41 service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-b825d02d-1e61-4d26-b7b7-e2ac5533179c req-6d8eaff1-5443-4fc9-814d-001599fc8c41 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] No waiting events found dispatching network-vif-unplugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:38:58 user nova-compute[75210]: WARNING nova.compute.manager [req-b825d02d-1e61-4d26-b7b7-e2ac5533179c req-6d8eaff1-5443-4fc9-814d-001599fc8c41 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received unexpected event network-vif-unplugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e for instance with vm_state active and task_state rebuilding.
Nov 29 01:38:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] No BDM found with device name sda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:38:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] No VIF found with MAC fa:16:3e:31:67:14, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:38:59 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Instance destroyed successfully.
Nov 29 01:38:59 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Instance destroyed successfully.
Nov 29 01:38:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2066306463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-270978347',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGU0DOtHsgsIIlh0yZXrpDNtdGQqQOnDnHoYuM6y1g9Epjtm7yg8pFsSH/xmwlmyR3J6FK80EjbFlCtWmdPs07pGLRnJSll8hIizePLsEmCf5a2RfdkfGukgo+XphH4Xw==',key_name='tempest-keypair-496495817',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:37:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d20161f567a4c50956fda3ec66ea74b',ramdisk_id='',reservation_id='r-eq4oj3h7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-974565393',owner_user_name='tempest-ServerActionsV293TestJSON-974565393-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed9ecba6c9944ba5804dc45e4e107f08',uuid=10a92792-5f02-42e5-8012-a022fc717797,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Converting VIF {"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_vif [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0fd23c3-61, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a6b8a61-14ba-477b-b1ab-2a83afc61e88) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:38:59 user nova-compute[75210]: INFO os_vif [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61')
Nov 29 01:38:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUIVBpEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:38:59 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a52b8-5b29-4843-8d10-78d4caf3e129]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:38:59 user nova-compute[75210]: No targets found.
Nov 29 01:38:59 user nova-compute[75210]: iSNS:
Nov 29 01:38:59 user nova-compute[75210]: No targets found.
Nov 29 01:38:59 user nova-compute[75210]: STATIC:
Nov 29 01:38:59 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:38:59 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:38:59 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:38:59 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b
Nov 29 01:38:59 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:38:59 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:38:59 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1
Nov 29 01:38:59 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:38:59 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:38:59 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8
Nov 29 01:38:59 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:38:59 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:38:59 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb
Nov 29 01:38:59 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:38:59 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:38:59 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97
Nov 29 01:38:59 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:38:59 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:38:59 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a
Nov 29 01:38:59 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:38:59 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:38:59 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27
Nov 29 01:38:59 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:38:59 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:38:59 user nova-compute[75210]: FIRMWARE:
Nov 29 01:38:59 user nova-compute[75210]: No targets found.
Nov 29 01:38:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:38:59 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:38:59 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b89efc-8c10-461b-a01c-427ba3ddb94a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba35d5a-66dc-4b16-9f84-ce1ba5f7fe8b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:38:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:38:59 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:38:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e8524700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eadf11-e72b-44e9-af9a-1da96afd05d6]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb66ce98-1b2d-472f-bea1-370dd10d7d80]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc19d775-072a-4ab7-8198-6a0a5e5796e1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[138df0d9-98da-4549-aaaa-cc4492999908]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23036663136316430', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f40a46b6', '/dev/disk/by-id/scsi-1SCST_BIOf40a46b6-06f161d0a5204597') {{(pid=85542) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af16abd-05ec-4c5d-b627-50c6ac027a43]: (4, None) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a21ad3d-9b81-40f1-9c76-201fbdc2fc7e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c22bdf-d496-403d-8141-623fcb5b991c]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260]
Nov 29 01:38:59 user nova-compute[75210]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260] successful.
Nov 29 01:38:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ad0c75-9ed7-4aca-9e4d-ef0a8e7fe5f4]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] <== disconnect_volume: return (353ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:38:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:38:59 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Deleting instance files /opt/stack/data/nova/instances/10a92792-5f02-42e5-8012-a022fc717797_del
Nov 29 01:38:59 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Deletion of /opt/stack/data/nova/instances/10a92792-5f02-42e5-8012-a022fc717797_del complete
Nov 29 01:38:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75210) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 29 01:38:59 user nova-compute[75210]: INFO nova.virt.libvirt.host [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] UEFI support detected
Nov 29 01:39:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-0cf8b09c-59f2-4640-9b28-ee72442f9713 req-62e54ba6-5a18-417e-9c6b-ba2b43ca8bfb service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received event network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0cf8b09c-59f2-4640-9b28-ee72442f9713 req-62e54ba6-5a18-417e-9c6b-ba2b43ca8bfb service nova] Acquiring lock "10a92792-5f02-42e5-8012-a022fc717797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0cf8b09c-59f2-4640-9b28-ee72442f9713 req-62e54ba6-5a18-417e-9c6b-ba2b43ca8bfb service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0cf8b09c-59f2-4640-9b28-ee72442f9713 req-62e54ba6-5a18-417e-9c6b-ba2b43ca8bfb service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-0cf8b09c-59f2-4640-9b28-ee72442f9713 req-62e54ba6-5a18-417e-9c6b-ba2b43ca8bfb service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] No waiting events found dispatching network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:00 user nova-compute[75210]: WARNING nova.compute.manager [req-0cf8b09c-59f2-4640-9b28-ee72442f9713 req-62e54ba6-5a18-417e-9c6b-ba2b43ca8bfb service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received unexpected event network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e for instance with vm_state active and task_state rebuilding.
Nov 29 01:39:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncTuQgjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6cb707b0-aa06-42ee-abd8-f18d01c7cef9', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd6acc4a-acee-4240-bdf4-ea0411135bcc', 'serial': 'cd6acc4a-acee-4240-bdf4-ea0411135bcc'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vaeouFjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '6cb707b0-aa06-42ee-abd8-f18d01c7cef9', 'attached_at': '', 'detached_at': '', 'volume_id': '9fa865ad-bd63-404e-a923-56fa76acb88a', 'serial'} {{(pid=75210) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncTuQgjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:06 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:06 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:06 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5d9684-fef2-4ffa-adaa-c2275582b8ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:39:06 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7dcae6-9873-4568-b390-d62c65856320]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc] added
Nov 29 01:39:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-adf2f9c1-5221-46f5-adf4-6aff0d78af74 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.876s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad453f2-b962-45e9-967d-c369855338c7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c667f97-1569-477d-8425-f2051477948a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncTuQgjX {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncTuQgjX" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dc2654-8cbc-455d-bc04-02f66aaad9fc]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ncTuQgjX'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e004e1c5-f91b-45ff-a863-6f3abc2f1e02]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d0bb5e-8047-4ea3-8e92-356ec0374d54]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a91f3a-a0c7-484b-a0cb-936dc5cca9c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc, portal: 172.16.0.220,3260]
Nov 29 01:39:06 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d1104d-c3c0-4a40-ae4c-41909dc0cb53]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef41d9c8-722a-4a0f-aa6c-80350f0d5438]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:06 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d51fa42-6b6d-4e22-87b1-6230bdcc6894]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncTuQgjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWVRrJfO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:06 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:06 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 10a92792-5f02-42e5-8012-a022fc717797 could not be found.
Nov 29 01:39:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUIVBpEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:06 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfanMEGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:06 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:07 user nova-compute[75210]: INFO nova.compute.manager [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Detaching volume 60116b9c-ddca-4d23-bf8c-a64878d0dc27
Nov 29 01:39:07 user nova-compute[75210]: INFO nova.virt.block_device [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Attempting to driver detach volume 60116b9c-ddca-4d23-bf8c-a64878d0dc27 from mountpoint /dev/sdc
Nov 29 01:39:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Attempting to detach device sdc from instance fff9790b-6b08-43f9-8a71-577e9f1bf04c from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:39:07 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:39:07 user nova-compute[75210]:   <source dev="/dev/sdi"/>
Nov 29 01:39:07 user nova-compute[75210]:   <target dev="sdc" bus="scsi"/>
Nov 29 01:39:07 user nova-compute[75210]:   <serial>60116b9c-ddca-4d23-bf8c-a64878d0dc27</serial>
Nov 29 01:39:07 user nova-compute[75210]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 01:39:07 user nova-compute[75210]: </disk>
Nov 29 01:39:07 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:39:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Successfully detached device sdc from instance fff9790b-6b08-43f9-8a71-577e9f1bf04c from the persistent domain config.
Nov 29 01:39:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance fff9790b-6b08-43f9-8a71-577e9f1bf04c from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:39:07 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:39:07 user nova-compute[75210]:   <source dev="/dev/sdi"/>
Nov 29 01:39:07 user nova-compute[75210]:   <target dev="sdc" bus="scsi"/>
Nov 29 01:39:07 user nova-compute[75210]:   <serial>60116b9c-ddca-4d23-bf8c-a64878d0dc27</serial>
Nov 29 01:39:07 user nova-compute[75210]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 29 01:39:07 user nova-compute[75210]: </disk>
Nov 29 01:39:07 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26432336363626366', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432336363626366', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.914s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:07 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:07 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:39:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance fff9790b-6b08-43f9-8a71-577e9f1bf04c {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG nova.objects.instance [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lazy-loading 'flavor' on Instance uuid 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc465ba-79de-47ca-bc70-4d99371c3aea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:39:07 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b53561-2b01-46b3-95ba-4c9c6d0a23f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42] added
Nov 29 01:39:07 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6286c11-8134-4ecd-8e67-498219bc258f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.042s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d284af51-9623-40b8-a29a-4b627c8bb3f6]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWVRrJfO {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWVRrJfO" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8557b550-a31c-470d-93ec-88c67d264ba0]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SWVRrJfO'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34080d1-7969-40b7-a4cd-b4be6116732a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f5183d-1393-4be7-8a4a-16baa6076ed8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef920ff-2da0-42ee-a9a1-19b13b0ccf9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42, portal: 172.16.0.220,3260]
Nov 29 01:39:07 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:07 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b8aa34-f885-495f-b168-4045b45a0fc5]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a56615-94d1-418e-8915-476f4dcbde20]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:07 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:07 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bab133-38e6-4fb8-9d50-b2a653b49df8]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:39:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWVRrJfO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:39:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 15728640 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 161480704 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] <== connect_volume: return (2317ms) {'type': 'block', 'scsi_wwn': '26130303830333566', 'path': '/dev/sdj'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130303830333566', 'path': '/dev/sdj'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:39:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.286s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG nova.objects.instance [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lazy-loading 'flavor' on Instance uuid 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[13653134-d676-47f9-94d7-5f1d4d343ab6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:39:09 user nova-compute[75210]: No targets found.
Nov 29 01:39:09 user nova-compute[75210]: iSNS:
Nov 29 01:39:09 user nova-compute[75210]: No targets found.
Nov 29 01:39:09 user nova-compute[75210]: STATIC:
Nov 29 01:39:09 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:39:09 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:09 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:09 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b
Nov 29 01:39:09 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:09 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:09 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1
Nov 29 01:39:09 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:09 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:09 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8
Nov 29 01:39:09 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:09 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:09 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97
Nov 29 01:39:09 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:09 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:09 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42
Nov 29 01:39:09 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:09 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:09 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a
Nov 29 01:39:09 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:09 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:09 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27
Nov 29 01:39:09 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:09 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:09 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc
Nov 29 01:39:09 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:09 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:09 user nova-compute[75210]: FIRMWARE:
Nov 29 01:39:09 user nova-compute[75210]: No targets found.
Nov 29 01:39:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:39:09 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:39:09 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:39:09 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:39:09 user nova-compute[75210]:   <source dev="/dev/sdj"/>
Nov 29 01:39:09 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:39:09 user nova-compute[75210]:   <serial>889b6f62-4cd3-418c-afb8-cbf3c3d04e42</serial>
Nov 29 01:39:09 user nova-compute[75210]: </disk>
Nov 29 01:39:09 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d527f0d-39a6-4e4e-a260-87a92e84b19a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[574f19c7-90a2-4b81-b71b-e1cc532f39d7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f240813d1b0>, {}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Disconnecting from: [] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.126s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] <== disconnect_volume: return (2411ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.412s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:09 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:09 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 303038464 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcfba73-8dfe-4da4-9a26-1008cf6130aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:39:09 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0606bf-378a-4773-8010-f4654fc2d040]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0] added
Nov 29 01:39:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[af623a14-042f-49c4-9615-f6a502d307c5]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d69e8f7-9891-44aa-8f17-4ad2a3fd2091]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfanMEGU {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfanMEGU" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[956c6be5-bf9b-4623-b018-3969e7beeef6]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yfanMEGU'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e447355-f91d-41ea-8259-bfa9976d0630]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b259dfa-1784-4f8b-a475-b74a0eb6c3b2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed0cd1a-5e2c-456d-9f80-2d2028b00c29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0, portal: 172.16.0.220,3260]
Nov 29 01:39:09 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a341bc-6a83-4896-ab2f-35dfde3fa8a7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4c3bab-c732-4d41-b596-c56959155f1f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:09 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc42747-ce08-4ae0-bf43-d5185bd0f86c]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfanMEGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] No BDM found with device name hda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] No VIF found with MAC fa:16:3e:00:cd:81, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:39:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 427819008 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4ff7641c-5e84-4b8a-b89f-105ab1f55f27 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.879s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 467664896 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] <== connect_volume: return (3873ms) {'type': 'block', 'scsi_wwn': '23234613366353864', 'path': '/dev/sdk'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234613366353864', 'path': '/dev/sdk'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:39:10 user nova-compute[75210]: DEBUG nova.objects.instance [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lazy-loading 'flavor' on Instance uuid c8c0c1d8-5241-4204-87f2-c9c20618bb86 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] attach device xml: <disk type="block" device="disk">
Nov 29 01:39:10 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:39:10 user nova-compute[75210]:   <source dev="/dev/sdk"/>
Nov 29 01:39:10 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:39:10 user nova-compute[75210]:   <serial>aa37108f-04c4-4236-8abf-869a2b378bf0</serial>
Nov 29 01:39:10 user nova-compute[75210]: </disk>
Nov 29 01:39:10 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:39:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 529530880 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Preparing to wait for external event volume-reimaged-9f315778-a694-4266-8fec-4d9cc29e76bb {{(pid=75210) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 29 01:39:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "10a92792-5f02-42e5-8012-a022fc717797-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:39:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:39:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] No VIF found with MAC fa:16:3e:e4:32:00, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:39:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 676331520 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-89dd988b-5d27-425f-a397-24647cac2746 tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.357s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 782237696 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:11 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 088f3f0c-2895-46f9-9697-a48d35a1f6f6 is timed out.
Nov 29 01:39:11 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Successfully detached device vdb from instance 088f3f0c-2895-46f9-9697-a48d35a1f6f6 from the live domain config.
Nov 29 01:39:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:39:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFaQgzoe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:11 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[974cc98d-b98a-4396-a1bf-ad546a3691ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:39:12 user nova-compute[75210]: No targets found.
Nov 29 01:39:12 user nova-compute[75210]: iSNS:
Nov 29 01:39:12 user nova-compute[75210]: No targets found.
Nov 29 01:39:12 user nova-compute[75210]: STATIC:
Nov 29 01:39:12 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:39:12 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:12 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:12 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b
Nov 29 01:39:12 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:12 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:12 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1
Nov 29 01:39:12 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:12 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:12 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8
Nov 29 01:39:12 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:12 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:12 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97
Nov 29 01:39:12 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:12 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:12 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42
Nov 29 01:39:12 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:12 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:12 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a
Nov 29 01:39:12 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:12 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:12 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0
Nov 29 01:39:12 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:12 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:12 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27
Nov 29 01:39:12 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:12 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:12 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc
Nov 29 01:39:12 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:12 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:12 user nova-compute[75210]: FIRMWARE:
Nov 29 01:39:12 user nova-compute[75210]: No targets found.
Nov 29 01:39:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:39:12 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:39:12 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36e5778-d28d-4323-b7e0-bf29c894499a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6013d6-a13b-426c-b478-90983a322dfe]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:12 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e820b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b'): ({'sdg'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Removing single pathed devices sdg {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41f5a64-0400-4fe5-b099-adb1fc2a0f1c]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfded1a5-1b17-4b8e-9a8a-ac7cdda83705]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Flushing IO for device /dev/sdg {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[675c7091-9a22-4d5b-a3f0-ee4c454851ae]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 965738496 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09faf35-97cf-4edc-b522-ada2d7ab80cc]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] SCSI volumes sdg have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[83874e21-cb74-4e45-b422-ee487afb1cce]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:12 user nova-compute[75210]: INFO nova.compute.manager [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Detaching volume 889b6f62-4cd3-418c-afb8-cbf3c3d04e42
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5f453a-92bf-4904-9d9a-2620fe8c4cce]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b, portal: 172.16.0.220,3260]
Nov 29 01:39:12 user nova-compute[75210]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3bcaf8e9-bf58-49e9-8b38-cd91b6595bec tempest-VolumesAssistedSnapshotsTest-1652188383 tempest-VolumesAssistedSnapshotsTest-1652188383-project] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] volume_snapshot_create: create_info: {'snapshot_id': '9d05496a-548f-4451-8f84-f7fff4e676f0', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75210) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3bcaf8e9-bf58-49e9-8b38-cd91b6595bec tempest-VolumesAssistedSnapshotsTest-1652188383 tempest-VolumesAssistedSnapshotsTest-1652188383-project] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] snap xml: <domainsnapshot>
Nov 29 01:39:12 user nova-compute[75210]:   <disks>
Nov 29 01:39:12 user nova-compute[75210]:     <disk name="/dev/sdk" snapshot="external" type="file">
Nov 29 01:39:12 user nova-compute[75210]:       <source file="/dev/new_file"/>
Nov 29 01:39:12 user nova-compute[75210]:     </disk>
Nov 29 01:39:12 user nova-compute[75210]:     <disk name="vda" snapshot="no"/>
Nov 29 01:39:12 user nova-compute[75210]:   </disks>
Nov 29 01:39:12 user nova-compute[75210]: </domainsnapshot>
Nov 29 01:39:12 user nova-compute[75210]:  {{(pid=75210) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG nova.objects.instance [None req-3bcaf8e9-bf58-49e9-8b38-cd91b6595bec tempest-VolumesAssistedSnapshotsTest-1652188383 tempest-VolumesAssistedSnapshotsTest-1652188383-project] Lazy-loading 'system_metadata' on Instance uuid c8c0c1d8-5241-4204-87f2-c9c20618bb86 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93582a82-1839-4ff5-bfc6-fb69f81e991b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ebef80-ce88-4476-8aa7-530c42abf89f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.486s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] <== disconnect_volume: return (488ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:39:12 user nova-compute[75210]: INFO nova.virt.block_device [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Attempting to driver detach volume 889b6f62-4cd3-418c-afb8-cbf3c3d04e42 from mountpoint /dev/vdb
Nov 29 01:39:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Attempting to detach device vdb from instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:39:12 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:39:12 user nova-compute[75210]:   <source dev="/dev/sdj"/>
Nov 29 01:39:12 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:39:12 user nova-compute[75210]:   <serial>889b6f62-4cd3-418c-afb8-cbf3c3d04e42</serial>
Nov 29 01:39:12 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 01:39:12 user nova-compute[75210]: </disk>
Nov 29 01:39:12 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:39:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Successfully detached device vdb from instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 from the persistent domain config.
Nov 29 01:39:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:39:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:39:12 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:39:12 user nova-compute[75210]:   <source dev="/dev/sdj"/>
Nov 29 01:39:12 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:39:12 user nova-compute[75210]:   <serial>889b6f62-4cd3-418c-afb8-cbf3c3d04e42</serial>
Nov 29 01:39:12 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 01:39:12 user nova-compute[75210]: </disk>
Nov 29 01:39:12 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:39:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-3bcaf8e9-bf58-49e9-8b38-cd91b6595bec tempest-VolumesAssistedSnapshotsTest-1652188383 tempest-VolumesAssistedSnapshotsTest-1652188383-project] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [None req-3bcaf8e9-bf58-49e9-8b38-cd91b6595bec tempest-VolumesAssistedSnapshotsTest-1652188383 tempest-VolumesAssistedSnapshotsTest-1652188383-project] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Traceback (most recent call last):
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     rv = execute(f, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     six.reraise(c, e, tb)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     raise value
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     rv = meth(*args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] 
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [None req-3bcaf8e9-bf58-49e9-8b38-cd91b6595bec tempest-VolumesAssistedSnapshotsTest-1652188383 tempest-VolumesAssistedSnapshotsTest-1652188383-project] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Traceback (most recent call last):
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     self._volume_snapshot_create(context, instance, guest,
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     rv = execute(f, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     six.reraise(c, e, tb)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     raise value
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     rv = meth(*args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] 
Nov 29 01:39:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0b3457ed-2be6-4eb5-b335-06f99d073bef tempest-VolumesAssistedSnapshotsTest-1652188383 tempest-VolumesAssistedSnapshotsTest-1652188383-project] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] volume_snapshot_delete: delete_info: {'volume_id': 'aa37108f-04c4-4236-8abf-869a2b378bf0'} {{(pid=75210) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [None req-0b3457ed-2be6-4eb5-b335-06f99d073bef tempest-VolumesAssistedSnapshotsTest-1652188383 tempest-VolumesAssistedSnapshotsTest-1652188383-project] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Traceback (most recent call last):
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86]     if delete_info['type'] != 'qcow2':
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] KeyError: 'type'
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] 
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [None req-3bcaf8e9-bf58-49e9-8b38-cd91b6595bec tempest-VolumesAssistedSnapshotsTest-1652188383 tempest-VolumesAssistedSnapshotsTest-1652188383-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 9d05496a-548f-4451-8f84-f7fff4e676f0 could not be found.
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     raise value
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver 
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver 
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 9d05496a-548f-4451-8f84-f7fff4e676f0 could not be found. (HTTP 404) (Request-ID: req-915262e7-218e-4435-b753-b895d03c01ee)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver 
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver 
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 9d05496a-548f-4451-8f84-f7fff4e676f0 could not be found.
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver 
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver [None req-0b3457ed-2be6-4eb5-b335-06f99d073bef tempest-VolumesAssistedSnapshotsTest-1652188383 tempest-VolumesAssistedSnapshotsTest-1652188383-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver 
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver 
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f9a88254-d3f8-4949-af41-a11d1d3ef96d)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver 
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver 
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 29 01:39:12 user nova-compute[75210]: ERROR nova.virt.libvirt.driver 
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server [None req-3bcaf8e9-bf58-49e9-8b38-cd91b6595bec tempest-VolumesAssistedSnapshotsTest-1652188383 tempest-VolumesAssistedSnapshotsTest-1652188383-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     raise value
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server 
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server [None req-0b3457ed-2be6-4eb5-b335-06f99d073bef tempest-VolumesAssistedSnapshotsTest-1652188383 tempest-VolumesAssistedSnapshotsTest-1652188383-project] Exception during message handling: KeyError: 'type'
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 29 01:39:12 user nova-compute[75210]: ERROR oslo_messaging.rpc.server 
Nov 29 01:39:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Acquiring lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:13 user nova-compute[75210]: INFO nova.compute.manager [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Detaching volume aa37108f-04c4-4236-8abf-869a2b378bf0
Nov 29 01:39:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:39:13 user nova-compute[75210]: INFO nova.virt.block_device [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Attempting to driver detach volume aa37108f-04c4-4236-8abf-869a2b378bf0 from mountpoint /dev/vdb
Nov 29 01:39:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Attempting to detach device vdb from instance c8c0c1d8-5241-4204-87f2-c9c20618bb86 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 01:39:13 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:39:13 user nova-compute[75210]:   <source dev="/dev/sdk"/>
Nov 29 01:39:13 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:39:13 user nova-compute[75210]:   <serial>aa37108f-04c4-4236-8abf-869a2b378bf0</serial>
Nov 29 01:39:13 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:39:13 user nova-compute[75210]: </disk>
Nov 29 01:39:13 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:39:13 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Successfully detached device vdb from instance c8c0c1d8-5241-4204-87f2-c9c20618bb86 from the persistent domain config.
Nov 29 01:39:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c8c0c1d8-5241-4204-87f2-c9c20618bb86 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] detach device xml: <disk type="block" device="disk">
Nov 29 01:39:13 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:39:13 user nova-compute[75210]:   <source dev="/dev/sdk"/>
Nov 29 01:39:13 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:39:13 user nova-compute[75210]:   <serial>aa37108f-04c4-4236-8abf-869a2b378bf0</serial>
Nov 29 01:39:13 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:39:13 user nova-compute[75210]: </disk>
Nov 29 01:39:13 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vaeouFjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:13 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[87533fd8-144f-4d22-9c92-bdeba4014131]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:39:13 user nova-compute[75210]: No targets found.
Nov 29 01:39:13 user nova-compute[75210]: iSNS:
Nov 29 01:39:13 user nova-compute[75210]: No targets found.
Nov 29 01:39:13 user nova-compute[75210]: STATIC:
Nov 29 01:39:13 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:39:13 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:13 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:13 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1
Nov 29 01:39:13 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:13 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:13 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8
Nov 29 01:39:13 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:13 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:13 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97
Nov 29 01:39:13 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:13 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:13 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42
Nov 29 01:39:13 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:13 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:13 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a
Nov 29 01:39:13 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:13 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:13 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0
Nov 29 01:39:13 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:13 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:13 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27
Nov 29 01:39:13 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:13 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:13 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc
Nov 29 01:39:13 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:13 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:13 user nova-compute[75210]: FIRMWARE:
Nov 29 01:39:13 user nova-compute[75210]: No targets found.
Nov 29 01:39:13 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:39:13 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:39:13 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7248f5ac-026c-4a5c-a877-51850a67f038]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cad32ad-1acc-4d2e-b7c1-34179aea0f4b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:13 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:13 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:13 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f240811bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a'): ({'sdh'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Removing single pathed devices sdh {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64e0fb8-c956-4c1c-80f3-4e630cc84c00]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[02989f20-0e5e-40d4-87df-a0b8cb444fc7]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Flushing IO for device /dev/sdh {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1809f1-9416-4c6f-ab9f-9f1870772a5f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.079s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ea6073-6d2a-48a5-a8aa-17b19e1f90d1]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] SCSI volumes sdh have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG nova.objects.instance [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lazy-loading 'flavor' on Instance uuid 088f3f0c-2895-46f9-9697-a48d35a1f6f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d4b92b-bd0e-43b1-86a6-10f7985ecfee]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-256e8e98-d32b-4f47-96d7-0522baeade62 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.161s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6ccebe-3bab-41e0-9694-cf27c59321b2]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260]
Nov 29 01:39:13 user nova-compute[75210]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:13 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1a2d99-c887-4903-9b24-66e6e1e6c179]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] <== disconnect_volume: return (405ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c8c0c1d8-5241-4204-87f2-c9c20618bb86 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncTuQgjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6cb707b0-aa06-42ee-abd8-f18d01c7cef9', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd6acc4a-acee-4240-bdf4-ea0411135bcc', 'serial'} {{(pid=75210) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 01:39:13 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] swap_volume: removing Cinder connection for volume 9fa865ad-bd63-404e-a923-56fa76acb88a {{(pid=75210) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 01:39:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:14 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:39:14 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] swap_volume: Updating volume 9fa865ad-bd63-404e-a923-56fa76acb88a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ncTuQgjX", "auth_password": "CeujY705rMnBhS", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "cd6acc4a-acee-4240-bdf4-ea0411135bcc"}, "status": "reserved", "instance": "6cb707b0-aa06-42ee-abd8-f18d01c7cef9", "attached_at": "", "detached_at": "", "volume_id": "cd6acc4a-acee-4240-bdf4-ea0411135bcc", "serial": "cd6acc4a-acee-4240-bdf4-ea0411135bcc"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'cd6acc4a-acee-4240-bdf4-ea0411135bcc', 'no_device': None, 'attachment_id': 'd4d13c2c-ecca-45ff-a3fd-11b6f69b6279'} {{(pid=75210) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 01:39:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5086ad71-6ff0-436b-ba3e-9f6b17f7b0b4 tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.769s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-088f3f0c-2895-46f9-9697-a48d35a1f6f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-088f3f0c-2895-46f9-9697-a48d35a1f6f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Acquiring lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG os_brick.utils [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ea570f-1c99-4080-9b9b-033d0e685e8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b13847a-e906-4ee7-a27a-9207f0f14c19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c63e67-a1a9-44bd-98c1-e3991fc3ee05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[69de8277-c225-4468-b7e5-e80af84e5053]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:39:15 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b78684-b687-4f30-8724-2e13b048988c]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG os_brick.utils [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG nova.compute.manager [req-a9255769-48ca-47fd-90f5-ff063057e784 req-e9b60e1c-acc9-485b-b860-5cd13a1b21d9 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-changed-f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG nova.compute.manager [req-a9255769-48ca-47fd-90f5-ff063057e784 req-e9b60e1c-acc9-485b-b860-5cd13a1b21d9 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing instance network info cache due to event network-changed-f3b667a4-01d3-4aee-a486-30b1ca2d868d. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a9255769-48ca-47fd-90f5-ff063057e784 req-e9b60e1c-acc9-485b-b860-5cd13a1b21d9 service nova] Acquiring lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a9255769-48ca-47fd-90f5-ff063057e784 req-e9b60e1c-acc9-485b-b860-5cd13a1b21d9 service nova] Acquired lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:39:15 user nova-compute[75210]: DEBUG nova.network.neutron [req-a9255769-48ca-47fd-90f5-ff063057e784 req-e9b60e1c-acc9-485b-b860-5cd13a1b21d9 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Refreshing network info cache for port f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:39:15 user nova-compute[75210]: INFO nova.compute.manager [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Swapping volume cd6acc4a-acee-4240-bdf4-ea0411135bcc for 9fa865ad-bd63-404e-a923-56fa76acb88a
Nov 29 01:39:16 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Updating instance_info_cache with network_info: [{"id": "5b7af5ad-622c-41e2-a119-90373684cf5b", "address": "fa:16:3e:f8:8f:ff", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b7af5ad-62", "ovs_interfaceid": "5b7af5ad-622c-41e2-a119-90373684cf5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-088f3f0c-2895-46f9-9697-a48d35a1f6f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:39:16 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:39:16 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:39:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:16 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:39:16 user nova-compute[75210]: DEBUG nova.network.neutron [req-a9255769-48ca-47fd-90f5-ff063057e784 req-e9b60e1c-acc9-485b-b860-5cd13a1b21d9 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updated VIF entry in instance network info cache for port f3b667a4-01d3-4aee-a486-30b1ca2d868d. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:39:16 user nova-compute[75210]: DEBUG nova.network.neutron [req-a9255769-48ca-47fd-90f5-ff063057e784 req-e9b60e1c-acc9-485b-b860-5cd13a1b21d9 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [{"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "address": "fa:16:3e:f5:ee:b0", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88bd7a4-0e", "ovs_interfaceid": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "address": "fa:16:3e:14:f7:95", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a08bcf2-ad", "ovs_interfaceid": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a9255769-48ca-47fd-90f5-ff063057e784 req-e9b60e1c-acc9-485b-b860-5cd13a1b21d9 service nova] Releasing lock "refresh_cache-061f89f7-91f0-4046-b5dc-b5ef7acfaf30" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:39:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:18 user nova-compute[75210]: INFO nova.compute.manager [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Terminating instance
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG nova.compute.manager [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-0d5431ad-d4f8-4c99-ba46-063cc2251044 req-a1e08ad5-76c1-42d5-b398-aace01fdbb6c service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0d5431ad-d4f8-4c99-ba46-063cc2251044 req-a1e08ad5-76c1-42d5-b398-aace01fdbb6c service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0d5431ad-d4f8-4c99-ba46-063cc2251044 req-a1e08ad5-76c1-42d5-b398-aace01fdbb6c service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0d5431ad-d4f8-4c99-ba46-063cc2251044 req-a1e08ad5-76c1-42d5-b398-aace01fdbb6c service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-0d5431ad-d4f8-4c99-ba46-063cc2251044 req-a1e08ad5-76c1-42d5-b398-aace01fdbb6c service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-unplugged-f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-0d5431ad-d4f8-4c99-ba46-063cc2251044 req-a1e08ad5-76c1-42d5-b398-aace01fdbb6c service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-f3b667a4-01d3-4aee-a486-30b1ca2d868d for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-7be32882-84b5-450a-9871-61163ff6b815 req-bf63b9f5-4613-4d04-a2f7-bbd93cd1e523 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-2d450923-2a6b-4299-9be1-0af909115502 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7be32882-84b5-450a-9871-61163ff6b815 req-bf63b9f5-4613-4d04-a2f7-bbd93cd1e523 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7be32882-84b5-450a-9871-61163ff6b815 req-bf63b9f5-4613-4d04-a2f7-bbd93cd1e523 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7be32882-84b5-450a-9871-61163ff6b815 req-bf63b9f5-4613-4d04-a2f7-bbd93cd1e523 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-7be32882-84b5-450a-9871-61163ff6b815 req-bf63b9f5-4613-4d04-a2f7-bbd93cd1e523 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-unplugged-2d450923-2a6b-4299-9be1-0af909115502 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-7be32882-84b5-450a-9871-61163ff6b815 req-bf63b9f5-4613-4d04-a2f7-bbd93cd1e523 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-2d450923-2a6b-4299-9be1-0af909115502 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-72dfc427-1de6-4f83-9c51-77985358a87d req-e44320ba-9bde-420d-ba68-25a48d8be34a service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-72dfc427-1de6-4f83-9c51-77985358a87d req-e44320ba-9bde-420d-ba68-25a48d8be34a service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-72dfc427-1de6-4f83-9c51-77985358a87d req-e44320ba-9bde-420d-ba68-25a48d8be34a service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-72dfc427-1de6-4f83-9c51-77985358a87d req-e44320ba-9bde-420d-ba68-25a48d8be34a service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-72dfc427-1de6-4f83-9c51-77985358a87d req-e44320ba-9bde-420d-ba68-25a48d8be34a service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-unplugged-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-72dfc427-1de6-4f83-9c51-77985358a87d req-e44320ba-9bde-420d-ba68-25a48d8be34a service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:39:20 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Instance destroyed successfully.
Nov 29 01:39:20 user nova-compute[75210]: DEBUG nova.objects.instance [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lazy-loading 'resources' on Instance uuid 061f89f7-91f0-4046-b5dc-b5ef7acfaf30 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:38:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:85:c8,bridge_name='br-int',has_traffic_filtering=True,id=f3b667a4-01d3-4aee-a486-30b1ca2d868d,network=Network(f1e9724b-5ea5-47c8-84e7-7cc6a123c702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b667a4-01') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:85:c8,bridge_name='br-int',has_traffic_filtering=True,id=f3b667a4-01d3-4aee-a486-30b1ca2d868d,network=Network(f1e9724b-5ea5-47c8-84e7-7cc6a123c702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b667a4-01') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3b667a4-01, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e8d4573-f70e-49e4-a0e0-79bc6a9d44c2) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:20 user nova-compute[75210]: INFO os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:85:c8,bridge_name='br-int',has_traffic_filtering=True,id=f3b667a4-01d3-4aee-a486-30b1ca2d868d,network=Network(f1e9724b-5ea5-47c8-84e7-7cc6a123c702),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b667a4-01')
Nov 29 01:39:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:38:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:31:ab,bridge_name='br-int',has_traffic_filtering=True,id=c5881b8e-634d-4969-8e69-b5e3e65adc3d,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5881b8e-63') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:31:ab,bridge_name='br-int',has_traffic_filtering=True,id=c5881b8e-634d-4969-8e69-b5e3e65adc3d,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5881b8e-63') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5881b8e-63, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e80e3ef6-3669-43e1-8726-86d3783a4330) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: INFO os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:31:ab,bridge_name='br-int',has_traffic_filtering=True,id=c5881b8e-634d-4969-8e69-b5e3e65adc3d,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc5881b8e-63')
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:38:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:a2:05,bridge_name='br-int',has_traffic_filtering=True,id=518be547-e0f3-44c9-9cf6-83fa8f7a2a10,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap518be547-e0') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a2:05,bridge_name='br-int',has_traffic_filtering=True,id=518be547-e0f3-44c9-9cf6-83fa8f7a2a10,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap518be547-e0') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap518be547-e0, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70c9be42-74e4-4102-86f8-54c958f91bcb) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: INFO os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:a2:05,bridge_name='br-int',has_traffic_filtering=True,id=518be547-e0f3-44c9-9cf6-83fa8f7a2a10,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap518be547-e0')
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:38:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:1c:51,bridge_name='br-int',has_traffic_filtering=True,id=2d450923-2a6b-4299-9be1-0af909115502,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d450923-2a') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:1c:51,bridge_name='br-int',has_traffic_filtering=True,id=2d450923-2a6b-4299-9be1-0af909115502,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d450923-2a') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d450923-2a, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:21 user nova-compute[75210]: WARNING nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-f3b667a4-01d3-4aee-a486-30b1ca2d868d for instance with vm_state active and task_state deleting.
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-c5881b8e-634d-4969-8e69-b5e3e65adc3d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-unplugged-c5881b8e-634d-4969-8e69-b5e3e65adc3d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-c5881b8e-634d-4969-8e69-b5e3e65adc3d for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-c5881b8e-634d-4969-8e69-b5e3e65adc3d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-c5881b8e-634d-4969-8e69-b5e3e65adc3d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:21 user nova-compute[75210]: WARNING nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-c5881b8e-634d-4969-8e69-b5e3e65adc3d for instance with vm_state active and task_state deleting.
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-518be547-e0f3-44c9-9cf6-83fa8f7a2a10 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-unplugged-518be547-e0f3-44c9-9cf6-83fa8f7a2a10 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-518be547-e0f3-44c9-9cf6-83fa8f7a2a10 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-518be547-e0f3-44c9-9cf6-83fa8f7a2a10 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-518be547-e0f3-44c9-9cf6-83fa8f7a2a10 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:21 user nova-compute[75210]: WARNING nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-518be547-e0f3-44c9-9cf6-83fa8f7a2a10 for instance with vm_state active and task_state deleting.
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-unplugged-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:21 user nova-compute[75210]: WARNING nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba for instance with vm_state active and task_state deleting.
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-e7ea6535-38e6-4481-b759-db9710f14ccb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-unplugged-e7ea6535-38e6-4481-b759-db9710f14ccb {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-unplugged-e7ea6535-38e6-4481-b759-db9710f14ccb for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-e7ea6535-38e6-4481-b759-db9710f14ccb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-e7ea6535-38e6-4481-b759-db9710f14ccb {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:21 user nova-compute[75210]: WARNING nova.compute.manager [req-be87ef78-674f-4fca-bf01-b8b2e1d4f378 req-3fa22313-4c3c-4a96-9c0f-fcbf3d32d446 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-e7ea6535-38e6-4481-b759-db9710f14ccb for instance with vm_state active and task_state deleting.
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-1b7849e4-d010-4b6c-a34f-518895a96cd7 req-e550c55d-3cf5-4c54-8c37-a1f535072d72 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-2d450923-2a6b-4299-9be1-0af909115502 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1b7849e4-d010-4b6c-a34f-518895a96cd7 req-e550c55d-3cf5-4c54-8c37-a1f535072d72 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1b7849e4-d010-4b6c-a34f-518895a96cd7 req-e550c55d-3cf5-4c54-8c37-a1f535072d72 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1b7849e4-d010-4b6c-a34f-518895a96cd7 req-e550c55d-3cf5-4c54-8c37-a1f535072d72 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-1b7849e4-d010-4b6c-a34f-518895a96cd7 req-e550c55d-3cf5-4c54-8c37-a1f535072d72 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-2d450923-2a6b-4299-9be1-0af909115502 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:21 user nova-compute[75210]: WARNING nova.compute.manager [req-1b7849e4-d010-4b6c-a34f-518895a96cd7 req-e550c55d-3cf5-4c54-8c37-a1f535072d72 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-2d450923-2a6b-4299-9be1-0af909115502 for instance with vm_state active and task_state deleting.
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0db8af38-06d7-441c-a6a7-ce237953c202) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:21 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:39:21 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=6851MB free_disk=25.40546417236328GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: INFO os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:1c:51,bridge_name='br-int',has_traffic_filtering=True,id=2d450923-2a6b-4299-9be1-0af909115502,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d450923-2a')
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:38:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "address": "fa:16:3e:f5:ee:b0", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88bd7a4-0e", "ovs_interfaceid": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "address": "fa:16:3e:f5:ee:b0", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88bd7a4-0e", "ovs_interfaceid": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88bd7a4-0e') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88bd7a4-0e') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd88bd7a4-0e, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b2ac952-ef86-4f0b-936d-c3ff1396b41e) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: INFO os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:ee:b0,bridge_name='br-int',has_traffic_filtering=True,id=d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba,network=Network(d995c657-648b-450d-92e3-41b7520c9481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd88bd7a4-0e')
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:38:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "address": "fa:16:3e:14:f7:95", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a08bcf2-ad", "ovs_interfaceid": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "address": "fa:16:3e:14:f7:95", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a08bcf2-ad", "ovs_interfaceid": "7a08bcf2-ad02-4ba4-8caf-a38790d8c493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:f7:95,bridge_name='br-int',has_traffic_filtering=True,id=7a08bcf2-ad02-4ba4-8caf-a38790d8c493,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a08bcf2-ad') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:f7:95,bridge_name='br-int',has_traffic_filtering=True,id=7a08bcf2-ad02-4ba4-8caf-a38790d8c493,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a08bcf2-ad') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a08bcf2-ad, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a59a16f-fbf8-4a7a-94d3-07010f73fbf7) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-405783dc-5a55-4ef6-aa97-91e679b2c17b req-3f7b9ee8-35ec-4f12-80d2-e22da6e863c6 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-plugged-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-405783dc-5a55-4ef6-aa97-91e679b2c17b req-3f7b9ee8-35ec-4f12-80d2-e22da6e863c6 service nova] Acquiring lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-405783dc-5a55-4ef6-aa97-91e679b2c17b req-3f7b9ee8-35ec-4f12-80d2-e22da6e863c6 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-405783dc-5a55-4ef6-aa97-91e679b2c17b req-3f7b9ee8-35ec-4f12-80d2-e22da6e863c6 service nova] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-405783dc-5a55-4ef6-aa97-91e679b2c17b req-3f7b9ee8-35ec-4f12-80d2-e22da6e863c6 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] No waiting events found dispatching network-vif-plugged-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:21 user nova-compute[75210]: WARNING nova.compute.manager [req-405783dc-5a55-4ef6-aa97-91e679b2c17b req-3f7b9ee8-35ec-4f12-80d2-e22da6e863c6 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received unexpected event network-vif-plugged-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 for instance with vm_state active and task_state deleting.
Nov 29 01:39:21 user nova-compute[75210]: INFO os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:f7:95,bridge_name='br-int',has_traffic_filtering=True,id=7a08bcf2-ad02-4ba4-8caf-a38790d8c493,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a08bcf2-ad')
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-450311638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-450311638',id=10,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxqmplRN/pu1l9sB0/zVU7eOR11gp0dQ1ITawDE5HNBMYemAJeUx5ZBtdsf1KAncnfs7/8RWtB8qNsKPgsLHDvRdsruakoSzhLaMsLa1eYxFS0l6KxZa8ZtxMFAADwq3w==',key_name='tempest-keypair-779353937',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:38:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d274f767ed724eb2927863bcfc0ecfc6',ramdisk_id='',reservation_id='r-jm7im1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1709736932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1709736932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:38:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f0e9ad031e14048afd31e194ae57127',uuid=061f89f7-91f0-4046-b5dc-b5ef7acfaf30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converting VIF {"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:35:33,bridge_name='br-int',has_traffic_filtering=True,id=e7ea6535-38e6-4481-b759-db9710f14ccb,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ea6535-38') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:35:33,bridge_name='br-int',has_traffic_filtering=True,id=e7ea6535-38e6-4481-b759-db9710f14ccb,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ea6535-38') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7ea6535-38, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=153bf1f9-7955-46d8-983f-7c189184f6e7) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:22 user nova-compute[75210]: INFO os_vif [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:35:33,bridge_name='br-int',has_traffic_filtering=True,id=e7ea6535-38e6-4481-b759-db9710f14ccb,network=Network(994e9d22-1cdb-4752-9692-b6ebb0bcd006),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7ea6535-38')
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 18aa0259-a720-42aa-be33-4a676dd4d0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 42760d1a-1d14-47bb-a602-6eb3ed5205d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 088f3f0c-2895-46f9-9697-a48d35a1f6f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fff9790b-6b08-43f9-8a71-577e9f1bf04c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c8c0c1d8-5241-4204-87f2-c9c20618bb86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 10a92792-5f02-42e5-8012-a022fc717797 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 059d2d1e-75ba-4672-be7a-3d1ac186a609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 061f89f7-91f0-4046-b5dc-b5ef7acfaf30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 0aa70e63-acd6-4aae-8c8d-167dba11168b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance a6571012-7707-47bc-a057-905eef9d762a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance bf300df0-a62b-4d1d-8b72-86678e2b69fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWEOADlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:22 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c056882-50b0-48bd-a36b-eaff817c99b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:39:22 user nova-compute[75210]: No targets found.
Nov 29 01:39:22 user nova-compute[75210]: iSNS:
Nov 29 01:39:22 user nova-compute[75210]: No targets found.
Nov 29 01:39:22 user nova-compute[75210]: STATIC:
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: FIRMWARE:
Nov 29 01:39:22 user nova-compute[75210]: No targets found.
Nov 29 01:39:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:39:22 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:39:22 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3936052-b2a1-4837-8a5a-a113d03649a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6778eb-365e-4f49-b2f5-5fde19dd112c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f240813e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8'): ({'sde'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Removing single pathed devices sde {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e45e7f-7529-433f-b771-148ee4ff71eb]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b74f94-9310-402e-92cc-e0f642023caa]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Flushing IO for device /dev/sde {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd6bf54-9c71-414c-9556-591d352ce9e3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ad8c84-9948-45d7-a24f-5246a3ae076f]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dda13dd-cdbe-46a5-9295-abc039d22919]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7193be28-a98b-42a2-90fc-5ad231c7f9e2]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8, portal: 172.16.0.220,3260]
Nov 29 01:39:22 user nova-compute[75210]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07f14d03-17ff-4f4c-a95d-5067ccfb60f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b535ea81-c613-450b-ab3d-77cff3c84109]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] <== disconnect_volume: return (385ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxCWYkBU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:22 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9760623b-fbde-4d2f-a2b2-65388a537d07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:39:22 user nova-compute[75210]: No targets found.
Nov 29 01:39:22 user nova-compute[75210]: iSNS:
Nov 29 01:39:22 user nova-compute[75210]: No targets found.
Nov 29 01:39:22 user nova-compute[75210]: STATIC:
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: FIRMWARE:
Nov 29 01:39:22 user nova-compute[75210]: No targets found.
Nov 29 01:39:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:39:22 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:39:22 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7492474b-7d32-4633-a3a2-7df120350f1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadca751-3621-4f56-b228-e810df0e4a26]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e81b4d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2363143c-dcd3-4db7-99a7-f19402b7801d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af4311a-6977-4dd4-b494-e54bbb51f4d8]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6e3d09-c279-4fb6-b5e5-e87c0ca8dfae]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48cfbe2-8207-4bca-91d4-c4deb230b6af]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5e07a5-e021-4677-986b-8d394e47797d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c811341d-1ebb-4e19-8215-240d26248e3a]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1, portal: 172.16.0.220,3260]
Nov 29 01:39:22 user nova-compute[75210]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a26e42f-306c-4267-bf3f-b6d0430d4ee1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d8a8c8-940a-4ddc-b1b1-35176c3c1d97]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] <== disconnect_volume: return (343ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ldKLYpvI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:22 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c8ca61-5c73-455f-859a-81d1a4307887]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:39:22 user nova-compute[75210]: No targets found.
Nov 29 01:39:22 user nova-compute[75210]: iSNS:
Nov 29 01:39:22 user nova-compute[75210]: No targets found.
Nov 29 01:39:22 user nova-compute[75210]: STATIC:
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc
Nov 29 01:39:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:22 user nova-compute[75210]: FIRMWARE:
Nov 29 01:39:22 user nova-compute[75210]: No targets found.
Nov 29 01:39:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:39:22 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:39:22 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e55ea-7150-49aa-9ed6-9edd4afd5348]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6ddb19-b175-4089-af62-9c9d9792d314]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:22 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e81b4d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97'): ({'sdd'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Removing single pathed devices sdd {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2001ea-cf20-4bf0-9f62-10d9c2f18a32]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc56ff32-a7e8-41d0-a269-ef86842bc048]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Flushing IO for device /dev/sdd {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[db297444-d562-41ad-b25f-05529c4fcdc6]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[438deb94-0c11-40a9-a151-7aef250ea369]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:39:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bfcb90-fa02-4ec0-9627-dc2390dbf8d5]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0495b876-0ddf-48d5-953d-7c4918d99e8b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97, portal: 172.16.0.220,3260]
Nov 29 01:39:23 user nova-compute[75210]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:23 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4637c52-9dbb-492a-949a-0de9d3b7af97 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a29973-45ae-47ae-a319-464777a3adce]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] <== disconnect_volume: return (321ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:39:23 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Deleting instance files /opt/stack/data/nova/instances/061f89f7-91f0-4046-b5dc-b5ef7acfaf30_del
Nov 29 01:39:23 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Deletion of /opt/stack/data/nova/instances/061f89f7-91f0-4046-b5dc-b5ef7acfaf30_del complete
Nov 29 01:39:23 user nova-compute[75210]: INFO nova.compute.manager [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Took 4.38 seconds to destroy the instance on the hypervisor.
Nov 29 01:39:23 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:39:23 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vaeouFjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6cb707b0-aa06-42ee-abd8-f18d01c7cef9', 'attached_at': '', 'detached_at': '', 'volume_id': '9fa865ad-bd63-404e-a923-56fa76acb88a', 'serial': '9fa865ad-bd63-404e-a923-56fa76acb88a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncTuQgjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'cd6acc4a-acee-4240-bdf4-ea0411135bcc'}, 'status': 'reserved', 'instance': '6cb707b0-aa06-42ee-abd8-f18d01c7cef9', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd6acc4a-acee-4240-bdf4-ea0411135bcc', 'serial'} {{(pid=75210) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vaeouFjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:24 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:24 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:24 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f192b16-f9ff-4784-9df8-4e0f07c5dbe1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:39:24 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5006c00-79fb-402d-933b-df45a0be5cbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a] added
Nov 29 01:39:24 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf477153-5a81-44be-8317-d3aa2388afb7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f865ece-167d-4777-afc8-d628a5d27bea]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vaeouFjO {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vaeouFjO" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b70a1a0-ee53-4d38-ad93-973af4b812aa]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vaeouFjO'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8c7cd5-f049-41b6-b84a-908be70c962a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abce766-32e5-4fba-b639-75d0147e0075]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:24 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:24 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:24 user nova-compute[75210]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:24 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:24 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:24 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:24 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:24 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:24 user nova-compute[75210]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:24 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:24 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:24 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Acquiring lock "059d2d1e-75ba-4672-be7a-3d1ac186a609" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Acquiring lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:25 user nova-compute[75210]: INFO nova.compute.manager [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Terminating instance
Nov 29 01:39:25 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeaf527-083a-41fa-9481-0d5c451f1aa3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260]
Nov 29 01:39:25 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db4e555-9df5-4c80-98a3-54a8357afde9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG nova.compute.manager [req-56f84bcf-c705-491e-a85c-ab38933342e0 req-1e1e4240-fb15-4587-bfd7-8bc22a9c03a7 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-deleted-7a08bcf2-ad02-4ba4-8caf-a38790d8c493 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:25 user nova-compute[75210]: INFO nova.compute.manager [req-56f84bcf-c705-491e-a85c-ab38933342e0 req-1e1e4240-fb15-4587-bfd7-8bc22a9c03a7 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Neutron deleted interface 7a08bcf2-ad02-4ba4-8caf-a38790d8c493; detaching it from the instance and deleting it from the info cache
Nov 29 01:39:25 user nova-compute[75210]: DEBUG nova.network.neutron [req-56f84bcf-c705-491e-a85c-ab38933342e0 req-1e1e4240-fb15-4587-bfd7-8bc22a9c03a7 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [{"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "address": "fa:16:3e:f5:ee:b0", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88bd7a4-0e", "ovs_interfaceid": "d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5f0fe6-caac-49f0-96f2-70e346861110]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:25 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:25 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:25 user nova-compute[75210]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:25 user nova-compute[75210]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:25 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:25 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:25 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:25 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:25 user nova-compute[75210]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:25 user nova-compute[75210]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:25 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:25 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG nova.compute.manager [req-56f84bcf-c705-491e-a85c-ab38933342e0 req-1e1e4240-fb15-4587-bfd7-8bc22a9c03a7 service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Detach interface failed, port_id=7a08bcf2-ad02-4ba4-8caf-a38790d8c493, reason: Instance 061f89f7-91f0-4046-b5dc-b5ef7acfaf30 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0490d916-3fae-4ad3-9ba5-c276a51ba3bf]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vaeouFjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG nova.compute.manager [req-18d168fb-6329-4ad3-ab5b-ef61dc743067 req-0c0349b5-f331-462b-aa5e-c13ff2c1a57f service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Received event network-vif-unplugged-9a495ef6-de86-4b5d-ad22-9c627ae8505c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-18d168fb-6329-4ad3-ab5b-ef61dc743067 req-0c0349b5-f331-462b-aa5e-c13ff2c1a57f service nova] Acquiring lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-18d168fb-6329-4ad3-ab5b-ef61dc743067 req-0c0349b5-f331-462b-aa5e-c13ff2c1a57f service nova] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-18d168fb-6329-4ad3-ab5b-ef61dc743067 req-0c0349b5-f331-462b-aa5e-c13ff2c1a57f service nova] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG nova.compute.manager [req-18d168fb-6329-4ad3-ab5b-ef61dc743067 req-0c0349b5-f331-462b-aa5e-c13ff2c1a57f service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] No waiting events found dispatching network-vif-unplugged-9a495ef6-de86-4b5d-ad22-9c627ae8505c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG nova.compute.manager [req-18d168fb-6329-4ad3-ab5b-ef61dc743067 req-0c0349b5-f331-462b-aa5e-c13ff2c1a57f service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Received event network-vif-unplugged-9a495ef6-de86-4b5d-ad22-9c627ae8505c for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:25 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Instance destroyed successfully.
Nov 29 01:39:25 user nova-compute[75210]: DEBUG nova.objects.instance [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lazy-loading 'resources' on Instance uuid 059d2d1e-75ba-4672-be7a-3d1ac186a609 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:37:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2015942200',display_name='tempest-VolumesActionsTest-instance-2015942200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2015942200',id=9,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:37:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3256c43b9ae54d2cb4069d76f24e56b1',ramdisk_id='',reservation_id='r-9lbbvfcf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-876555301',owner_user_name='tempest-VolumesActionsTest-876555301-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:37:28Z,user_data=None,user_id='234b019000e241e3b0f80000d7f2eb11',uuid=059d2d1e-75ba-4672-be7a-3d1ac186a609,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "address": "fa:16:3e:f2:52:55", "network": {"id": "1c2fd584-5b23-4e0e-9ea7-5de99891edc7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1025036948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3256c43b9ae54d2cb4069d76f24e56b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a495ef6-de", "ovs_interfaceid": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Converting VIF {"id": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "address": "fa:16:3e:f2:52:55", "network": {"id": "1c2fd584-5b23-4e0e-9ea7-5de99891edc7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1025036948-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3256c43b9ae54d2cb4069d76f24e56b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a495ef6-de", "ovs_interfaceid": "9a495ef6-de86-4b5d-ad22-9c627ae8505c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:52:55,bridge_name='br-int',has_traffic_filtering=True,id=9a495ef6-de86-4b5d-ad22-9c627ae8505c,network=Network(1c2fd584-5b23-4e0e-9ea7-5de99891edc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a495ef6-de') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG os_vif [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:52:55,bridge_name='br-int',has_traffic_filtering=True,id=9a495ef6-de86-4b5d-ad22-9c627ae8505c,network=Network(1c2fd584-5b23-4e0e-9ea7-5de99891edc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a495ef6-de') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a495ef6-de, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fc17a6e-8aa6-4632-a89f-fa728892f73b) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:25 user nova-compute[75210]: INFO os_vif [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:52:55,bridge_name='br-int',has_traffic_filtering=True,id=9a495ef6-de86-4b5d-ad22-9c627ae8505c,network=Network(1c2fd584-5b23-4e0e-9ea7-5de99891edc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a495ef6-de')
Nov 29 01:39:25 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Deleting instance files /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609_del
Nov 29 01:39:25 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Deletion of /opt/stack/data/nova/instances/059d2d1e-75ba-4672-be7a-3d1ac186a609_del complete
Nov 29 01:39:25 user nova-compute[75210]: INFO nova.compute.manager [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 01:39:25 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:39:25 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:39:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23433313937623333', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433313937623333', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:39:26 user nova-compute[75210]: DEBUG nova.objects.instance [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lazy-loading 'flavor' on Instance uuid 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:26 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:26 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Took 1.04 seconds to deallocate network for instance.
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-a764f0f9-ff52-4210-a0ff-d6394e62df5a req-29ed0c0d-5fef-43ed-9dc3-d3c63a6d57b7 service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Received event network-vif-deleted-9a495ef6-de86-4b5d-ad22-9c627ae8505c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-f623d665-82eb-4952-b418-e0fbc2e20eae req-040739bf-b6c1-4569-ae1d-29e5e6e422ab service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-deleted-d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:27 user nova-compute[75210]: INFO nova.compute.manager [req-f623d665-82eb-4952-b418-e0fbc2e20eae req-040739bf-b6c1-4569-ae1d-29e5e6e422ab service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Neutron deleted interface d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba; detaching it from the instance and deleting it from the info cache
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.network.neutron [req-f623d665-82eb-4952-b418-e0fbc2e20eae req-040739bf-b6c1-4569-ae1d-29e5e6e422ab service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [{"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e7ea6535-38e6-4481-b759-db9710f14ccb", "address": "fa:16:3e:74:35:33", "network": {"id": "994e9d22-1cdb-4752-9692-b6ebb0bcd006", "bridge": "br-int", "label": "tempest-device-tagging-net2-609883254", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7ea6535-38", "ovs_interfaceid": "e7ea6535-38e6-4481-b759-db9710f14ccb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-f623d665-82eb-4952-b418-e0fbc2e20eae req-040739bf-b6c1-4569-ae1d-29e5e6e422ab service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Detach interface failed, port_id=d88bd7a4-0ef0-4508-a2f4-9fc0af9abdba, reason: Instance 061f89f7-91f0-4046-b5dc-b5ef7acfaf30 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-f623d665-82eb-4952-b418-e0fbc2e20eae req-040739bf-b6c1-4569-ae1d-29e5e6e422ab service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-deleted-e7ea6535-38e6-4481-b759-db9710f14ccb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:27 user nova-compute[75210]: INFO nova.compute.manager [req-f623d665-82eb-4952-b418-e0fbc2e20eae req-040739bf-b6c1-4569-ae1d-29e5e6e422ab service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Neutron deleted interface e7ea6535-38e6-4481-b759-db9710f14ccb; detaching it from the instance and deleting it from the info cache
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.network.neutron [req-f623d665-82eb-4952-b418-e0fbc2e20eae req-040739bf-b6c1-4569-ae1d-29e5e6e422ab service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [{"id": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "address": "fa:16:3e:c5:85:c8", "network": {"id": "f1e9724b-5ea5-47c8-84e7-7cc6a123c702", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-34112813-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b667a4-01", "ovs_interfaceid": "f3b667a4-01d3-4aee-a486-30b1ca2d868d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 85983232 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-f623d665-82eb-4952-b418-e0fbc2e20eae req-040739bf-b6c1-4569-ae1d-29e5e6e422ab service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Detach interface failed, port_id=e7ea6535-38e6-4481-b759-db9710f14ccb, reason: Instance 061f89f7-91f0-4046-b5dc-b5ef7acfaf30 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-f623d665-82eb-4952-b418-e0fbc2e20eae req-040739bf-b6c1-4569-ae1d-29e5e6e422ab service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-deleted-f3b667a4-01d3-4aee-a486-30b1ca2d868d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:27 user nova-compute[75210]: INFO nova.compute.manager [req-f623d665-82eb-4952-b418-e0fbc2e20eae req-040739bf-b6c1-4569-ae1d-29e5e6e422ab service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Neutron deleted interface f3b667a4-01d3-4aee-a486-30b1ca2d868d; detaching it from the instance and deleting it from the info cache
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.network.neutron [req-f623d665-82eb-4952-b418-e0fbc2e20eae req-040739bf-b6c1-4569-ae1d-29e5e6e422ab service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [{"id": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "address": "fa:16:3e:63:31:ab", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5881b8e-63", "ovs_interfaceid": "c5881b8e-634d-4969-8e69-b5e3e65adc3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "address": "fa:16:3e:15:a2:05", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518be547-e0", "ovs_interfaceid": "518be547-e0f3-44c9-9cf6-83fa8f7a2a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d450923-2a6b-4299-9be1-0af909115502", "address": "fa:16:3e:96:1c:51", "network": {"id": "d995c657-648b-450d-92e3-41b7520c9481", "bridge": "br-int", "label": "tempest-device-tagging-net1-1727194139", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d274f767ed724eb2927863bcfc0ecfc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d450923-2a", "ovs_interfaceid": "2d450923-2a6b-4299-9be1-0af909115502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-f623d665-82eb-4952-b418-e0fbc2e20eae req-040739bf-b6c1-4569-ae1d-29e5e6e422ab service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Detach interface failed, port_id=f3b667a4-01d3-4aee-a486-30b1ca2d868d, reason: Instance 061f89f7-91f0-4046-b5dc-b5ef7acfaf30 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-0d6bd54a-5ccb-47fa-874d-fcf8c4d2fdb9 req-b37a3622-fe7b-47b9-8215-4aab5e91a0d0 service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Received event network-vif-plugged-9a495ef6-de86-4b5d-ad22-9c627ae8505c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0d6bd54a-5ccb-47fa-874d-fcf8c4d2fdb9 req-b37a3622-fe7b-47b9-8215-4aab5e91a0d0 service nova] Acquiring lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0d6bd54a-5ccb-47fa-874d-fcf8c4d2fdb9 req-b37a3622-fe7b-47b9-8215-4aab5e91a0d0 service nova] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0d6bd54a-5ccb-47fa-874d-fcf8c4d2fdb9 req-b37a3622-fe7b-47b9-8215-4aab5e91a0d0 service nova] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-0d6bd54a-5ccb-47fa-874d-fcf8c4d2fdb9 req-b37a3622-fe7b-47b9-8215-4aab5e91a0d0 service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] No waiting events found dispatching network-vif-plugged-9a495ef6-de86-4b5d-ad22-9c627ae8505c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:27 user nova-compute[75210]: WARNING nova.compute.manager [req-0d6bd54a-5ccb-47fa-874d-fcf8c4d2fdb9 req-b37a3622-fe7b-47b9-8215-4aab5e91a0d0 service nova] [instance: 059d2d1e-75ba-4672-be7a-3d1ac186a609] Received unexpected event network-vif-plugged-9a495ef6-de86-4b5d-ad22-9c627ae8505c for instance with vm_state deleted and task_state None.
Nov 29 01:39:27 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Took 4.29 seconds to deallocate network for instance.
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:39:27 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance fff9790b-6b08-43f9-8a71-577e9f1bf04c is timed out.
Nov 29 01:39:27 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Successfully detached device sdc from instance fff9790b-6b08-43f9-8a71-577e9f1bf04c from the live domain config.
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDGitqsp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:27 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[025fb59b-0817-4224-a995-2f42248e6d9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:39:27 user nova-compute[75210]: No targets found.
Nov 29 01:39:27 user nova-compute[75210]: iSNS:
Nov 29 01:39:27 user nova-compute[75210]: No targets found.
Nov 29 01:39:27 user nova-compute[75210]: STATIC:
Nov 29 01:39:27 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:39:27 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:27 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:27 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb
Nov 29 01:39:27 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:27 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:27 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42
Nov 29 01:39:27 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:27 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:27 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a
Nov 29 01:39:27 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:27 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:27 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0
Nov 29 01:39:27 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:27 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:27 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27
Nov 29 01:39:27 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:27 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:27 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc
Nov 29 01:39:27 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:27 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:27 user nova-compute[75210]: FIRMWARE:
Nov 29 01:39:27 user nova-compute[75210]: No targets found.
Nov 29 01:39:27 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:39:27 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:39:27 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fc37d8-d819-467b-b29a-7015a3bbab89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea4a35b-fe4b-4f0d-ade6-84235b44f9ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:27 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:27 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:27 user nova-compute[75210]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:27 user nova-compute[75210]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:27 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:27 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:27 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:27 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:27 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:27 user nova-compute[75210]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:27 user nova-compute[75210]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:27 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:27 user nova-compute[75210]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 (non-flash)
Nov 29 01:39:27 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e85268c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27'): ({'sdi'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Removing single pathed devices sdi {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 146800640 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.625s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1245f4ea-f3ef-4153-84e3-b09292d29876]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e088c9-aa76-4793-a858-1f099998b7d3]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Flushing IO for device /dev/sdi {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:27 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Deleted allocations for instance 059d2d1e-75ba-4672-be7a-3d1ac186a609
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcafc60e-4664-47c0-9167-56841cb79083]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.048s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6644ef59-f8b8-4a4c-88f7-a289ee29d417]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] SCSI volumes sdi have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d45c1ca-31fd-494f-a00f-8bcac5b25247]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e18dbdd9-8aa2-4704-b186-4378d74990ee tempest-VolumesActionsTest-876555301 tempest-VolumesActionsTest-876555301-project-member] Lock "059d2d1e-75ba-4672-be7a-3d1ac186a609" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.915s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec0fff3-33ab-4e0e-b433-5c9e4f207e6d]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27, portal: 172.16.0.220,3260]
Nov 29 01:39:27 user nova-compute[75210]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:27 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60116b9c-ddca-4d23-bf8c-a64878d0dc27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3fade6-e696-4d57-80e9-b6e545190540]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] <== disconnect_volume: return (353ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:39:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 206569472 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 258998272 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:29 user nova-compute[75210]: DEBUG nova.compute.manager [req-27b5a4dd-ac73-48c5-a467-489e6a93757d req-1e084787-e359-4509-9962-1435a7bd43cd service nova] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Received event network-vif-deleted-2d450923-2a6b-4299-9be1-0af909115502 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 304087040 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:29 user nova-compute[75210]: DEBUG nova.objects.instance [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lazy-loading 'flavor' on Instance uuid fff9790b-6b08-43f9-8a71-577e9f1bf04c {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-14ef70d2-8fe4-432b-8ed6-57e9dcc2f25a tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.463s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 356515840 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 397410304 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:30 user nova-compute[75210]: INFO nova.compute.manager [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Terminating instance
Nov 29 01:39:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:39:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 432013312 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-005dc5c1-996a-46e1-934c-4f877d49fc55 req-aed7fb30-88d6-42ec-898c-a2447824f8f8 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Received event network-vif-unplugged-a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-005dc5c1-996a-46e1-934c-4f877d49fc55 req-aed7fb30-88d6-42ec-898c-a2447824f8f8 service nova] Acquiring lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-005dc5c1-996a-46e1-934c-4f877d49fc55 req-aed7fb30-88d6-42ec-898c-a2447824f8f8 service nova] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-005dc5c1-996a-46e1-934c-4f877d49fc55 req-aed7fb30-88d6-42ec-898c-a2447824f8f8 service nova] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-005dc5c1-996a-46e1-934c-4f877d49fc55 req-aed7fb30-88d6-42ec-898c-a2447824f8f8 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] No waiting events found dispatching network-vif-unplugged-a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-005dc5c1-996a-46e1-934c-4f877d49fc55 req-aed7fb30-88d6-42ec-898c-a2447824f8f8 service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Received event network-vif-unplugged-a997a159-ff47-43b7-8aac-104013bc4db3 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 569376768 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:31 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Instance destroyed successfully.
Nov 29 01:39:31 user nova-compute[75210]: DEBUG nova.objects.instance [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lazy-loading 'resources' on Instance uuid fff9790b-6b08-43f9-8a71-577e9f1bf04c {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-326911359',display_name='tempest-AttachSCSIVolumeTestJSON-server-326911359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-326911359',id=5,image_ref='81ed5433-d1d5-4122-98bd-e514cef509b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2JmJWyjNgeYuVAuu+BrREwnKnjcO2boWE/fkfGL//2RktkhREIpUCSdfmGv5pyvtTl6gCyspkZ68bgvgTG7IHBilYv0p8kdbTuoCqpvOw/Wpnij9d3/C5cPgtJBzf3YQ==',key_name='tempest-keypair-169331701',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:37:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f485dbe16514b79afba40741584e0eb',ramdisk_id='',reservation_id='r-4zufkff3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='81ed5433-d1d5-4122-98bd-e514cef509b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1912120829',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1912120829-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:37:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4403a299971f4f6d9135bb92daa308e9',uuid=fff9790b-6b08-43f9-8a71-577e9f1bf04c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a997a159-ff47-43b7-8aac-104013bc4db3", "address": "fa:16:3e:31:67:14", "network": {"id": "a9818bde-1a8a-4799-abfb-1a4c20f0a05f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-814349716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f485dbe16514b79afba40741584e0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa997a159-ff", "ovs_interfaceid": "a997a159-ff47-43b7-8aac-104013bc4db3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Converting VIF {"id": "a997a159-ff47-43b7-8aac-104013bc4db3", "address": "fa:16:3e:31:67:14", "network": {"id": "a9818bde-1a8a-4799-abfb-1a4c20f0a05f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-814349716-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f485dbe16514b79afba40741584e0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa997a159-ff", "ovs_interfaceid": "a997a159-ff47-43b7-8aac-104013bc4db3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:67:14,bridge_name='br-int',has_traffic_filtering=True,id=a997a159-ff47-43b7-8aac-104013bc4db3,network=Network(a9818bde-1a8a-4799-abfb-1a4c20f0a05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa997a159-ff') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG os_vif [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:67:14,bridge_name='br-int',has_traffic_filtering=True,id=a997a159-ff47-43b7-8aac-104013bc4db3,network=Network(a9818bde-1a8a-4799-abfb-1a4c20f0a05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa997a159-ff') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa997a159-ff, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7101ef6b-9ea8-479e-b8d5-f16e6e700ae4) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:31 user nova-compute[75210]: INFO os_vif [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:67:14,bridge_name='br-int',has_traffic_filtering=True,id=a997a159-ff47-43b7-8aac-104013bc4db3,network=Network(a9818bde-1a8a-4799-abfb-1a4c20f0a05f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa997a159-ff')
Nov 29 01:39:31 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Deleting instance files /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c_del
Nov 29 01:39:31 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Deletion of /opt/stack/data/nova/instances/fff9790b-6b08-43f9-8a71-577e9f1bf04c_del complete
Nov 29 01:39:31 user nova-compute[75210]: INFO nova.compute.manager [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 29 01:39:31 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:39:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 600834048 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 667942912 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:32 user nova-compute[75210]: INFO nova.compute.manager [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] [instance: 061f89f7-91f0-4046-b5dc-b5ef7acfaf30] Took 5.02 seconds to detach 3 volumes for instance.
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 req-01edda3f-ea9a-4a34-a191-edff2957afbf service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received event volume-reimaged-9f315778-a694-4266-8fec-4d9cc29e76bb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 req-01edda3f-ea9a-4a34-a191-edff2957afbf service nova] Acquiring lock "10a92792-5f02-42e5-8012-a022fc717797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 req-01edda3f-ea9a-4a34-a191-edff2957afbf service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 req-01edda3f-ea9a-4a34-a191-edff2957afbf service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 req-01edda3f-ea9a-4a34-a191-edff2957afbf service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Processing event volume-reimaged-9f315778-a694-4266-8fec-4d9cc29e76bb {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-1082f813-9556-4eef-a0fc-b599105ae849 req-514415de-19e0-4186-8e6e-fa3b7f454bbd service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Received event network-vif-deleted-a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:32 user nova-compute[75210]: INFO nova.compute.manager [req-1082f813-9556-4eef-a0fc-b599105ae849 req-514415de-19e0-4186-8e6e-fa3b7f454bbd service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Neutron deleted interface a997a159-ff47-43b7-8aac-104013bc4db3; detaching it from the instance and deleting it from the info cache
Nov 29 01:39:32 user nova-compute[75210]: DEBUG nova.network.neutron [req-1082f813-9556-4eef-a0fc-b599105ae849 req-514415de-19e0-4186-8e6e-fa3b7f454bbd service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:32 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Took 1.17 seconds to deallocate network for instance.
Nov 29 01:39:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-1082f813-9556-4eef-a0fc-b599105ae849 req-514415de-19e0-4186-8e6e-fa3b7f454bbd service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Detach interface failed, port_id=a997a159-ff47-43b7-8aac-104013bc4db3, reason: Instance fff9790b-6b08-43f9-8a71-577e9f1bf04c could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:39:32 user nova-compute[75210]: INFO nova.virt.block_device [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Booting with volume 9f315778-a694-4266-8fec-4d9cc29e76bb at /dev/vda
Nov 29 01:39:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 833617920 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG os_brick.utils [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd438c09-ac00-45cb-a950-406ed456f968]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ffcc36-3616-496e-8f02-7fd9b1f6e119]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f30bb1a-3d01-46cb-8978-7f495290360e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f00a572-bc06-42b5-8b06-694811250406]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:39:33 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f277bf-6782-428c-b023-1eb50b41521d]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.utils [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Updating existing volume attachment record: 329a2a2b-fd32-4a4e-9e17-dc6ce9a0fb74 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:39:33 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 is timed out.
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.compute.manager [req-d1a23efa-f416-411d-9de9-f77ff459390c req-46797a69-beec-4e2b-bed8-dbbf7ac0f0fc service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Received event network-vif-plugged-a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d1a23efa-f416-411d-9de9-f77ff459390c req-46797a69-beec-4e2b-bed8-dbbf7ac0f0fc service nova] Acquiring lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d1a23efa-f416-411d-9de9-f77ff459390c req-46797a69-beec-4e2b-bed8-dbbf7ac0f0fc service nova] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d1a23efa-f416-411d-9de9-f77ff459390c req-46797a69-beec-4e2b-bed8-dbbf7ac0f0fc service nova] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.compute.manager [req-d1a23efa-f416-411d-9de9-f77ff459390c req-46797a69-beec-4e2b-bed8-dbbf7ac0f0fc service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] No waiting events found dispatching network-vif-plugged-a997a159-ff47-43b7-8aac-104013bc4db3 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:33 user nova-compute[75210]: WARNING nova.compute.manager [req-d1a23efa-f416-411d-9de9-f77ff459390c req-46797a69-beec-4e2b-bed8-dbbf7ac0f0fc service nova] [instance: fff9790b-6b08-43f9-8a71-577e9f1bf04c] Received unexpected event network-vif-plugged-a997a159-ff47-43b7-8aac-104013bc4db3 for instance with vm_state deleted and task_state None.
Nov 29 01:39:33 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Successfully detached device vdb from instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 from the live domain config.
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWVRrJfO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:33 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b31b0d-06f4-4009-b278-05ecd8e036f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:39:33 user nova-compute[75210]: No targets found.
Nov 29 01:39:33 user nova-compute[75210]: iSNS:
Nov 29 01:39:33 user nova-compute[75210]: No targets found.
Nov 29 01:39:33 user nova-compute[75210]: STATIC:
Nov 29 01:39:33 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:39:33 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:33 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:33 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42
Nov 29 01:39:33 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:33 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:33 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a
Nov 29 01:39:33 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:33 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:33 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0
Nov 29 01:39:33 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:33 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:33 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc
Nov 29 01:39:33 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:33 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:33 user nova-compute[75210]: FIRMWARE:
Nov 29 01:39:33 user nova-compute[75210]: No targets found.
Nov 29 01:39:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:39:33 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:39:33 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb5845e-e488-4cf9-9bcc-cd3831236571]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6f18b9-1594-4345-875c-71cc26455cdb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f240813dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42'): ({'sdj'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Removing single pathed devices sdj {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 990904320 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.706s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40870fe-cdec-4f26-b762-5bad1dfb0f03]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.528s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[198934e0-5773-4dc1-b72d-42ba2f7dd2c9]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Flushing IO for device /dev/sdj {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Deleted allocations for instance 061f89f7-91f0-4046-b5dc-b5ef7acfaf30
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99b77d2-5606-4e40-889c-b5e7544c5156]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.042s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45d3a0b-511f-470e-a495-c22d232bcf1b]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] SCSI volumes sdj have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a67921-8d62-4ba0-b647-bb36c34a147a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c8c0c1d8-5241-4204-87f2-c9c20618bb86 is timed out.
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Successfully detached device vdb from instance c8c0c1d8-5241-4204-87f2-c9c20618bb86 from the live domain config.
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[98364576-0e4d-4a05-a522-6a0282cf6ada]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42, portal: 172.16.0.220,3260]
Nov 29 01:39:33 user nova-compute[75210]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfanMEGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:33 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-110b0638-0de4-4d8d-87c0-44b9a1754c17 tempest-TaggedBootDevicesTest_v242-1709736932 tempest-TaggedBootDevicesTest_v242-1709736932-project-member] Lock "061f89f7-91f0-4046-b5dc-b5ef7acfaf30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.853s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:889b6f62-4cd3-418c-afb8-cbf3c3d04e42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[46517dc8-9565-4eb9-a3a4-16fe9447a5f4]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.466s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] <== disconnect_volume: return (468ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.034s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d16a15-e1d1-4632-ab12-f66783edcdd8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:39:33 user nova-compute[75210]: No targets found.
Nov 29 01:39:33 user nova-compute[75210]: iSNS:
Nov 29 01:39:33 user nova-compute[75210]: No targets found.
Nov 29 01:39:33 user nova-compute[75210]: STATIC:
Nov 29 01:39:33 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:39:33 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:33 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:33 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a
Nov 29 01:39:33 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:33 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:33 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0
Nov 29 01:39:33 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:33 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:33 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc
Nov 29 01:39:33 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:33 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:33 user nova-compute[75210]: FIRMWARE:
Nov 29 01:39:33 user nova-compute[75210]: No targets found.
Nov 29 01:39:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:39:33 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:39:33 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3125f43-a335-41cc-a1b8-77de93312445]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c04ae3a-2454-49a7-9a0c-779a8d387737]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:33 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f096c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0'): ({'sdk'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Removing single pathed devices sdk {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f98a20a-a143-4144-9648-658228f694d1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a342944-1ac4-4675-aea6-27def5186049]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Flushing IO for device /dev/sdk {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af7e716-67a7-4a02-b279-0f8d6a9b69ec]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.032s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fb6604-ebc4-4559-bd7b-f79ac87b0c78]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] SCSI volumes sdk have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd38dd1-deaa-4c85-b8e0-3dde936db240]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[212e2e5e-ceca-476f-bbd6-d0f1215e9302]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0, portal: 172.16.0.220,3260]
Nov 29 01:39:33 user nova-compute[75210]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa37108f-04c4-4236-8abf-869a2b378bf0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9d8bb5-ca3a-42f7-b60c-dda35c53aa28]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] <== disconnect_volume: return (379ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.642s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncTuQgjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'cd6acc4a-acee-4240-bdf4-ea0411135bcc'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:33 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1a9c5f-e3e0-41ed-854d-1cc472e390de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:39:34 user nova-compute[75210]: No targets found.
Nov 29 01:39:34 user nova-compute[75210]: iSNS:
Nov 29 01:39:34 user nova-compute[75210]: No targets found.
Nov 29 01:39:34 user nova-compute[75210]: STATIC:
Nov 29 01:39:34 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:39:34 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:34 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:34 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a
Nov 29 01:39:34 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:34 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:34 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc
Nov 29 01:39:34 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:34 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:34 user nova-compute[75210]: FIRMWARE:
Nov 29 01:39:34 user nova-compute[75210]: No targets found.
Nov 29 01:39:34 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:39:34 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:39:34 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:34 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Deleted allocations for instance fff9790b-6b08-43f9-8a71-577e9f1bf04c
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe66e13-0d54-4366-ad55-ae5bcc105fd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf702ea-e641-4fbb-aace-d9617a43bdcd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:34 user nova-compute[75210]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:34 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:34 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc (non-flash)
Nov 29 01:39:34 user nova-compute[75210]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:34 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:34 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e820bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c6fc6f-6cdd-4d80-af9d-ac8140259c59]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1275709-cfc9-49c5-b3f7-437fedb9a579]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[36114887-e41e-4a60-9fed-9083eb5e5521]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-47985c91-e67c-46b6-89f6-b194ed120486 tempest-AttachSCSIVolumeTestJSON-1912120829 tempest-AttachSCSIVolumeTestJSON-1912120829-project-member] Lock "fff9790b-6b08-43f9-8a71-577e9f1bf04c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.619s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[187091d0-73a3-49e0-9a44-8919ab2899b3]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1447a903-bf21-40a0-b685-89468e4ea8cf]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed6ec8e-62d4-415a-a4ef-a6f8a96e2577]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc, portal: 172.16.0.220,3260]
Nov 29 01:39:34 user nova-compute[75210]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:34 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd6acc4a-acee-4240-bdf4-ea0411135bcc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7731ee6-c6f4-4615-a77c-2b66ffe2e7b7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] <== disconnect_volume: return (321ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG nova.objects.instance [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lazy-loading 'flavor' on Instance uuid 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e128a885-ce94-47e5-b924-2260f217053b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.521s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "interface-0d7f5bf7-edc1-465f-b24f-171d1481ffa0-181af4a1-3952-4c3c-b58c-c87a89a63bab" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "interface-0d7f5bf7-edc1-465f-b24f-171d1481ffa0-181af4a1-3952-4c3c-b58c-c87a89a63bab" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG nova.compute.manager [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vaeouFjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6cb707b0-aa06-42ee-abd8-f18d01c7cef9', 'attached_at': '', 'detached_at': '', 'volume_id': '9fa865ad-bd63-404e-a923-56fa76acb88a', 'serial'} {{(pid=75210) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG nova.compute.manager [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] swap_volume: removing Cinder connection for volume cd6acc4a-acee-4240-bdf4-ea0411135bcc {{(pid=75210) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 29 01:39:34 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lazy-loading 'flavor' on Instance uuid 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:36:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906023654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906023654',id=6,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmtm9Y/rL28hHvUP7150cqzO8TBgS/8Pwq7X/7Gtilm5Sd870B/ZK7bsEtY2wPDo+rNSG8X+Tp2Avrz3QbtDNgCJe0acCKnqRj8bkYwO8r/0na0wbSxh0PaL89RzsH/pA==',key_name='tempest-keypair-1039804411',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08d017f83b2449c18c70e3dbed78af01',ramdisk_id='',reservation_id='r-c01u2q0f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1153284446',owner_user_name='tempest-TaggedAttachmentsTest-1153284446-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413fdbcc401e4fd99a537e93fea9eaa4',uuid=0d7f5bf7-edc1-465f-b24f-171d1481ffa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converting VIF {"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:df,bridge_name='br-int',has_traffic_filtering=True,id=181af4a1-3952-4c3c-b58c-c87a89a63bab,network=Network(28cea21a-f823-40a9-8d9c-4bcbf5829b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181af4a1-39') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:09:df"/><model type="virtio"/><mtu size="1442"/><target dev="tap181af4a1-39"/></interface> {{(pid=75210) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:09:df"/><model type="virtio"/><mtu size="1442"/><target dev="tap181af4a1-39"/></interface> {{(pid=75210) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Attempting to detach device tap181af4a1-39 from instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] detach device xml: <interface type="ethernet">
Nov 29 01:39:35 user nova-compute[75210]:   <mac address="fa:16:3e:f0:09:df"/>
Nov 29 01:39:35 user nova-compute[75210]:   <model type="virtio"/>
Nov 29 01:39:35 user nova-compute[75210]:   <mtu size="1442"/>
Nov 29 01:39:35 user nova-compute[75210]:   <target dev="tap181af4a1-39"/>
Nov 29 01:39:35 user nova-compute[75210]: </interface>
Nov 29 01:39:35 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:09:df"/><model type="virtio"/><mtu size="1442"/><target dev="tap181af4a1-39"/></interface> {{(pid=75210) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f0:09:df"/><model type="virtio"/><mtu size="1442"/><target dev="tap181af4a1-39"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 29 01:39:35 user nova-compute[75210]:   <name>instance-00000006</name>
Nov 29 01:39:35 user nova-compute[75210]:   <uuid>0d7f5bf7-edc1-465f-b24f-171d1481ffa0</uuid>
Nov 29 01:39:35 user nova-compute[75210]:   <metadata>
Nov 29 01:39:35 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:39:35 user nova-compute[75210]:   <nova:package version="0.0.0"/>
Nov 29 01:39:35 user nova-compute[75210]:   <nova:name>tempest-device-tagging-server-1906023654</nova:name>
Nov 29 01:39:35 user nova-compute[75210]:   <nova:creationTime>2023-11-29 01:38:49</nova:creationTime>
Nov 29 01:39:35 user nova-compute[75210]:   <nova:flavor name="m1.tiny">
Nov 29 01:39:35 user nova-compute[75210]:     <nova:memory>512</nova:memory>
Nov 29 01:39:35 user nova-compute[75210]:     <nova:disk>1</nova:disk>
Nov 29 01:39:35 user nova-compute[75210]:     <nova:swap>0</nova:swap>
Nov 29 01:39:35 user nova-compute[75210]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:39:35 user nova-compute[75210]:     <nova:vcpus>1</nova:vcpus>
Nov 29 01:39:35 user nova-compute[75210]:   </nova:flavor>
Nov 29 01:39:35 user nova-compute[75210]:   <nova:owner>
Nov 29 01:39:35 user nova-compute[75210]:     <nova:user uuid="413fdbcc401e4fd99a537e93fea9eaa4">tempest-TaggedAttachmentsTest-1153284446-project-member</nova:user>
Nov 29 01:39:35 user nova-compute[75210]:     <nova:project uuid="08d017f83b2449c18c70e3dbed78af01">tempest-TaggedAttachmentsTest-1153284446</nova:project>
Nov 29 01:39:35 user nova-compute[75210]:   </nova:owner>
Nov 29 01:39:35 user nova-compute[75210]:   <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:39:35 user nova-compute[75210]:   <nova:ports>
Nov 29 01:39:35 user nova-compute[75210]:     <nova:port uuid="bddbec43-276a-4a46-a083-2aa153ccd4db">
Nov 29 01:39:35 user nova-compute[75210]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:39:35 user nova-compute[75210]:     </nova:port>
Nov 29 01:39:35 user nova-compute[75210]:     <nova:port uuid="181af4a1-3952-4c3c-b58c-c87a89a63bab">
Nov 29 01:39:35 user nova-compute[75210]:       <nova:ip type="fixed" address="10.10.10.20" ipVersion="4"/>
Nov 29 01:39:35 user nova-compute[75210]:     </nova:port>
Nov 29 01:39:35 user nova-compute[75210]:   </nova:ports>
Nov 29 01:39:35 user nova-compute[75210]: </nova:instance>
Nov 29 01:39:35 user nova-compute[75210]:   </metadata>
Nov 29 01:39:35 user nova-compute[75210]:   <memory unit='KiB'>524288</memory>
Nov 29 01:39:35 user nova-compute[75210]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 01:39:35 user nova-compute[75210]:   <vcpu placement='static'>1</vcpu>
Nov 29 01:39:35 user nova-compute[75210]:   <resource>
Nov 29 01:39:35 user nova-compute[75210]:     <partition>/machine</partition>
Nov 29 01:39:35 user nova-compute[75210]:   </resource>
Nov 29 01:39:35 user nova-compute[75210]:   <sysinfo type='smbios'>
Nov 29 01:39:35 user nova-compute[75210]:     <system>
Nov 29 01:39:35 user nova-compute[75210]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 01:39:35 user nova-compute[75210]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 01:39:35 user nova-compute[75210]:       <entry name='version'>0.0.0</entry>
Nov 29 01:39:35 user nova-compute[75210]:       <entry name='serial'>0d7f5bf7-edc1-465f-b24f-171d1481ffa0</entry>
Nov 29 01:39:35 user nova-compute[75210]:       <entry name='uuid'>0d7f5bf7-edc1-465f-b24f-171d1481ffa0</entry>
Nov 29 01:39:35 user nova-compute[75210]:       <entry name='family'>Virtual Machine</entry>
Nov 29 01:39:35 user nova-compute[75210]:     </system>
Nov 29 01:39:35 user nova-compute[75210]:   </sysinfo>
Nov 29 01:39:35 user nova-compute[75210]:   <os>
Nov 29 01:39:35 user nova-compute[75210]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 01:39:35 user nova-compute[75210]:     <boot dev='hd'/>
Nov 29 01:39:35 user nova-compute[75210]:     <smbios mode='sysinfo'/>
Nov 29 01:39:35 user nova-compute[75210]:   </os>
Nov 29 01:39:35 user nova-compute[75210]:   <features>
Nov 29 01:39:35 user nova-compute[75210]:     <acpi/>
Nov 29 01:39:35 user nova-compute[75210]:     <apic/>
Nov 29 01:39:35 user nova-compute[75210]:     <vmcoreinfo state='on'/>
Nov 29 01:39:35 user nova-compute[75210]:   </features>
Nov 29 01:39:35 user nova-compute[75210]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 01:39:35 user nova-compute[75210]:     <model fallback='forbid'>Nehalem</model>
Nov 29 01:39:35 user nova-compute[75210]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 01:39:35 user nova-compute[75210]:     <feature policy='require' name='vme'/>
Nov 29 01:39:35 user nova-compute[75210]:     <feature policy='require' name='x2apic'/>
Nov 29 01:39:35 user nova-compute[75210]:     <feature policy='require' name='hypervisor'/>
Nov 29 01:39:35 user nova-compute[75210]:   </cpu>
Nov 29 01:39:35 user nova-compute[75210]:   <clock offset='utc'>
Nov 29 01:39:35 user nova-compute[75210]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 01:39:35 user nova-compute[75210]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 01:39:35 user nova-compute[75210]:     <timer name='hpet' present='no'/>
Nov 29 01:39:35 user nova-compute[75210]:   </clock>
Nov 29 01:39:35 user nova-compute[75210]:   <on_poweroff>destroy</on_poweroff>
Nov 29 01:39:35 user nova-compute[75210]:   <on_reboot>restart</on_reboot>
Nov 29 01:39:35 user nova-compute[75210]:   <on_crash>destroy</on_crash>
Nov 29 01:39:35 user nova-compute[75210]:   <devices>
Nov 29 01:39:35 user nova-compute[75210]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 01:39:35 user nova-compute[75210]:     <disk type='file' device='disk'>
Nov 29 01:39:35 user nova-compute[75210]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 01:39:35 user nova-compute[75210]:       <source file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk' index='2'/>
Nov 29 01:39:35 user nova-compute[75210]:       <backingStore type='file' index='3'>
Nov 29 01:39:35 user nova-compute[75210]:         <format type='raw'/>
Nov 29 01:39:35 user nova-compute[75210]:         <source file='/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8'/>
Nov 29 01:39:35 user nova-compute[75210]:         <backingStore/>
Nov 29 01:39:35 user nova-compute[75210]:       </backingStore>
Nov 29 01:39:35 user nova-compute[75210]:       <target dev='vda' bus='virtio'/>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='virtio-disk0'/>
Nov 29 01:39:35 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 01:39:35 user nova-compute[75210]:     </disk>
Nov 29 01:39:35 user nova-compute[75210]:     <disk type='file' device='cdrom'>
Nov 29 01:39:35 user nova-compute[75210]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 01:39:35 user nova-compute[75210]:       <source file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk.config' index='1'/>
Nov 29 01:39:35 user nova-compute[75210]:       <backingStore/>
Nov 29 01:39:35 user nova-compute[75210]:       <target dev='hda' bus='ide'/>
Nov 29 01:39:35 user nova-compute[75210]:       <readonly/>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='ide0-0-0'/>
Nov 29 01:39:35 user nova-compute[75210]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 01:39:35 user nova-compute[75210]:     </disk>
Nov 29 01:39:35 user nova-compute[75210]:     <controller type='usb' index='0' model='none'>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='usb'/>
Nov 29 01:39:35 user nova-compute[75210]:     </controller>
Nov 29 01:39:35 user nova-compute[75210]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='pci.0'/>
Nov 29 01:39:35 user nova-compute[75210]:     </controller>
Nov 29 01:39:35 user nova-compute[75210]:     <controller type='ide' index='0'>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='ide'/>
Nov 29 01:39:35 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 01:39:35 user nova-compute[75210]:     </controller>
Nov 29 01:39:35 user nova-compute[75210]:     <interface type='ethernet'>
Nov 29 01:39:35 user nova-compute[75210]:       <mac address='fa:16:3e:00:cd:81'/>
Nov 29 01:39:35 user nova-compute[75210]:       <target dev='tapbddbec43-27'/>
Nov 29 01:39:35 user nova-compute[75210]:       <model type='virtio'/>
Nov 29 01:39:35 user nova-compute[75210]:       <mtu size='1442'/>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='net0'/>
Nov 29 01:39:35 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 01:39:35 user nova-compute[75210]:     </interface>
Nov 29 01:39:35 user nova-compute[75210]:     <interface type='ethernet'>
Nov 29 01:39:35 user nova-compute[75210]:       <mac address='fa:16:3e:f0:09:df'/>
Nov 29 01:39:35 user nova-compute[75210]:       <target dev='tap181af4a1-39'/>
Nov 29 01:39:35 user nova-compute[75210]:       <model type='virtio'/>
Nov 29 01:39:35 user nova-compute[75210]:       <mtu size='1442'/>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='net1'/>
Nov 29 01:39:35 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 29 01:39:35 user nova-compute[75210]:     </interface>
Nov 29 01:39:35 user nova-compute[75210]:     <serial type='pty'>
Nov 29 01:39:35 user nova-compute[75210]:       <source path='/dev/pts/5'/>
Nov 29 01:39:35 user nova-compute[75210]:       <log file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/console.log' append='off'/>
Nov 29 01:39:35 user nova-compute[75210]:       <target type='isa-serial' port='0'>
Nov 29 01:39:35 user nova-compute[75210]:         <model name='isa-serial'/>
Nov 29 01:39:35 user nova-compute[75210]:       </target>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='serial0'/>
Nov 29 01:39:35 user nova-compute[75210]:     </serial>
Nov 29 01:39:35 user nova-compute[75210]:     <console type='pty' tty='/dev/pts/5'>
Nov 29 01:39:35 user nova-compute[75210]:       <source path='/dev/pts/5'/>
Nov 29 01:39:35 user nova-compute[75210]:       <log file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/console.log' append='off'/>
Nov 29 01:39:35 user nova-compute[75210]:       <target type='serial' port='0'/>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='serial0'/>
Nov 29 01:39:35 user nova-compute[75210]:     </console>
Nov 29 01:39:35 user nova-compute[75210]:     <input type='mouse' bus='ps2'>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='input0'/>
Nov 29 01:39:35 user nova-compute[75210]:     </input>
Nov 29 01:39:35 user nova-compute[75210]:     <input type='keyboard' bus='ps2'>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='input1'/>
Nov 29 01:39:35 user nova-compute[75210]:     </input>
Nov 29 01:39:35 user nova-compute[75210]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 29 01:39:35 user nova-compute[75210]:       <listen type='address' address='0.0.0.0'/>
Nov 29 01:39:35 user nova-compute[75210]:     </graphics>
Nov 29 01:39:35 user nova-compute[75210]:     <audio id='1' type='none'/>
Nov 29 01:39:35 user nova-compute[75210]:     <video>
Nov 29 01:39:35 user nova-compute[75210]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='video0'/>
Nov 29 01:39:35 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 01:39:35 user nova-compute[75210]:     </video>
Nov 29 01:39:35 user nova-compute[75210]:     <memballoon model='virtio'>
Nov 29 01:39:35 user nova-compute[75210]:       <stats period='10'/>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='balloon0'/>
Nov 29 01:39:35 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 01:39:35 user nova-compute[75210]:     </memballoon>
Nov 29 01:39:35 user nova-compute[75210]:     <rng model='virtio'>
Nov 29 01:39:35 user nova-compute[75210]:       <backend model='random'>/dev/urandom</backend>
Nov 29 01:39:35 user nova-compute[75210]:       <alias name='rng0'/>
Nov 29 01:39:35 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 01:39:35 user nova-compute[75210]:     </rng>
Nov 29 01:39:35 user nova-compute[75210]:   </devices>
Nov 29 01:39:35 user nova-compute[75210]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 01:39:35 user nova-compute[75210]:     <label>libvirt-0d7f5bf7-edc1-465f-b24f-171d1481ffa0</label>
Nov 29 01:39:35 user nova-compute[75210]:     <imagelabel>libvirt-0d7f5bf7-edc1-465f-b24f-171d1481ffa0</imagelabel>
Nov 29 01:39:35 user nova-compute[75210]:   </seclabel>
Nov 29 01:39:35 user nova-compute[75210]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 01:39:35 user nova-compute[75210]:     <label>+64055:+108</label>
Nov 29 01:39:35 user nova-compute[75210]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 01:39:35 user nova-compute[75210]:   </seclabel>
Nov 29 01:39:35 user nova-compute[75210]: </domain>
Nov 29 01:39:35 user nova-compute[75210]:  {{(pid=75210) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 01:39:35 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Successfully detached device tap181af4a1-39 from instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 from the persistent domain config.
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] (1/8): Attempting to detach device tap181af4a1-39 with device alias net1 from instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] detach device xml: <interface type="ethernet">
Nov 29 01:39:35 user nova-compute[75210]:   <mac address="fa:16:3e:f0:09:df"/>
Nov 29 01:39:35 user nova-compute[75210]:   <model type="virtio"/>
Nov 29 01:39:35 user nova-compute[75210]:   <mtu size="1442"/>
Nov 29 01:39:35 user nova-compute[75210]:   <target dev="tap181af4a1-39"/>
Nov 29 01:39:35 user nova-compute[75210]: </interface>
Nov 29 01:39:35 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.objects.instance [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lazy-loading 'flavor' on Instance uuid c8c0c1d8-5241-4204-87f2-c9c20618bb86 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-adf458a2-35fc-462e-bd61-c1f997fce58f tempest-VolumesAssistedSnapshotsTest-441802585 tempest-VolumesAssistedSnapshotsTest-441802585-project-admin] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.146s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Start waiting for the detach event from libvirt for device tap181af4a1-39 with device alias net1 for instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-c694085d-2314-4ad9-9b84-19cc76500815 req-262191d4-f40c-4088-a1b3-31a13ba08a73 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-vif-unplugged-181af4a1-3952-4c3c-b58c-c87a89a63bab {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c694085d-2314-4ad9-9b84-19cc76500815 req-262191d4-f40c-4088-a1b3-31a13ba08a73 service nova] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c694085d-2314-4ad9-9b84-19cc76500815 req-262191d4-f40c-4088-a1b3-31a13ba08a73 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c694085d-2314-4ad9-9b84-19cc76500815 req-262191d4-f40c-4088-a1b3-31a13ba08a73 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-c694085d-2314-4ad9-9b84-19cc76500815 req-262191d4-f40c-4088-a1b3-31a13ba08a73 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] No waiting events found dispatching network-vif-unplugged-181af4a1-3952-4c3c-b58c-c87a89a63bab {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:35 user nova-compute[75210]: WARNING nova.compute.manager [req-c694085d-2314-4ad9-9b84-19cc76500815 req-262191d4-f40c-4088-a1b3-31a13ba08a73 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received unexpected event network-vif-unplugged-181af4a1-3952-4c3c-b58c-c87a89a63bab for instance with vm_state active and task_state None.
Nov 29 01:39:35 user nova-compute[75210]: DEBUG nova.compute.manager [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] swap_volume: Updating volume cd6acc4a-acee-4240-bdf4-ea0411135bcc BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "vaeouFjO", "auth_password": "KRFQ17wdkiTAm6", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "9fa865ad-bd63-404e-a923-56fa76acb88a"}, "status": "reserved", "instance": "6cb707b0-aa06-42ee-abd8-f18d01c7cef9", "attached_at": "", "detached_at": "", "volume_id": "9fa865ad-bd63-404e-a923-56fa76acb88a", "serial": "9fa865ad-bd63-404e-a923-56fa76acb88a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9fa865ad-bd63-404e-a923-56fa76acb88a', 'no_device': None, 'attachment_id': 'daf18ea6-dc3e-43df-86d7-a6ad136e8910'} {{(pid=75210) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 29 01:39:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99c59445-048f-4c75-bd78-83addb1469bb tempest-TestVolumeSwap-1963473742 tempest-TestVolumeSwap-1963473742-project-admin] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.179s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:36 user nova-compute[75210]: INFO nova.compute.manager [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Detaching volume 9fa865ad-bd63-404e-a923-56fa76acb88a
Nov 29 01:39:36 user nova-compute[75210]: INFO nova.virt.block_device [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Attempting to driver detach volume 9fa865ad-bd63-404e-a923-56fa76acb88a from mountpoint /dev/vdb
Nov 29 01:39:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Attempting to detach device vdb from instance 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:39:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:39:36 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:39:36 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:39:36 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:39:36 user nova-compute[75210]:   <serial>9fa865ad-bd63-404e-a923-56fa76acb88a</serial>
Nov 29 01:39:36 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:39:36 user nova-compute[75210]: </disk>
Nov 29 01:39:36 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:39:36 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Successfully detached device vdb from instance 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 from the persistent domain config.
Nov 29 01:39:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:39:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:39:36 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:39:36 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:39:36 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:39:36 user nova-compute[75210]:   <serial>9fa865ad-bd63-404e-a923-56fa76acb88a</serial>
Nov 29 01:39:36 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:39:36 user nova-compute[75210]: </disk>
Nov 29 01:39:36 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:39:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:39:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-cc64fcef-7436-4ad0-b91e-58657631b742 req-04283c4b-1096-4301-a7c4-82a584245398 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-vif-plugged-181af4a1-3952-4c3c-b58c-c87a89a63bab {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cc64fcef-7436-4ad0-b91e-58657631b742 req-04283c4b-1096-4301-a7c4-82a584245398 service nova] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cc64fcef-7436-4ad0-b91e-58657631b742 req-04283c4b-1096-4301-a7c4-82a584245398 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cc64fcef-7436-4ad0-b91e-58657631b742 req-04283c4b-1096-4301-a7c4-82a584245398 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-cc64fcef-7436-4ad0-b91e-58657631b742 req-04283c4b-1096-4301-a7c4-82a584245398 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] No waiting events found dispatching network-vif-plugged-181af4a1-3952-4c3c-b58c-c87a89a63bab {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:37 user nova-compute[75210]: WARNING nova.compute.manager [req-cc64fcef-7436-4ad0-b91e-58657631b742 req-04283c4b-1096-4301-a7c4-82a584245398 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received unexpected event network-vif-plugged-181af4a1-3952-4c3c-b58c-c87a89a63bab for instance with vm_state active and task_state None.
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:39:40 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Creating image(s)
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Ensure instance console log exists: /opt/stack/data/nova/instances/10a92792-5f02-42e5-8012-a022fc717797/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Start _get_guest_xml network_info=[{"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': '329a2a2b-fd32-4a4e-9e17-dc6ce9a0fb74', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUIVBpEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10a92792-5f02-42e5-8012-a022fc717797', 'attached_at': '', 'detached_at': '', 'volume_id': '9f315778-a694-4266-8fec-4d9cc29e76bb', 'serial': '9f315778-a694-4266-8fec-4d9cc29e76bb'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:39:40 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 01:39:40 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.objects.instance [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lazy-loading 'vcpu_model' on Instance uuid 10a92792-5f02-42e5-8012-a022fc717797 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUIVBpEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:40 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:40 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:40 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf356060-88f4-4824-9fea-364e32abeb16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:39:40 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[06756150-4fa4-4886-86ea-fb5cb35b51c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb] added
Nov 29 01:39:40 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f47be9-43f6-40a1-b03f-50e3a5d31778]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8ee54d-9515-4460-9751-be3e65e77dfc]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUIVBpEv {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUIVBpEv" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f68e1a-51aa-462a-a779-97115b63431b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AUIVBpEv'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[356836c1-001f-42ad-9523-8ec7998e967b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ec2a99-fa51-44ea-a315-c4948ac7c40c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:40 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:40 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:40 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:40 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[753b694f-f209-4bd0-b3f6-64cb89ebf6d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260]
Nov 29 01:39:40 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:40 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5088b0aa-554e-4b43-9580-5769c966e80f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe59794-f506-4689-9151-2d3043383c35]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:40 user nova-compute[75210]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:40 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:40 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:40 user nova-compute[75210]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:40 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:40 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:39:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:41 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4062dfb-a737-49f1-b733-76b47b2bb9b2]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:41 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:39:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUIVBpEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:39:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23036663136316430', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036663136316430', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T01:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2066306463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-270978347',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGU0DOtHsgsIIlh0yZXrpDNtdGQqQOnDnHoYuM6y1g9Epjtm7yg8pFsSH/xmwlmyR3J6FK80EjbFlCtWmdPs07pGLRnJSll8hIizePLsEmCf5a2RfdkfGukgo+XphH4Xw==',key_name='tempest-keypair-496495817',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:37:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d20161f567a4c50956fda3ec66ea74b',ramdisk_id='',reservation_id='r-eq4oj3h7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-974565393',owner_user_name='tempest-ServerActionsV293TestJSON-974565393-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed9ecba6c9944ba5804dc45e4e107f08',uuid=10a92792-5f02-42e5-8012-a022fc717797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Converting VIF {"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:39:42 user nova-compute[75210]:   <uuid>10a92792-5f02-42e5-8012-a022fc717797</uuid>
Nov 29 01:39:42 user nova-compute[75210]:   <name>instance-00000008</name>
Nov 29 01:39:42 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:39:42 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:39:42 user nova-compute[75210]:   <metadata>
Nov 29 01:39:42 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:39:42 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:39:42 user nova-compute[75210]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2066306463</nova:name>
Nov 29 01:39:42 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:39:40</nova:creationTime>
Nov 29 01:39:42 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:39:42 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:39:42 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:39:42 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:39:42 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:39:42 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:39:42 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:39:42 user nova-compute[75210]:       <nova:owner>
Nov 29 01:39:42 user nova-compute[75210]:         <nova:user uuid="ed9ecba6c9944ba5804dc45e4e107f08">tempest-ServerActionsV293TestJSON-974565393-project-member</nova:user>
Nov 29 01:39:42 user nova-compute[75210]:         <nova:project uuid="9d20161f567a4c50956fda3ec66ea74b">tempest-ServerActionsV293TestJSON-974565393</nova:project>
Nov 29 01:39:42 user nova-compute[75210]:       </nova:owner>
Nov 29 01:39:42 user nova-compute[75210]:       <nova:ports>
Nov 29 01:39:42 user nova-compute[75210]:         <nova:port uuid="c0fd23c3-6145-4950-ac75-4af31b96ed5e">
Nov 29 01:39:42 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 01:39:42 user nova-compute[75210]:         </nova:port>
Nov 29 01:39:42 user nova-compute[75210]:       </nova:ports>
Nov 29 01:39:42 user nova-compute[75210]:     </nova:instance>
Nov 29 01:39:42 user nova-compute[75210]:   </metadata>
Nov 29 01:39:42 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:39:42 user nova-compute[75210]:     <system>
Nov 29 01:39:42 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:39:42 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:39:42 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:39:42 user nova-compute[75210]:       <entry name="serial">10a92792-5f02-42e5-8012-a022fc717797</entry>
Nov 29 01:39:42 user nova-compute[75210]:       <entry name="uuid">10a92792-5f02-42e5-8012-a022fc717797</entry>
Nov 29 01:39:42 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:39:42 user nova-compute[75210]:     </system>
Nov 29 01:39:42 user nova-compute[75210]:   </sysinfo>
Nov 29 01:39:42 user nova-compute[75210]:   <os>
Nov 29 01:39:42 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:39:42 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:39:42 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:39:42 user nova-compute[75210]:   </os>
Nov 29 01:39:42 user nova-compute[75210]:   <features>
Nov 29 01:39:42 user nova-compute[75210]:     <acpi/>
Nov 29 01:39:42 user nova-compute[75210]:     <apic/>
Nov 29 01:39:42 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:39:42 user nova-compute[75210]:   </features>
Nov 29 01:39:42 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:39:42 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:39:42 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:39:42 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:39:42 user nova-compute[75210]:   </clock>
Nov 29 01:39:42 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:39:42 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:39:42 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:39:42 user nova-compute[75210]:   </cpu>
Nov 29 01:39:42 user nova-compute[75210]:   <devices>
Nov 29 01:39:42 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:39:42 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:39:42 user nova-compute[75210]:       <source dev="/dev/sdb"/>
Nov 29 01:39:42 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:39:42 user nova-compute[75210]:       <serial>9f315778-a694-4266-8fec-4d9cc29e76bb</serial>
Nov 29 01:39:42 user nova-compute[75210]:     </disk>
Nov 29 01:39:42 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:39:42 user nova-compute[75210]:       <mac address="fa:16:3e:2a:a4:15"/>
Nov 29 01:39:42 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:39:42 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:39:42 user nova-compute[75210]:       <target dev="tapc0fd23c3-61"/>
Nov 29 01:39:42 user nova-compute[75210]:     </interface>
Nov 29 01:39:42 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:39:42 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/10a92792-5f02-42e5-8012-a022fc717797/console.log" append="off"/>
Nov 29 01:39:42 user nova-compute[75210]:     </serial>
Nov 29 01:39:42 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:39:42 user nova-compute[75210]:     <video>
Nov 29 01:39:42 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:39:42 user nova-compute[75210]:     </video>
Nov 29 01:39:42 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:39:42 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:39:42 user nova-compute[75210]:     </rng>
Nov 29 01:39:42 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:39:42 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:39:42 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:39:42 user nova-compute[75210]:     </memballoon>
Nov 29 01:39:42 user nova-compute[75210]:   </devices>
Nov 29 01:39:42 user nova-compute[75210]: </domain>
Nov 29 01:39:42 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T01:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2066306463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-270978347',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGU0DOtHsgsIIlh0yZXrpDNtdGQqQOnDnHoYuM6y1g9Epjtm7yg8pFsSH/xmwlmyR3J6FK80EjbFlCtWmdPs07pGLRnJSll8hIizePLsEmCf5a2RfdkfGukgo+XphH4Xw==',key_name='tempest-keypair-496495817',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:37:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d20161f567a4c50956fda3ec66ea74b',ramdisk_id='',reservation_id='r-eq4oj3h7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-974565393',owner_user_name='tempest-ServerActionsV293TestJSON-974565393-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:39:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed9ecba6c9944ba5804dc45e4e107f08',uuid=10a92792-5f02-42e5-8012-a022fc717797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Converting VIF {"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG os_vif [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54283a51-3442-5b04-9ae7-c8481c3c0eb0', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0fd23c3-61, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0fd23c3-61, col_values=(('qos', UUID('e2e156f6-da66-4cd7-b804-49770f9ae06d')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0fd23c3-61, col_values=(('external_ids', {'iface-id': 'c0fd23c3-6145-4950-ac75-4af31b96ed5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:a4:15', 'vm-uuid': '10a92792-5f02-42e5-8012-a022fc717797'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:42 user nova-compute[75210]: INFO os_vif [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61')
Nov 29 01:39:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:39:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] No VIF found with MAC fa:16:3e:2a:a4:15, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:39:43 user nova-compute[75210]: INFO nova.compute.claims [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Claim successful on node user
Nov 29 01:39:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:39:43 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:39:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG nova.policy [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b74bb613cf57414b8495c3391821442e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633ac01a07914222b8d881ce54802dbd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-a9036808-fdf9-4ca9-a045-219e03921c64 req-13dcee73-4cea-4b3d-8458-dd08a5239078 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received event network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a9036808-fdf9-4ca9-a045-219e03921c64 req-13dcee73-4cea-4b3d-8458-dd08a5239078 service nova] Acquiring lock "10a92792-5f02-42e5-8012-a022fc717797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a9036808-fdf9-4ca9-a045-219e03921c64 req-13dcee73-4cea-4b3d-8458-dd08a5239078 service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a9036808-fdf9-4ca9-a045-219e03921c64 req-13dcee73-4cea-4b3d-8458-dd08a5239078 service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-a9036808-fdf9-4ca9-a045-219e03921c64 req-13dcee73-4cea-4b3d-8458-dd08a5239078 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] No waiting events found dispatching network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:43 user nova-compute[75210]: WARNING nova.compute.manager [req-a9036808-fdf9-4ca9-a045-219e03921c64 req-13dcee73-4cea-4b3d-8458-dd08a5239078 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received unexpected event network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e for instance with vm_state active and task_state rebuild_spawning.
Nov 29 01:39:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:39:43 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Creating image(s)
Nov 29 01:39:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "/opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "/opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.214s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Successfully created port: cab8d54d-c948-4e8f-a543-2f999336ef32 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk 1073741824" returned: 0 in 0.050s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Cannot resize image /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Ensure instance console log exists: /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Successfully updated port: cab8d54d-c948-4e8f-a543-2f999336ef32 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "refresh_cache-7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquired lock "refresh_cache-7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-8db8de53-f0ab-4030-b8b1-89c1b47aad98 req-07d82d15-8020-4cd4-bbd3-978ec675d923 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Received event network-changed-cab8d54d-c948-4e8f-a543-2f999336ef32 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-8db8de53-f0ab-4030-b8b1-89c1b47aad98 req-07d82d15-8020-4cd4-bbd3-978ec675d923 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Refreshing instance network info cache due to event network-changed-cab8d54d-c948-4e8f-a543-2f999336ef32. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8db8de53-f0ab-4030-b8b1-89c1b47aad98 req-07d82d15-8020-4cd4-bbd3-978ec675d923 service nova] Acquiring lock "refresh_cache-7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:39:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Updating instance_info_cache with network_info: [{"id": "cab8d54d-c948-4e8f-a543-2f999336ef32", "address": "fa:16:3e:81:05:66", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab8d54d-c9", "ovs_interfaceid": "cab8d54d-c948-4e8f-a543-2f999336ef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Releasing lock "refresh_cache-7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Instance network_info: |[{"id": "cab8d54d-c948-4e8f-a543-2f999336ef32", "address": "fa:16:3e:81:05:66", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab8d54d-c9", "ovs_interfaceid": "cab8d54d-c948-4e8f-a543-2f999336ef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8db8de53-f0ab-4030-b8b1-89c1b47aad98 req-07d82d15-8020-4cd4-bbd3-978ec675d923 service nova] Acquired lock "refresh_cache-7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.network.neutron [req-8db8de53-f0ab-4030-b8b1-89c1b47aad98 req-07d82d15-8020-4cd4-bbd3-978ec675d923 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Refreshing network info cache for port cab8d54d-c948-4e8f-a543-2f999336ef32 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Start _get_guest_xml network_info=[{"id": "cab8d54d-c948-4e8f-a543-2f999336ef32", "address": "fa:16:3e:81:05:66", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab8d54d-c9", "ovs_interfaceid": "cab8d54d-c948-4e8f-a543-2f999336ef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:39:45 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:39:45 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1178143244',display_name='tempest-VolumesAdminNegativeTest-server-1178143244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1178143244',id=14,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='633ac01a07914222b8d881ce54802dbd',ramdisk_id='',reservation_id='r-nqbhz84v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1252348372',owner_user_name='tempest-VolumesAdminNegativeTest-1252348372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:39:44Z,user_data=None,user_id='b74bb613cf57414b8495c3391821442e',uuid=7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cab8d54d-c948-4e8f-a543-2f999336ef32", "address": "fa:16:3e:81:05:66", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab8d54d-c9", "ovs_interfaceid": "cab8d54d-c948-4e8f-a543-2f999336ef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Converting VIF {"id": "cab8d54d-c948-4e8f-a543-2f999336ef32", "address": "fa:16:3e:81:05:66", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab8d54d-c9", "ovs_interfaceid": "cab8d54d-c948-4e8f-a543-2f999336ef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:05:66,bridge_name='br-int',has_traffic_filtering=True,id=cab8d54d-c948-4e8f-a543-2f999336ef32,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab8d54d-c9') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.objects.instance [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:39:45 user nova-compute[75210]:   <uuid>7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2</uuid>
Nov 29 01:39:45 user nova-compute[75210]:   <name>instance-0000000e</name>
Nov 29 01:39:45 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:39:45 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:39:45 user nova-compute[75210]:   <metadata>
Nov 29 01:39:45 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:39:45 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:39:45 user nova-compute[75210]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1178143244</nova:name>
Nov 29 01:39:45 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:39:45</nova:creationTime>
Nov 29 01:39:45 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:39:45 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:39:45 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:39:45 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:39:45 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:39:45 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:39:45 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:39:45 user nova-compute[75210]:       <nova:owner>
Nov 29 01:39:45 user nova-compute[75210]:         <nova:user uuid="b74bb613cf57414b8495c3391821442e">tempest-VolumesAdminNegativeTest-1252348372-project-member</nova:user>
Nov 29 01:39:45 user nova-compute[75210]:         <nova:project uuid="633ac01a07914222b8d881ce54802dbd">tempest-VolumesAdminNegativeTest-1252348372</nova:project>
Nov 29 01:39:45 user nova-compute[75210]:       </nova:owner>
Nov 29 01:39:45 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:39:45 user nova-compute[75210]:       <nova:ports>
Nov 29 01:39:45 user nova-compute[75210]:         <nova:port uuid="cab8d54d-c948-4e8f-a543-2f999336ef32">
Nov 29 01:39:45 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:39:45 user nova-compute[75210]:         </nova:port>
Nov 29 01:39:45 user nova-compute[75210]:       </nova:ports>
Nov 29 01:39:45 user nova-compute[75210]:     </nova:instance>
Nov 29 01:39:45 user nova-compute[75210]:   </metadata>
Nov 29 01:39:45 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:39:45 user nova-compute[75210]:     <system>
Nov 29 01:39:45 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:39:45 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:39:45 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:39:45 user nova-compute[75210]:       <entry name="serial">7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2</entry>
Nov 29 01:39:45 user nova-compute[75210]:       <entry name="uuid">7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2</entry>
Nov 29 01:39:45 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:39:45 user nova-compute[75210]:     </system>
Nov 29 01:39:45 user nova-compute[75210]:   </sysinfo>
Nov 29 01:39:45 user nova-compute[75210]:   <os>
Nov 29 01:39:45 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:39:45 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:39:45 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:39:45 user nova-compute[75210]:   </os>
Nov 29 01:39:45 user nova-compute[75210]:   <features>
Nov 29 01:39:45 user nova-compute[75210]:     <acpi/>
Nov 29 01:39:45 user nova-compute[75210]:     <apic/>
Nov 29 01:39:45 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:39:45 user nova-compute[75210]:   </features>
Nov 29 01:39:45 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:39:45 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:39:45 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:39:45 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:39:45 user nova-compute[75210]:   </clock>
Nov 29 01:39:45 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:39:45 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:39:45 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:39:45 user nova-compute[75210]:   </cpu>
Nov 29 01:39:45 user nova-compute[75210]:   <devices>
Nov 29 01:39:45 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:39:45 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:39:45 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk"/>
Nov 29 01:39:45 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:39:45 user nova-compute[75210]:     </disk>
Nov 29 01:39:45 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:39:45 user nova-compute[75210]:       <mac address="fa:16:3e:81:05:66"/>
Nov 29 01:39:45 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:39:45 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:39:45 user nova-compute[75210]:       <target dev="tapcab8d54d-c9"/>
Nov 29 01:39:45 user nova-compute[75210]:     </interface>
Nov 29 01:39:45 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:39:45 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/console.log" append="off"/>
Nov 29 01:39:45 user nova-compute[75210]:     </serial>
Nov 29 01:39:45 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:39:45 user nova-compute[75210]:     <video>
Nov 29 01:39:45 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:39:45 user nova-compute[75210]:     </video>
Nov 29 01:39:45 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:39:45 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:39:45 user nova-compute[75210]:     </rng>
Nov 29 01:39:45 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:39:45 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:39:45 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:39:45 user nova-compute[75210]:     </memballoon>
Nov 29 01:39:45 user nova-compute[75210]:   </devices>
Nov 29 01:39:45 user nova-compute[75210]: </domain>
Nov 29 01:39:45 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1178143244',display_name='tempest-VolumesAdminNegativeTest-server-1178143244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1178143244',id=14,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='633ac01a07914222b8d881ce54802dbd',ramdisk_id='',reservation_id='r-nqbhz84v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1252348372',owner_user_name='tempest-VolumesAdminNegativeTest-1252348372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:39:44Z,user_data=None,user_id='b74bb613cf57414b8495c3391821442e',uuid=7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cab8d54d-c948-4e8f-a543-2f999336ef32", "address": "fa:16:3e:81:05:66", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab8d54d-c9", "ovs_interfaceid": "cab8d54d-c948-4e8f-a543-2f999336ef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Converting VIF {"id": "cab8d54d-c948-4e8f-a543-2f999336ef32", "address": "fa:16:3e:81:05:66", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab8d54d-c9", "ovs_interfaceid": "cab8d54d-c948-4e8f-a543-2f999336ef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:05:66,bridge_name='br-int',has_traffic_filtering=True,id=cab8d54d-c948-4e8f-a543-2f999336ef32,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab8d54d-c9') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG os_vif [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:05:66,bridge_name='br-int',has_traffic_filtering=True,id=cab8d54d-c948-4e8f-a543-2f999336ef32,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab8d54d-c9') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67585048-845f-56b5-a229-71cc1f3cdb04', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcab8d54d-c9, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcab8d54d-c9, col_values=(('qos', UUID('e0e0039d-e3a7-42f6-9b8c-e0d3a0e91d7e')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcab8d54d-c9, col_values=(('external_ids', {'iface-id': 'cab8d54d-c948-4e8f-a543-2f999336ef32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:05:66', 'vm-uuid': '7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:45 user nova-compute[75210]: INFO os_vif [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:05:66,bridge_name='br-int',has_traffic_filtering=True,id=cab8d54d-c948-4e8f-a543-2f999336ef32,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab8d54d-c9')
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] No VIF found with MAC fa:16:3e:81:05:66, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.network.neutron [req-8db8de53-f0ab-4030-b8b1-89c1b47aad98 req-07d82d15-8020-4cd4-bbd3-978ec675d923 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Updated VIF entry in instance network info cache for port cab8d54d-c948-4e8f-a543-2f999336ef32. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.network.neutron [req-8db8de53-f0ab-4030-b8b1-89c1b47aad98 req-07d82d15-8020-4cd4-bbd3-978ec675d923 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Updating instance_info_cache with network_info: [{"id": "cab8d54d-c948-4e8f-a543-2f999336ef32", "address": "fa:16:3e:81:05:66", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab8d54d-c9", "ovs_interfaceid": "cab8d54d-c948-4e8f-a543-2f999336ef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8db8de53-f0ab-4030-b8b1-89c1b47aad98 req-07d82d15-8020-4cd4-bbd3-978ec675d923 service nova] Releasing lock "refresh_cache-7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:39:45 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Instance spawned successfully.
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.objects.instance [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75210) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.compute.manager [req-d876bbb2-0647-42e5-9514-16425078a82a req-b9c2c7f4-1892-4429-a963-8bf0dc559a0f service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received event network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d876bbb2-0647-42e5-9514-16425078a82a req-b9c2c7f4-1892-4429-a963-8bf0dc559a0f service nova] Acquiring lock "10a92792-5f02-42e5-8012-a022fc717797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d876bbb2-0647-42e5-9514-16425078a82a req-b9c2c7f4-1892-4429-a963-8bf0dc559a0f service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d876bbb2-0647-42e5-9514-16425078a82a req-b9c2c7f4-1892-4429-a963-8bf0dc559a0f service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:45 user nova-compute[75210]: DEBUG nova.compute.manager [req-d876bbb2-0647-42e5-9514-16425078a82a req-b9c2c7f4-1892-4429-a963-8bf0dc559a0f service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] No waiting events found dispatching network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:45 user nova-compute[75210]: WARNING nova.compute.manager [req-d876bbb2-0647-42e5-9514-16425078a82a req-b9c2c7f4-1892-4429-a963-8bf0dc559a0f service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received unexpected event network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e for instance with vm_state active and task_state None.
Nov 29 01:39:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6fe1186f-9c8e-440e-8dfb-b422a28158c2 tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-6e5ac2a9-516b-426f-b84c-47f24a42bccb req-7564da2d-81b9-44d4-8054-7f1227b24c99 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Received event network-vif-plugged-cab8d54d-c948-4e8f-a543-2f999336ef32 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6e5ac2a9-516b-426f-b84c-47f24a42bccb req-7564da2d-81b9-44d4-8054-7f1227b24c99 service nova] Acquiring lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6e5ac2a9-516b-426f-b84c-47f24a42bccb req-7564da2d-81b9-44d4-8054-7f1227b24c99 service nova] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6e5ac2a9-516b-426f-b84c-47f24a42bccb req-7564da2d-81b9-44d4-8054-7f1227b24c99 service nova] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-6e5ac2a9-516b-426f-b84c-47f24a42bccb req-7564da2d-81b9-44d4-8054-7f1227b24c99 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] No waiting events found dispatching network-vif-plugged-cab8d54d-c948-4e8f-a543-2f999336ef32 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:46 user nova-compute[75210]: WARNING nova.compute.manager [req-6e5ac2a9-516b-426f-b84c-47f24a42bccb req-7564da2d-81b9-44d4-8054-7f1227b24c99 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Received unexpected event network-vif-plugged-cab8d54d-c948-4e8f-a543-2f999336ef32 for instance with vm_state building and task_state spawning.
Nov 29 01:39:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:39:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:39:48 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Instance spawned successfully.
Nov 29 01:39:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:39:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:39:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:39:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:39:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:39:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:39:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:39:48 user nova-compute[75210]: DEBUG nova.compute.manager [req-99a2f9f3-9582-4c84-a59b-c0154da2b61f req-7ece2d11-9029-4a0b-b82f-c53be03e5825 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Received event network-vif-plugged-cab8d54d-c948-4e8f-a543-2f999336ef32 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-99a2f9f3-9582-4c84-a59b-c0154da2b61f req-7ece2d11-9029-4a0b-b82f-c53be03e5825 service nova] Acquiring lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:39:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-99a2f9f3-9582-4c84-a59b-c0154da2b61f req-7ece2d11-9029-4a0b-b82f-c53be03e5825 service nova] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:39:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-99a2f9f3-9582-4c84-a59b-c0154da2b61f req-7ece2d11-9029-4a0b-b82f-c53be03e5825 service nova] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:48 user nova-compute[75210]: DEBUG nova.compute.manager [req-99a2f9f3-9582-4c84-a59b-c0154da2b61f req-7ece2d11-9029-4a0b-b82f-c53be03e5825 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] No waiting events found dispatching network-vif-plugged-cab8d54d-c948-4e8f-a543-2f999336ef32 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:39:48 user nova-compute[75210]: WARNING nova.compute.manager [req-99a2f9f3-9582-4c84-a59b-c0154da2b61f req-7ece2d11-9029-4a0b-b82f-c53be03e5825 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Received unexpected event network-vif-plugged-cab8d54d-c948-4e8f-a543-2f999336ef32 for instance with vm_state building and task_state spawning.
Nov 29 01:39:48 user nova-compute[75210]: INFO nova.compute.manager [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 29 01:39:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:39:49 user nova-compute[75210]: INFO nova.compute.manager [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Took 5.91 seconds to build instance.
Nov 29 01:39:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5236cdf3-40e5-4c34-b5e0-fafb1a84a562 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.005s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:55 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Waiting for libvirt event about the detach of device tap181af4a1-39 with device alias net1 from instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 is timed out.
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:09:df"/><model type="virtio"/><mtu size="1442"/><target dev="tap181af4a1-39"/></interface> {{(pid=75210) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f0:09:df"/><model type="virtio"/><mtu size="1442"/><target dev="tap181af4a1-39"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 29 01:39:55 user nova-compute[75210]:   <name>instance-00000006</name>
Nov 29 01:39:55 user nova-compute[75210]:   <uuid>0d7f5bf7-edc1-465f-b24f-171d1481ffa0</uuid>
Nov 29 01:39:55 user nova-compute[75210]:   <metadata>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:39:55 user nova-compute[75210]:   <nova:package version="0.0.0"/>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:name>tempest-device-tagging-server-1906023654</nova:name>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:creationTime>2023-11-29 01:38:49</nova:creationTime>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:flavor name="m1.tiny">
Nov 29 01:39:55 user nova-compute[75210]:     <nova:memory>512</nova:memory>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:disk>1</nova:disk>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:swap>0</nova:swap>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:vcpus>1</nova:vcpus>
Nov 29 01:39:55 user nova-compute[75210]:   </nova:flavor>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:owner>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:user uuid="413fdbcc401e4fd99a537e93fea9eaa4">tempest-TaggedAttachmentsTest-1153284446-project-member</nova:user>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:project uuid="08d017f83b2449c18c70e3dbed78af01">tempest-TaggedAttachmentsTest-1153284446</nova:project>
Nov 29 01:39:55 user nova-compute[75210]:   </nova:owner>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:ports>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:port uuid="bddbec43-276a-4a46-a083-2aa153ccd4db">
Nov 29 01:39:55 user nova-compute[75210]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:39:55 user nova-compute[75210]:     </nova:port>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:port uuid="181af4a1-3952-4c3c-b58c-c87a89a63bab">
Nov 29 01:39:55 user nova-compute[75210]:       <nova:ip type="fixed" address="10.10.10.20" ipVersion="4"/>
Nov 29 01:39:55 user nova-compute[75210]:     </nova:port>
Nov 29 01:39:55 user nova-compute[75210]:   </nova:ports>
Nov 29 01:39:55 user nova-compute[75210]: </nova:instance>
Nov 29 01:39:55 user nova-compute[75210]:   </metadata>
Nov 29 01:39:55 user nova-compute[75210]:   <memory unit='KiB'>524288</memory>
Nov 29 01:39:55 user nova-compute[75210]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 01:39:55 user nova-compute[75210]:   <vcpu placement='static'>1</vcpu>
Nov 29 01:39:55 user nova-compute[75210]:   <resource>
Nov 29 01:39:55 user nova-compute[75210]:     <partition>/machine</partition>
Nov 29 01:39:55 user nova-compute[75210]:   </resource>
Nov 29 01:39:55 user nova-compute[75210]:   <sysinfo type='smbios'>
Nov 29 01:39:55 user nova-compute[75210]:     <system>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='version'>0.0.0</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='serial'>0d7f5bf7-edc1-465f-b24f-171d1481ffa0</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='uuid'>0d7f5bf7-edc1-465f-b24f-171d1481ffa0</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='family'>Virtual Machine</entry>
Nov 29 01:39:55 user nova-compute[75210]:     </system>
Nov 29 01:39:55 user nova-compute[75210]:   </sysinfo>
Nov 29 01:39:55 user nova-compute[75210]:   <os>
Nov 29 01:39:55 user nova-compute[75210]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 01:39:55 user nova-compute[75210]:     <boot dev='hd'/>
Nov 29 01:39:55 user nova-compute[75210]:     <smbios mode='sysinfo'/>
Nov 29 01:39:55 user nova-compute[75210]:   </os>
Nov 29 01:39:55 user nova-compute[75210]:   <features>
Nov 29 01:39:55 user nova-compute[75210]:     <acpi/>
Nov 29 01:39:55 user nova-compute[75210]:     <apic/>
Nov 29 01:39:55 user nova-compute[75210]:     <vmcoreinfo state='on'/>
Nov 29 01:39:55 user nova-compute[75210]:   </features>
Nov 29 01:39:55 user nova-compute[75210]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 01:39:55 user nova-compute[75210]:     <model fallback='forbid'>Nehalem</model>
Nov 29 01:39:55 user nova-compute[75210]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 01:39:55 user nova-compute[75210]:     <feature policy='require' name='vme'/>
Nov 29 01:39:55 user nova-compute[75210]:     <feature policy='require' name='x2apic'/>
Nov 29 01:39:55 user nova-compute[75210]:     <feature policy='require' name='hypervisor'/>
Nov 29 01:39:55 user nova-compute[75210]:   </cpu>
Nov 29 01:39:55 user nova-compute[75210]:   <clock offset='utc'>
Nov 29 01:39:55 user nova-compute[75210]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 01:39:55 user nova-compute[75210]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 01:39:55 user nova-compute[75210]:     <timer name='hpet' present='no'/>
Nov 29 01:39:55 user nova-compute[75210]:   </clock>
Nov 29 01:39:55 user nova-compute[75210]:   <on_poweroff>destroy</on_poweroff>
Nov 29 01:39:55 user nova-compute[75210]:   <on_reboot>restart</on_reboot>
Nov 29 01:39:55 user nova-compute[75210]:   <on_crash>destroy</on_crash>
Nov 29 01:39:55 user nova-compute[75210]:   <devices>
Nov 29 01:39:55 user nova-compute[75210]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 01:39:55 user nova-compute[75210]:     <disk type='file' device='disk'>
Nov 29 01:39:55 user nova-compute[75210]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 01:39:55 user nova-compute[75210]:       <source file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk' index='2'/>
Nov 29 01:39:55 user nova-compute[75210]:       <backingStore type='file' index='3'>
Nov 29 01:39:55 user nova-compute[75210]:         <format type='raw'/>
Nov 29 01:39:55 user nova-compute[75210]:         <source file='/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8'/>
Nov 29 01:39:55 user nova-compute[75210]:         <backingStore/>
Nov 29 01:39:55 user nova-compute[75210]:       </backingStore>
Nov 29 01:39:55 user nova-compute[75210]:       <target dev='vda' bus='virtio'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='virtio-disk0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </disk>
Nov 29 01:39:55 user nova-compute[75210]:     <disk type='file' device='cdrom'>
Nov 29 01:39:55 user nova-compute[75210]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 01:39:55 user nova-compute[75210]:       <source file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk.config' index='1'/>
Nov 29 01:39:55 user nova-compute[75210]:       <backingStore/>
Nov 29 01:39:55 user nova-compute[75210]:       <target dev='hda' bus='ide'/>
Nov 29 01:39:55 user nova-compute[75210]:       <readonly/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='ide0-0-0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </disk>
Nov 29 01:39:55 user nova-compute[75210]:     <controller type='usb' index='0' model='none'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='usb'/>
Nov 29 01:39:55 user nova-compute[75210]:     </controller>
Nov 29 01:39:55 user nova-compute[75210]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='pci.0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </controller>
Nov 29 01:39:55 user nova-compute[75210]:     <controller type='ide' index='0'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='ide'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 01:39:55 user nova-compute[75210]:     </controller>
Nov 29 01:39:55 user nova-compute[75210]:     <interface type='ethernet'>
Nov 29 01:39:55 user nova-compute[75210]:       <mac address='fa:16:3e:00:cd:81'/>
Nov 29 01:39:55 user nova-compute[75210]:       <target dev='tapbddbec43-27'/>
Nov 29 01:39:55 user nova-compute[75210]:       <model type='virtio'/>
Nov 29 01:39:55 user nova-compute[75210]:       <mtu size='1442'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='net0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </interface>
Nov 29 01:39:55 user nova-compute[75210]:     <serial type='pty'>
Nov 29 01:39:55 user nova-compute[75210]:       <source path='/dev/pts/5'/>
Nov 29 01:39:55 user nova-compute[75210]:       <log file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/console.log' append='off'/>
Nov 29 01:39:55 user nova-compute[75210]:       <target type='isa-serial' port='0'>
Nov 29 01:39:55 user nova-compute[75210]:         <model name='isa-serial'/>
Nov 29 01:39:55 user nova-compute[75210]:       </target>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='serial0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </serial>
Nov 29 01:39:55 user nova-compute[75210]:     <console type='pty' tty='/dev/pts/5'>
Nov 29 01:39:55 user nova-compute[75210]:       <source path='/dev/pts/5'/>
Nov 29 01:39:55 user nova-compute[75210]:       <log file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/console.log' append='off'/>
Nov 29 01:39:55 user nova-compute[75210]:       <target type='serial' port='0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='serial0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </console>
Nov 29 01:39:55 user nova-compute[75210]:     <input type='mouse' bus='ps2'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='input0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </input>
Nov 29 01:39:55 user nova-compute[75210]:     <input type='keyboard' bus='ps2'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='input1'/>
Nov 29 01:39:55 user nova-compute[75210]:     </input>
Nov 29 01:39:55 user nova-compute[75210]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 29 01:39:55 user nova-compute[75210]:       <listen type='address' address='0.0.0.0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </graphics>
Nov 29 01:39:55 user nova-compute[75210]:     <audio id='1' type='none'/>
Nov 29 01:39:55 user nova-compute[75210]:     <video>
Nov 29 01:39:55 user nova-compute[75210]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='video0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </video>
Nov 29 01:39:55 user nova-compute[75210]:     <memballoon model='virtio'>
Nov 29 01:39:55 user nova-compute[75210]:       <stats period='10'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='balloon0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </memballoon>
Nov 29 01:39:55 user nova-compute[75210]:     <rng model='virtio'>
Nov 29 01:39:55 user nova-compute[75210]:       <backend model='random'>/dev/urandom</backend>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='rng0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </rng>
Nov 29 01:39:55 user nova-compute[75210]:   </devices>
Nov 29 01:39:55 user nova-compute[75210]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 01:39:55 user nova-compute[75210]:     <label>libvirt-0d7f5bf7-edc1-465f-b24f-171d1481ffa0</label>
Nov 29 01:39:55 user nova-compute[75210]:     <imagelabel>libvirt-0d7f5bf7-edc1-465f-b24f-171d1481ffa0</imagelabel>
Nov 29 01:39:55 user nova-compute[75210]:   </seclabel>
Nov 29 01:39:55 user nova-compute[75210]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 01:39:55 user nova-compute[75210]:     <label>+64055:+108</label>
Nov 29 01:39:55 user nova-compute[75210]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 01:39:55 user nova-compute[75210]:   </seclabel>
Nov 29 01:39:55 user nova-compute[75210]: </domain>
Nov 29 01:39:55 user nova-compute[75210]:  {{(pid=75210) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 01:39:55 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Successfully detached device tap181af4a1-39 from instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 from the live domain config.
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:36:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906023654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906023654',id=6,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmtm9Y/rL28hHvUP7150cqzO8TBgS/8Pwq7X/7Gtilm5Sd870B/ZK7bsEtY2wPDo+rNSG8X+Tp2Avrz3QbtDNgCJe0acCKnqRj8bkYwO8r/0na0wbSxh0PaL89RzsH/pA==',key_name='tempest-keypair-1039804411',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08d017f83b2449c18c70e3dbed78af01',ramdisk_id='',reservation_id='r-c01u2q0f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1153284446',owner_user_name='tempest-TaggedAttachmentsTest-1153284446-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413fdbcc401e4fd99a537e93fea9eaa4',uuid=0d7f5bf7-edc1-465f-b24f-171d1481ffa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converting VIF {"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:df,bridge_name='br-int',has_traffic_filtering=True,id=181af4a1-3952-4c3c-b58c-c87a89a63bab,network=Network(28cea21a-f823-40a9-8d9c-4bcbf5829b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181af4a1-39') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG os_vif [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:df,bridge_name='br-int',has_traffic_filtering=True,id=181af4a1-3952-4c3c-b58c-c87a89a63bab,network=Network(28cea21a-f823-40a9-8d9c-4bcbf5829b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181af4a1-39') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap181af4a1-39, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63e6a312-de4b-4f88-ad64-324a54ed3aa3) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:55 user nova-compute[75210]: INFO os_vif [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:df,bridge_name='br-int',has_traffic_filtering=True,id=181af4a1-3952-4c3c-b58c-c87a89a63bab,network=Network(28cea21a-f823-40a9-8d9c-4bcbf5829b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181af4a1-39')
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:39:55 user nova-compute[75210]:   <nova:package version="0.0.0"/>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:name>tempest-device-tagging-server-1906023654</nova:name>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:creationTime>2023-11-29 01:39:55</nova:creationTime>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:flavor name="m1.tiny">
Nov 29 01:39:55 user nova-compute[75210]:     <nova:memory>512</nova:memory>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:disk>1</nova:disk>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:swap>0</nova:swap>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:vcpus>1</nova:vcpus>
Nov 29 01:39:55 user nova-compute[75210]:   </nova:flavor>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:owner>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:user uuid="413fdbcc401e4fd99a537e93fea9eaa4">tempest-TaggedAttachmentsTest-1153284446-project-member</nova:user>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:project uuid="08d017f83b2449c18c70e3dbed78af01">tempest-TaggedAttachmentsTest-1153284446</nova:project>
Nov 29 01:39:55 user nova-compute[75210]:   </nova:owner>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:ports>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:port uuid="bddbec43-276a-4a46-a083-2aa153ccd4db">
Nov 29 01:39:55 user nova-compute[75210]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:39:55 user nova-compute[75210]:     </nova:port>
Nov 29 01:39:55 user nova-compute[75210]:   </nova:ports>
Nov 29 01:39:55 user nova-compute[75210]: </nova:instance>
Nov 29 01:39:55 user nova-compute[75210]:  {{(pid=75210) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.compute.manager [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-vif-deleted-181af4a1-3952-4c3c-b58c-c87a89a63bab {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:39:55 user nova-compute[75210]: INFO nova.compute.manager [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Neutron deleted interface 181af4a1-3952-4c3c-b58c-c87a89a63bab; detaching it from the instance and deleting it from the info cache
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.network.neutron [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Updating instance_info_cache with network_info: [{"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquired lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.objects.instance [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] Lazy-loading 'system_metadata' on Instance uuid 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.objects.instance [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] Lazy-loading 'flavor' on Instance uuid 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.objects.base [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] Object Instance<0d7f5bf7-edc1-465f-b24f-171d1481ffa0> lazy-loaded attributes: system_metadata,flavor {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:36:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906023654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906023654',id=6,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmtm9Y/rL28hHvUP7150cqzO8TBgS/8Pwq7X/7Gtilm5Sd870B/ZK7bsEtY2wPDo+rNSG8X+Tp2Avrz3QbtDNgCJe0acCKnqRj8bkYwO8r/0na0wbSxh0PaL89RzsH/pA==',key_name='tempest-keypair-1039804411',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08d017f83b2449c18c70e3dbed78af01',ramdisk_id='',reservation_id='r-c01u2q0f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1153284446',owner_user_name='tempest-TaggedAttachmentsTest-1153284446-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413fdbcc401e4fd99a537e93fea9eaa4',uuid=0d7f5bf7-edc1-465f-b24f-171d1481ffa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.network.os_vif_util [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] Converting VIF {"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.network.os_vif_util [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:df,bridge_name='br-int',has_traffic_filtering=True,id=181af4a1-3952-4c3c-b58c-c87a89a63bab,network=Network(28cea21a-f823-40a9-8d9c-4bcbf5829b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181af4a1-39') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:09:df"/><model type="virtio"/><mtu size="1442"/><target dev="tap181af4a1-39"/></interface> {{(pid=75210) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f0:09:df"/><model type="virtio"/><mtu size="1442"/><target dev="tap181af4a1-39"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 29 01:39:55 user nova-compute[75210]:   <name>instance-00000006</name>
Nov 29 01:39:55 user nova-compute[75210]:   <uuid>0d7f5bf7-edc1-465f-b24f-171d1481ffa0</uuid>
Nov 29 01:39:55 user nova-compute[75210]:   <metadata>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:39:55 user nova-compute[75210]:   <nova:package version="0.0.0"/>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:name>tempest-device-tagging-server-1906023654</nova:name>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:creationTime>2023-11-29 01:39:55</nova:creationTime>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:flavor name="m1.tiny">
Nov 29 01:39:55 user nova-compute[75210]:     <nova:memory>512</nova:memory>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:disk>1</nova:disk>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:swap>0</nova:swap>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:vcpus>1</nova:vcpus>
Nov 29 01:39:55 user nova-compute[75210]:   </nova:flavor>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:owner>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:user uuid="413fdbcc401e4fd99a537e93fea9eaa4">tempest-TaggedAttachmentsTest-1153284446-project-member</nova:user>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:project uuid="08d017f83b2449c18c70e3dbed78af01">tempest-TaggedAttachmentsTest-1153284446</nova:project>
Nov 29 01:39:55 user nova-compute[75210]:   </nova:owner>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:ports>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:port uuid="bddbec43-276a-4a46-a083-2aa153ccd4db">
Nov 29 01:39:55 user nova-compute[75210]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:39:55 user nova-compute[75210]:     </nova:port>
Nov 29 01:39:55 user nova-compute[75210]:   </nova:ports>
Nov 29 01:39:55 user nova-compute[75210]: </nova:instance>
Nov 29 01:39:55 user nova-compute[75210]:   </metadata>
Nov 29 01:39:55 user nova-compute[75210]:   <memory unit='KiB'>524288</memory>
Nov 29 01:39:55 user nova-compute[75210]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 01:39:55 user nova-compute[75210]:   <vcpu placement='static'>1</vcpu>
Nov 29 01:39:55 user nova-compute[75210]:   <resource>
Nov 29 01:39:55 user nova-compute[75210]:     <partition>/machine</partition>
Nov 29 01:39:55 user nova-compute[75210]:   </resource>
Nov 29 01:39:55 user nova-compute[75210]:   <sysinfo type='smbios'>
Nov 29 01:39:55 user nova-compute[75210]:     <system>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='version'>0.0.0</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='serial'>0d7f5bf7-edc1-465f-b24f-171d1481ffa0</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='uuid'>0d7f5bf7-edc1-465f-b24f-171d1481ffa0</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='family'>Virtual Machine</entry>
Nov 29 01:39:55 user nova-compute[75210]:     </system>
Nov 29 01:39:55 user nova-compute[75210]:   </sysinfo>
Nov 29 01:39:55 user nova-compute[75210]:   <os>
Nov 29 01:39:55 user nova-compute[75210]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 01:39:55 user nova-compute[75210]:     <boot dev='hd'/>
Nov 29 01:39:55 user nova-compute[75210]:     <smbios mode='sysinfo'/>
Nov 29 01:39:55 user nova-compute[75210]:   </os>
Nov 29 01:39:55 user nova-compute[75210]:   <features>
Nov 29 01:39:55 user nova-compute[75210]:     <acpi/>
Nov 29 01:39:55 user nova-compute[75210]:     <apic/>
Nov 29 01:39:55 user nova-compute[75210]:     <vmcoreinfo state='on'/>
Nov 29 01:39:55 user nova-compute[75210]:   </features>
Nov 29 01:39:55 user nova-compute[75210]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 01:39:55 user nova-compute[75210]:     <model fallback='forbid'>Nehalem</model>
Nov 29 01:39:55 user nova-compute[75210]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 01:39:55 user nova-compute[75210]:     <feature policy='require' name='vme'/>
Nov 29 01:39:55 user nova-compute[75210]:     <feature policy='require' name='x2apic'/>
Nov 29 01:39:55 user nova-compute[75210]:     <feature policy='require' name='hypervisor'/>
Nov 29 01:39:55 user nova-compute[75210]:   </cpu>
Nov 29 01:39:55 user nova-compute[75210]:   <clock offset='utc'>
Nov 29 01:39:55 user nova-compute[75210]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 01:39:55 user nova-compute[75210]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 01:39:55 user nova-compute[75210]:     <timer name='hpet' present='no'/>
Nov 29 01:39:55 user nova-compute[75210]:   </clock>
Nov 29 01:39:55 user nova-compute[75210]:   <on_poweroff>destroy</on_poweroff>
Nov 29 01:39:55 user nova-compute[75210]:   <on_reboot>restart</on_reboot>
Nov 29 01:39:55 user nova-compute[75210]:   <on_crash>destroy</on_crash>
Nov 29 01:39:55 user nova-compute[75210]:   <devices>
Nov 29 01:39:55 user nova-compute[75210]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 01:39:55 user nova-compute[75210]:     <disk type='file' device='disk'>
Nov 29 01:39:55 user nova-compute[75210]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 01:39:55 user nova-compute[75210]:       <source file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk' index='2'/>
Nov 29 01:39:55 user nova-compute[75210]:       <backingStore type='file' index='3'>
Nov 29 01:39:55 user nova-compute[75210]:         <format type='raw'/>
Nov 29 01:39:55 user nova-compute[75210]:         <source file='/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8'/>
Nov 29 01:39:55 user nova-compute[75210]:         <backingStore/>
Nov 29 01:39:55 user nova-compute[75210]:       </backingStore>
Nov 29 01:39:55 user nova-compute[75210]:       <target dev='vda' bus='virtio'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='virtio-disk0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </disk>
Nov 29 01:39:55 user nova-compute[75210]:     <disk type='file' device='cdrom'>
Nov 29 01:39:55 user nova-compute[75210]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 01:39:55 user nova-compute[75210]:       <source file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk.config' index='1'/>
Nov 29 01:39:55 user nova-compute[75210]:       <backingStore/>
Nov 29 01:39:55 user nova-compute[75210]:       <target dev='hda' bus='ide'/>
Nov 29 01:39:55 user nova-compute[75210]:       <readonly/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='ide0-0-0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </disk>
Nov 29 01:39:55 user nova-compute[75210]:     <controller type='usb' index='0' model='none'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='usb'/>
Nov 29 01:39:55 user nova-compute[75210]:     </controller>
Nov 29 01:39:55 user nova-compute[75210]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='pci.0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </controller>
Nov 29 01:39:55 user nova-compute[75210]:     <controller type='ide' index='0'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='ide'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 01:39:55 user nova-compute[75210]:     </controller>
Nov 29 01:39:55 user nova-compute[75210]:     <interface type='ethernet'>
Nov 29 01:39:55 user nova-compute[75210]:       <mac address='fa:16:3e:00:cd:81'/>
Nov 29 01:39:55 user nova-compute[75210]:       <target dev='tapbddbec43-27'/>
Nov 29 01:39:55 user nova-compute[75210]:       <model type='virtio'/>
Nov 29 01:39:55 user nova-compute[75210]:       <mtu size='1442'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='net0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </interface>
Nov 29 01:39:55 user nova-compute[75210]:     <serial type='pty'>
Nov 29 01:39:55 user nova-compute[75210]:       <source path='/dev/pts/5'/>
Nov 29 01:39:55 user nova-compute[75210]:       <log file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/console.log' append='off'/>
Nov 29 01:39:55 user nova-compute[75210]:       <target type='isa-serial' port='0'>
Nov 29 01:39:55 user nova-compute[75210]:         <model name='isa-serial'/>
Nov 29 01:39:55 user nova-compute[75210]:       </target>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='serial0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </serial>
Nov 29 01:39:55 user nova-compute[75210]:     <console type='pty' tty='/dev/pts/5'>
Nov 29 01:39:55 user nova-compute[75210]:       <source path='/dev/pts/5'/>
Nov 29 01:39:55 user nova-compute[75210]:       <log file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/console.log' append='off'/>
Nov 29 01:39:55 user nova-compute[75210]:       <target type='serial' port='0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='serial0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </console>
Nov 29 01:39:55 user nova-compute[75210]:     <input type='mouse' bus='ps2'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='input0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </input>
Nov 29 01:39:55 user nova-compute[75210]:     <input type='keyboard' bus='ps2'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='input1'/>
Nov 29 01:39:55 user nova-compute[75210]:     </input>
Nov 29 01:39:55 user nova-compute[75210]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 29 01:39:55 user nova-compute[75210]:       <listen type='address' address='0.0.0.0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </graphics>
Nov 29 01:39:55 user nova-compute[75210]:     <audio id='1' type='none'/>
Nov 29 01:39:55 user nova-compute[75210]:     <video>
Nov 29 01:39:55 user nova-compute[75210]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='video0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </video>
Nov 29 01:39:55 user nova-compute[75210]:     <memballoon model='virtio'>
Nov 29 01:39:55 user nova-compute[75210]:       <stats period='10'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='balloon0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </memballoon>
Nov 29 01:39:55 user nova-compute[75210]:     <rng model='virtio'>
Nov 29 01:39:55 user nova-compute[75210]:       <backend model='random'>/dev/urandom</backend>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='rng0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </rng>
Nov 29 01:39:55 user nova-compute[75210]:   </devices>
Nov 29 01:39:55 user nova-compute[75210]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 01:39:55 user nova-compute[75210]:     <label>libvirt-0d7f5bf7-edc1-465f-b24f-171d1481ffa0</label>
Nov 29 01:39:55 user nova-compute[75210]:     <imagelabel>libvirt-0d7f5bf7-edc1-465f-b24f-171d1481ffa0</imagelabel>
Nov 29 01:39:55 user nova-compute[75210]:   </seclabel>
Nov 29 01:39:55 user nova-compute[75210]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 01:39:55 user nova-compute[75210]:     <label>+64055:+108</label>
Nov 29 01:39:55 user nova-compute[75210]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 01:39:55 user nova-compute[75210]:   </seclabel>
Nov 29 01:39:55 user nova-compute[75210]: </domain>
Nov 29 01:39:55 user nova-compute[75210]:  {{(pid=75210) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:09:df"/><model type="virtio"/><mtu size="1442"/><target dev="tap181af4a1-39"/></interface> {{(pid=75210) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f0:09:df"/><model type="virtio"/><mtu size="1442"/><target dev="tap181af4a1-39"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 29 01:39:55 user nova-compute[75210]:   <name>instance-00000006</name>
Nov 29 01:39:55 user nova-compute[75210]:   <uuid>0d7f5bf7-edc1-465f-b24f-171d1481ffa0</uuid>
Nov 29 01:39:55 user nova-compute[75210]:   <metadata>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:39:55 user nova-compute[75210]:   <nova:package version="0.0.0"/>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:name>tempest-device-tagging-server-1906023654</nova:name>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:creationTime>2023-11-29 01:39:55</nova:creationTime>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:flavor name="m1.tiny">
Nov 29 01:39:55 user nova-compute[75210]:     <nova:memory>512</nova:memory>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:disk>1</nova:disk>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:swap>0</nova:swap>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:vcpus>1</nova:vcpus>
Nov 29 01:39:55 user nova-compute[75210]:   </nova:flavor>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:owner>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:user uuid="413fdbcc401e4fd99a537e93fea9eaa4">tempest-TaggedAttachmentsTest-1153284446-project-member</nova:user>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:project uuid="08d017f83b2449c18c70e3dbed78af01">tempest-TaggedAttachmentsTest-1153284446</nova:project>
Nov 29 01:39:55 user nova-compute[75210]:   </nova:owner>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:39:55 user nova-compute[75210]:   <nova:ports>
Nov 29 01:39:55 user nova-compute[75210]:     <nova:port uuid="bddbec43-276a-4a46-a083-2aa153ccd4db">
Nov 29 01:39:55 user nova-compute[75210]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:39:55 user nova-compute[75210]:     </nova:port>
Nov 29 01:39:55 user nova-compute[75210]:   </nova:ports>
Nov 29 01:39:55 user nova-compute[75210]: </nova:instance>
Nov 29 01:39:55 user nova-compute[75210]:   </metadata>
Nov 29 01:39:55 user nova-compute[75210]:   <memory unit='KiB'>524288</memory>
Nov 29 01:39:55 user nova-compute[75210]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 29 01:39:55 user nova-compute[75210]:   <vcpu placement='static'>1</vcpu>
Nov 29 01:39:55 user nova-compute[75210]:   <resource>
Nov 29 01:39:55 user nova-compute[75210]:     <partition>/machine</partition>
Nov 29 01:39:55 user nova-compute[75210]:   </resource>
Nov 29 01:39:55 user nova-compute[75210]:   <sysinfo type='smbios'>
Nov 29 01:39:55 user nova-compute[75210]:     <system>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='product'>OpenStack Nova</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='version'>0.0.0</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='serial'>0d7f5bf7-edc1-465f-b24f-171d1481ffa0</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='uuid'>0d7f5bf7-edc1-465f-b24f-171d1481ffa0</entry>
Nov 29 01:39:55 user nova-compute[75210]:       <entry name='family'>Virtual Machine</entry>
Nov 29 01:39:55 user nova-compute[75210]:     </system>
Nov 29 01:39:55 user nova-compute[75210]:   </sysinfo>
Nov 29 01:39:55 user nova-compute[75210]:   <os>
Nov 29 01:39:55 user nova-compute[75210]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 29 01:39:55 user nova-compute[75210]:     <boot dev='hd'/>
Nov 29 01:39:55 user nova-compute[75210]:     <smbios mode='sysinfo'/>
Nov 29 01:39:55 user nova-compute[75210]:   </os>
Nov 29 01:39:55 user nova-compute[75210]:   <features>
Nov 29 01:39:55 user nova-compute[75210]:     <acpi/>
Nov 29 01:39:55 user nova-compute[75210]:     <apic/>
Nov 29 01:39:55 user nova-compute[75210]:     <vmcoreinfo state='on'/>
Nov 29 01:39:55 user nova-compute[75210]:   </features>
Nov 29 01:39:55 user nova-compute[75210]:   <cpu mode='custom' match='exact' check='full'>
Nov 29 01:39:55 user nova-compute[75210]:     <model fallback='forbid'>Nehalem</model>
Nov 29 01:39:55 user nova-compute[75210]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 29 01:39:55 user nova-compute[75210]:     <feature policy='require' name='vme'/>
Nov 29 01:39:55 user nova-compute[75210]:     <feature policy='require' name='x2apic'/>
Nov 29 01:39:55 user nova-compute[75210]:     <feature policy='require' name='hypervisor'/>
Nov 29 01:39:55 user nova-compute[75210]:   </cpu>
Nov 29 01:39:55 user nova-compute[75210]:   <clock offset='utc'>
Nov 29 01:39:55 user nova-compute[75210]:     <timer name='pit' tickpolicy='delay'/>
Nov 29 01:39:55 user nova-compute[75210]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 29 01:39:55 user nova-compute[75210]:     <timer name='hpet' present='no'/>
Nov 29 01:39:55 user nova-compute[75210]:   </clock>
Nov 29 01:39:55 user nova-compute[75210]:   <on_poweroff>destroy</on_poweroff>
Nov 29 01:39:55 user nova-compute[75210]:   <on_reboot>restart</on_reboot>
Nov 29 01:39:55 user nova-compute[75210]:   <on_crash>destroy</on_crash>
Nov 29 01:39:55 user nova-compute[75210]:   <devices>
Nov 29 01:39:55 user nova-compute[75210]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 29 01:39:55 user nova-compute[75210]:     <disk type='file' device='disk'>
Nov 29 01:39:55 user nova-compute[75210]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 29 01:39:55 user nova-compute[75210]:       <source file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk' index='2'/>
Nov 29 01:39:55 user nova-compute[75210]:       <backingStore type='file' index='3'>
Nov 29 01:39:55 user nova-compute[75210]:         <format type='raw'/>
Nov 29 01:39:55 user nova-compute[75210]:         <source file='/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8'/>
Nov 29 01:39:55 user nova-compute[75210]:         <backingStore/>
Nov 29 01:39:55 user nova-compute[75210]:       </backingStore>
Nov 29 01:39:55 user nova-compute[75210]:       <target dev='vda' bus='virtio'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='virtio-disk0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </disk>
Nov 29 01:39:55 user nova-compute[75210]:     <disk type='file' device='cdrom'>
Nov 29 01:39:55 user nova-compute[75210]:       <driver name='qemu' type='raw' cache='none'/>
Nov 29 01:39:55 user nova-compute[75210]:       <source file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk.config' index='1'/>
Nov 29 01:39:55 user nova-compute[75210]:       <backingStore/>
Nov 29 01:39:55 user nova-compute[75210]:       <target dev='hda' bus='ide'/>
Nov 29 01:39:55 user nova-compute[75210]:       <readonly/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='ide0-0-0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </disk>
Nov 29 01:39:55 user nova-compute[75210]:     <controller type='usb' index='0' model='none'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='usb'/>
Nov 29 01:39:55 user nova-compute[75210]:     </controller>
Nov 29 01:39:55 user nova-compute[75210]:     <controller type='pci' index='0' model='pci-root'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='pci.0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </controller>
Nov 29 01:39:55 user nova-compute[75210]:     <controller type='ide' index='0'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='ide'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 29 01:39:55 user nova-compute[75210]:     </controller>
Nov 29 01:39:55 user nova-compute[75210]:     <interface type='ethernet'>
Nov 29 01:39:55 user nova-compute[75210]:       <mac address='fa:16:3e:00:cd:81'/>
Nov 29 01:39:55 user nova-compute[75210]:       <target dev='tapbddbec43-27'/>
Nov 29 01:39:55 user nova-compute[75210]:       <model type='virtio'/>
Nov 29 01:39:55 user nova-compute[75210]:       <mtu size='1442'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='net0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </interface>
Nov 29 01:39:55 user nova-compute[75210]:     <serial type='pty'>
Nov 29 01:39:55 user nova-compute[75210]:       <source path='/dev/pts/5'/>
Nov 29 01:39:55 user nova-compute[75210]:       <log file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/console.log' append='off'/>
Nov 29 01:39:55 user nova-compute[75210]:       <target type='isa-serial' port='0'>
Nov 29 01:39:55 user nova-compute[75210]:         <model name='isa-serial'/>
Nov 29 01:39:55 user nova-compute[75210]:       </target>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='serial0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </serial>
Nov 29 01:39:55 user nova-compute[75210]:     <console type='pty' tty='/dev/pts/5'>
Nov 29 01:39:55 user nova-compute[75210]:       <source path='/dev/pts/5'/>
Nov 29 01:39:55 user nova-compute[75210]:       <log file='/opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/console.log' append='off'/>
Nov 29 01:39:55 user nova-compute[75210]:       <target type='serial' port='0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='serial0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </console>
Nov 29 01:39:55 user nova-compute[75210]:     <input type='mouse' bus='ps2'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='input0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </input>
Nov 29 01:39:55 user nova-compute[75210]:     <input type='keyboard' bus='ps2'>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='input1'/>
Nov 29 01:39:55 user nova-compute[75210]:     </input>
Nov 29 01:39:55 user nova-compute[75210]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 29 01:39:55 user nova-compute[75210]:       <listen type='address' address='0.0.0.0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </graphics>
Nov 29 01:39:55 user nova-compute[75210]:     <audio id='1' type='none'/>
Nov 29 01:39:55 user nova-compute[75210]:     <video>
Nov 29 01:39:55 user nova-compute[75210]:       <model type='virtio' heads='1' primary='yes'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='video0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </video>
Nov 29 01:39:55 user nova-compute[75210]:     <memballoon model='virtio'>
Nov 29 01:39:55 user nova-compute[75210]:       <stats period='10'/>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='balloon0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </memballoon>
Nov 29 01:39:55 user nova-compute[75210]:     <rng model='virtio'>
Nov 29 01:39:55 user nova-compute[75210]:       <backend model='random'>/dev/urandom</backend>
Nov 29 01:39:55 user nova-compute[75210]:       <alias name='rng0'/>
Nov 29 01:39:55 user nova-compute[75210]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 29 01:39:55 user nova-compute[75210]:     </rng>
Nov 29 01:39:55 user nova-compute[75210]:   </devices>
Nov 29 01:39:55 user nova-compute[75210]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 29 01:39:55 user nova-compute[75210]:     <label>libvirt-0d7f5bf7-edc1-465f-b24f-171d1481ffa0</label>
Nov 29 01:39:55 user nova-compute[75210]:     <imagelabel>libvirt-0d7f5bf7-edc1-465f-b24f-171d1481ffa0</imagelabel>
Nov 29 01:39:55 user nova-compute[75210]:   </seclabel>
Nov 29 01:39:55 user nova-compute[75210]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 29 01:39:55 user nova-compute[75210]:     <label>+64055:+108</label>
Nov 29 01:39:55 user nova-compute[75210]:     <imagelabel>+64055:+108</imagelabel>
Nov 29 01:39:55 user nova-compute[75210]:   </seclabel>
Nov 29 01:39:55 user nova-compute[75210]: </domain>
Nov 29 01:39:55 user nova-compute[75210]:  {{(pid=75210) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 29 01:39:55 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Detaching interface fa:16:3e:f0:09:df failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap181af4a1-39' not found.
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:36:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906023654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906023654',id=6,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmtm9Y/rL28hHvUP7150cqzO8TBgS/8Pwq7X/7Gtilm5Sd870B/ZK7bsEtY2wPDo+rNSG8X+Tp2Avrz3QbtDNgCJe0acCKnqRj8bkYwO8r/0na0wbSxh0PaL89RzsH/pA==',key_name='tempest-keypair-1039804411',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08d017f83b2449c18c70e3dbed78af01',ramdisk_id='',reservation_id='r-c01u2q0f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1153284446',owner_user_name='tempest-TaggedAttachmentsTest-1153284446-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413fdbcc401e4fd99a537e93fea9eaa4',uuid=0d7f5bf7-edc1-465f-b24f-171d1481ffa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.network.os_vif_util [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] Converting VIF {"id": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "address": "fa:16:3e:f0:09:df", "network": {"id": "28cea21a-f823-40a9-8d9c-4bcbf5829b8c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1980156286", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181af4a1-39", "ovs_interfaceid": "181af4a1-3952-4c3c-b58c-c87a89a63bab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG nova.network.os_vif_util [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:df,bridge_name='br-int',has_traffic_filtering=True,id=181af4a1-3952-4c3c-b58c-c87a89a63bab,network=Network(28cea21a-f823-40a9-8d9c-4bcbf5829b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181af4a1-39') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG os_vif [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:df,bridge_name='br-int',has_traffic_filtering=True,id=181af4a1-3952-4c3c-b58c-c87a89a63bab,network=Network(28cea21a-f823-40a9-8d9c-4bcbf5829b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181af4a1-39') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:39:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap181af4a1-39, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:39:56 user nova-compute[75210]: INFO os_vif [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:df,bridge_name='br-int',has_traffic_filtering=True,id=181af4a1-3952-4c3c-b58c-c87a89a63bab,network=Network(28cea21a-f823-40a9-8d9c-4bcbf5829b8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181af4a1-39')
Nov 29 01:39:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [req-f2105ba3-dd43-487b-8a03-7377539df21d req-3004f6aa-8591-452d-a08a-f7713fc50fed service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:39:56 user nova-compute[75210]:   <nova:package version="0.0.0"/>
Nov 29 01:39:56 user nova-compute[75210]:   <nova:name>tempest-device-tagging-server-1906023654</nova:name>
Nov 29 01:39:56 user nova-compute[75210]:   <nova:creationTime>2023-11-29 01:39:55</nova:creationTime>
Nov 29 01:39:56 user nova-compute[75210]:   <nova:flavor name="m1.tiny">
Nov 29 01:39:56 user nova-compute[75210]:     <nova:memory>512</nova:memory>
Nov 29 01:39:56 user nova-compute[75210]:     <nova:disk>1</nova:disk>
Nov 29 01:39:56 user nova-compute[75210]:     <nova:swap>0</nova:swap>
Nov 29 01:39:56 user nova-compute[75210]:     <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:39:56 user nova-compute[75210]:     <nova:vcpus>1</nova:vcpus>
Nov 29 01:39:56 user nova-compute[75210]:   </nova:flavor>
Nov 29 01:39:56 user nova-compute[75210]:   <nova:owner>
Nov 29 01:39:56 user nova-compute[75210]:     <nova:user uuid="413fdbcc401e4fd99a537e93fea9eaa4">tempest-TaggedAttachmentsTest-1153284446-project-member</nova:user>
Nov 29 01:39:56 user nova-compute[75210]:     <nova:project uuid="08d017f83b2449c18c70e3dbed78af01">tempest-TaggedAttachmentsTest-1153284446</nova:project>
Nov 29 01:39:56 user nova-compute[75210]:   </nova:owner>
Nov 29 01:39:56 user nova-compute[75210]:   <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:39:56 user nova-compute[75210]:   <nova:ports>
Nov 29 01:39:56 user nova-compute[75210]:     <nova:port uuid="bddbec43-276a-4a46-a083-2aa153ccd4db">
Nov 29 01:39:56 user nova-compute[75210]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:39:56 user nova-compute[75210]:     </nova:port>
Nov 29 01:39:56 user nova-compute[75210]:   </nova:ports>
Nov 29 01:39:56 user nova-compute[75210]: </nova:instance>
Nov 29 01:39:56 user nova-compute[75210]:  {{(pid=75210) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Updating instance_info_cache with network_info: [{"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Releasing lock "refresh_cache-0d7f5bf7-edc1-465f-b24f-171d1481ffa0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c382335f-746d-4bf1-bc1c-e4df9c430a6b tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "interface-0d7f5bf7-edc1-465f-b24f-171d1481ffa0-181af4a1-3952-4c3c-b58c-c87a89a63bab" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.331s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:39:56 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 is timed out.
Nov 29 01:39:56 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Successfully detached device vdb from instance 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 from the live domain config.
Nov 29 01:39:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vaeouFjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '9fa865ad-bd63-404e-a923-56fa76acb88a'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:39:56 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:39:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9f048a-dc01-4e24-a4a9-c82ad2244fd6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:39:56 user nova-compute[75210]: No targets found.
Nov 29 01:39:56 user nova-compute[75210]: iSNS:
Nov 29 01:39:56 user nova-compute[75210]: No targets found.
Nov 29 01:39:56 user nova-compute[75210]: STATIC:
Nov 29 01:39:56 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:39:56 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:56 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:56 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb
Nov 29 01:39:56 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:56 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:56 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a
Nov 29 01:39:56 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:39:56 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:39:56 user nova-compute[75210]: FIRMWARE:
Nov 29 01:39:56 user nova-compute[75210]: No targets found.
Nov 29 01:39:56 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:39:56 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:39:56 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3736b001-fd00-403f-ab51-2392231165e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17ef896-c2e3-40d7-b877-aadbbcd3a071]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:56 user nova-compute[75210]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:56 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:56 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a (non-flash)
Nov 29 01:39:56 user nova-compute[75210]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:39:56 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:39:56 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e84a85e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:39:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b388c671-ba81-49dd-af30-301f06cf008c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[304f73fc-0a66-471e-abb6-baea1e50b135]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[651f3151-9698-49cc-bd5c-7b6775539cbc]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d8aba7-1f65-4298-9990-b805e58ed87b]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1098caf-30d1-463e-9018-fa875ab4b7ae]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfabe66-11da-4853-b526-c9f9b05f72a9]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260]
Nov 29 01:39:57 user nova-compute[75210]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a, portal: 172.16.0.220,3260] successful.
Nov 29 01:39:57 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa865ad-bd63-404e-a923-56fa76acb88a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee116b0-c697-497d-96ac-63b318104547]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] <== disconnect_volume: return (282ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:39:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:39:58 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lazy-loading 'flavor' on Instance uuid 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:39:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2109fe34-f6f5-4cc1-aeb6-56e3b036d821 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.049s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "0aa70e63-acd6-4aae-8c8d-167dba11168b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:04 user nova-compute[75210]: INFO nova.compute.manager [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Terminating instance
Nov 29 01:40:04 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-b6654de8-67d9-4756-b6ac-66d4061bc418 req-999da4e7-3939-468f-914f-b43498f328cb service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Received event network-vif-unplugged-91f654f9-64a8-4b8c-a298-f847cc840003 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b6654de8-67d9-4756-b6ac-66d4061bc418 req-999da4e7-3939-468f-914f-b43498f328cb service nova] Acquiring lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b6654de8-67d9-4756-b6ac-66d4061bc418 req-999da4e7-3939-468f-914f-b43498f328cb service nova] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b6654de8-67d9-4756-b6ac-66d4061bc418 req-999da4e7-3939-468f-914f-b43498f328cb service nova] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-b6654de8-67d9-4756-b6ac-66d4061bc418 req-999da4e7-3939-468f-914f-b43498f328cb service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] No waiting events found dispatching network-vif-unplugged-91f654f9-64a8-4b8c-a298-f847cc840003 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-b6654de8-67d9-4756-b6ac-66d4061bc418 req-999da4e7-3939-468f-914f-b43498f328cb service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Received event network-vif-unplugged-91f654f9-64a8-4b8c-a298-f847cc840003 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:04 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Instance destroyed successfully.
Nov 29 01:40:04 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lazy-loading 'resources' on Instance uuid 0aa70e63-acd6-4aae-8c8d-167dba11168b {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-810025350',display_name='tempest-ServersNegativeTestJSON-server-810025350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-810025350',id=11,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:38:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faba7aca2be7400e98500e02035788de',ramdisk_id='',reservation_id='r-wabj81tb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1979179804',owner_user_name='tempest-ServersNegativeTestJSON-1979179804-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:38:24Z,user_data=None,user_id='654b0e70c6334fa3906a6e1d9023320f',uuid=0aa70e63-acd6-4aae-8c8d-167dba11168b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91f654f9-64a8-4b8c-a298-f847cc840003", "address": "fa:16:3e:11:ba:37", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f654f9-64", "ovs_interfaceid": "91f654f9-64a8-4b8c-a298-f847cc840003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Converting VIF {"id": "91f654f9-64a8-4b8c-a298-f847cc840003", "address": "fa:16:3e:11:ba:37", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91f654f9-64", "ovs_interfaceid": "91f654f9-64a8-4b8c-a298-f847cc840003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:40:04 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:37,bridge_name='br-int',has_traffic_filtering=True,id=91f654f9-64a8-4b8c-a298-f847cc840003,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f654f9-64') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG os_vif [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:37,bridge_name='br-int',has_traffic_filtering=True,id=91f654f9-64a8-4b8c-a298-f847cc840003,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f654f9-64') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91f654f9-64, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dc531fa-289c-4e0c-9f76-ce080c7d361d) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:05 user nova-compute[75210]: INFO os_vif [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:ba:37,bridge_name='br-int',has_traffic_filtering=True,id=91f654f9-64a8-4b8c-a298-f847cc840003,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91f654f9-64')
Nov 29 01:40:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Deleting instance files /opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b_del
Nov 29 01:40:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Deletion of /opt/stack/data/nova/instances/0aa70e63-acd6-4aae-8c8d-167dba11168b_del complete
Nov 29 01:40:05 user nova-compute[75210]: INFO nova.compute.manager [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 29 01:40:05 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:05 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Took 0.45 seconds to deallocate network for instance.
Nov 29 01:40:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:40:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:06 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Deleted allocations for instance 0aa70e63-acd6-4aae-8c8d-167dba11168b
Nov 29 01:40:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c46699bb-2685-4dee-afaf-3e41a2028d56 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.667s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Acquiring lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Acquiring lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:06 user nova-compute[75210]: INFO nova.compute.manager [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Terminating instance
Nov 29 01:40:06 user nova-compute[75210]: DEBUG nova.compute.manager [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-91b3aa53-2e2d-4f3b-b16f-510ed032eb58 req-0094ef84-3480-4256-bd02-c11bbc6aac29 service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Received event network-vif-plugged-91f654f9-64a8-4b8c-a298-f847cc840003 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-91b3aa53-2e2d-4f3b-b16f-510ed032eb58 req-0094ef84-3480-4256-bd02-c11bbc6aac29 service nova] Acquiring lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-91b3aa53-2e2d-4f3b-b16f-510ed032eb58 req-0094ef84-3480-4256-bd02-c11bbc6aac29 service nova] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-91b3aa53-2e2d-4f3b-b16f-510ed032eb58 req-0094ef84-3480-4256-bd02-c11bbc6aac29 service nova] Lock "0aa70e63-acd6-4aae-8c8d-167dba11168b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-91b3aa53-2e2d-4f3b-b16f-510ed032eb58 req-0094ef84-3480-4256-bd02-c11bbc6aac29 service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] No waiting events found dispatching network-vif-plugged-91f654f9-64a8-4b8c-a298-f847cc840003 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:06 user nova-compute[75210]: WARNING nova.compute.manager [req-91b3aa53-2e2d-4f3b-b16f-510ed032eb58 req-0094ef84-3480-4256-bd02-c11bbc6aac29 service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Received unexpected event network-vif-plugged-91f654f9-64a8-4b8c-a298-f847cc840003 for instance with vm_state deleted and task_state None.
Nov 29 01:40:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-91b3aa53-2e2d-4f3b-b16f-510ed032eb58 req-0094ef84-3480-4256-bd02-c11bbc6aac29 service nova] [instance: 0aa70e63-acd6-4aae-8c8d-167dba11168b] Received event network-vif-deleted-91f654f9-64a8-4b8c-a298-f847cc840003 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Instance destroyed successfully.
Nov 29 01:40:07 user nova-compute[75210]: DEBUG nova.objects.instance [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lazy-loading 'resources' on Instance uuid c8c0c1d8-5241-4204-87f2-c9c20618bb86 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1455427633',display_name='tempest-VolumesAssistedSnapshotsTest-server-1455427633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1455427633',id=7,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjZ2Rw9fJ58hxyIeh1IORaloz/20dIrJegmglcBUdfDUw6SKV0VqUpfh1dGBabj2P8FWbFZLJgjEoCLUnGAb+2BnHOwjful4SlxVGtwW5EcyQv4yD8g/hy0F5RhLbFNiw==',key_name='tempest-keypair-1334843668',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:37:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d144a64090b94fe783113062302ee8b4',ramdisk_id='',reservation_id='r-lmw3tv5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-266577102',owner_user_name='tempest-VolumesAssistedSnapshotsTest-266577102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6244e12a3ac54a04a0070f916f3d6101',uuid=c8c0c1d8-5241-4204-87f2-c9c20618bb86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "address": "fa:16:3e:e4:32:00", "network": {"id": "5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1723418922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d144a64090b94fe783113062302ee8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afee2bd-e2", "ovs_interfaceid": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Converting VIF {"id": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "address": "fa:16:3e:e4:32:00", "network": {"id": "5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1723418922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d144a64090b94fe783113062302ee8b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afee2bd-e2", "ovs_interfaceid": "4afee2bd-e2b5-4da5-8243-b5158582e51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:32:00,bridge_name='br-int',has_traffic_filtering=True,id=4afee2bd-e2b5-4da5-8243-b5158582e51f,network=Network(5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afee2bd-e2') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG os_vif [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:32:00,bridge_name='br-int',has_traffic_filtering=True,id=4afee2bd-e2b5-4da5-8243-b5158582e51f,network=Network(5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afee2bd-e2') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4afee2bd-e2, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbbc440f-76e0-4d0a-a1f3-60e7ed4236bf) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:07 user nova-compute[75210]: INFO os_vif [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:32:00,bridge_name='br-int',has_traffic_filtering=True,id=4afee2bd-e2b5-4da5-8243-b5158582e51f,network=Network(5e1a83a1-7c3b-4805-9ed8-27a7f13a20d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afee2bd-e2')
Nov 29 01:40:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Deleting instance files /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86_del
Nov 29 01:40:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Deletion of /opt/stack/data/nova/instances/c8c0c1d8-5241-4204-87f2-c9c20618bb86_del complete
Nov 29 01:40:07 user nova-compute[75210]: INFO nova.compute.manager [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 01:40:07 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:40:07 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:08 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Took 0.97 seconds to deallocate network for instance.
Nov 29 01:40:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-2ddb6633-223c-406a-a680-38d9654be860 req-80ddfa61-3919-4854-b241-34e21cacfdf5 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Received event network-vif-unplugged-4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2ddb6633-223c-406a-a680-38d9654be860 req-80ddfa61-3919-4854-b241-34e21cacfdf5 service nova] Acquiring lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2ddb6633-223c-406a-a680-38d9654be860 req-80ddfa61-3919-4854-b241-34e21cacfdf5 service nova] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2ddb6633-223c-406a-a680-38d9654be860 req-80ddfa61-3919-4854-b241-34e21cacfdf5 service nova] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-2ddb6633-223c-406a-a680-38d9654be860 req-80ddfa61-3919-4854-b241-34e21cacfdf5 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] No waiting events found dispatching network-vif-unplugged-4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:08 user nova-compute[75210]: WARNING nova.compute.manager [req-2ddb6633-223c-406a-a680-38d9654be860 req-80ddfa61-3919-4854-b241-34e21cacfdf5 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Received unexpected event network-vif-unplugged-4afee2bd-e2b5-4da5-8243-b5158582e51f for instance with vm_state deleted and task_state None.
Nov 29 01:40:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-2ddb6633-223c-406a-a680-38d9654be860 req-80ddfa61-3919-4854-b241-34e21cacfdf5 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Received event network-vif-plugged-4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2ddb6633-223c-406a-a680-38d9654be860 req-80ddfa61-3919-4854-b241-34e21cacfdf5 service nova] Acquiring lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2ddb6633-223c-406a-a680-38d9654be860 req-80ddfa61-3919-4854-b241-34e21cacfdf5 service nova] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2ddb6633-223c-406a-a680-38d9654be860 req-80ddfa61-3919-4854-b241-34e21cacfdf5 service nova] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-2ddb6633-223c-406a-a680-38d9654be860 req-80ddfa61-3919-4854-b241-34e21cacfdf5 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] No waiting events found dispatching network-vif-plugged-4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:08 user nova-compute[75210]: WARNING nova.compute.manager [req-2ddb6633-223c-406a-a680-38d9654be860 req-80ddfa61-3919-4854-b241-34e21cacfdf5 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Received unexpected event network-vif-plugged-4afee2bd-e2b5-4da5-8243-b5158582e51f for instance with vm_state deleted and task_state None.
Nov 29 01:40:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-2ddb6633-223c-406a-a680-38d9654be860 req-80ddfa61-3919-4854-b241-34e21cacfdf5 service nova] [instance: c8c0c1d8-5241-4204-87f2-c9c20618bb86] Received event network-vif-deleted-4afee2bd-e2b5-4da5-8243-b5158582e51f {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:40:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:08 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Deleted allocations for instance c8c0c1d8-5241-4204-87f2-c9c20618bb86
Nov 29 01:40:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb684ae5-cce9-49ee-98f9-94ab1088d51c tempest-VolumesAssistedSnapshotsTest-266577102 tempest-VolumesAssistedSnapshotsTest-266577102-project-member] Lock "c8c0c1d8-5241-4204-87f2-c9c20618bb86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.436s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:40:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:40:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:16 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:40:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:17 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:40:17 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:40:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-6cb707b0-aa06-42ee-abd8-f18d01c7cef9" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:40:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-6cb707b0-aa06-42ee-abd8-f18d01c7cef9" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:40:17 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:40:17 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Updating instance_info_cache with network_info: [{"id": "98e39171-cc87-49a9-ac90-e31419ea55df", "address": "fa:16:3e:dc:86:85", "network": {"id": "7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815609002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ae9a24730042c7804b969aa21d7cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e39171-cc", "ovs_interfaceid": "98e39171-cc87-49a9-ac90-e31419ea55df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-6cb707b0-aa06-42ee-abd8-f18d01c7cef9" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:40:17 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:40:18 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:40:18 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:40:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:18 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:40:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-3fdb3467-a2d5-4022-9173-731801b42214 req-90768dcb-d82a-4360-9e36-c73ebb44e47b service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Received event network-changed-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-3fdb3467-a2d5-4022-9173-731801b42214 req-90768dcb-d82a-4360-9e36-c73ebb44e47b service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Refreshing instance network info cache due to event network-changed-1e0cc60f-9d89-48d2-8bf0-5de1573ee031. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3fdb3467-a2d5-4022-9173-731801b42214 req-90768dcb-d82a-4360-9e36-c73ebb44e47b service nova] Acquiring lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3fdb3467-a2d5-4022-9173-731801b42214 req-90768dcb-d82a-4360-9e36-c73ebb44e47b service nova] Acquired lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG nova.network.neutron [req-3fdb3467-a2d5-4022-9173-731801b42214 req-90768dcb-d82a-4360-9e36-c73ebb44e47b service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Refreshing network info cache for port 1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "a6571012-7707-47bc-a057-905eef9d762a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "a6571012-7707-47bc-a057-905eef9d762a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lazy-loading 'flavor' on Instance uuid a6571012-7707-47bc-a057-905eef9d762a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG nova.network.neutron [req-3fdb3467-a2d5-4022-9173-731801b42214 req-90768dcb-d82a-4360-9e36-c73ebb44e47b service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Updated VIF entry in instance network info cache for port 1e0cc60f-9d89-48d2-8bf0-5de1573ee031. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG nova.network.neutron [req-3fdb3467-a2d5-4022-9173-731801b42214 req-90768dcb-d82a-4360-9e36-c73ebb44e47b service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Updating instance_info_cache with network_info: [{"id": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "address": "fa:16:3e:ab:a3:78", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cc60f-9d", "ovs_interfaceid": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3fdb3467-a2d5-4022-9173-731801b42214 req-90768dcb-d82a-4360-9e36-c73ebb44e47b service nova] Releasing lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "a6571012-7707-47bc-a057-905eef9d762a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "a6571012-7707-47bc-a057-905eef9d762a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "a6571012-7707-47bc-a057-905eef9d762a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.006s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:20 user nova-compute[75210]: INFO nova.compute.manager [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Attaching volume f677d10f-0bbe-41e8-b670-d0fb0d18b4cf to /dev/vdb
Nov 29 01:40:20 user nova-compute[75210]: DEBUG os_brick.utils [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9974e11-6863-4408-a9d1-297c38e9315d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f239528-62f4-4053-ba8b-8735c110f47e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[87512dc3-5991-4f81-a3c6-36ababc70a61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fd076d-6094-4ded-87b1-f11431199205]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:40:20 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:40:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd1b438-52d4-42c2-a0f7-140192c19342]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG os_brick.utils [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:40:20 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Updating existing volume attachment record: 131a90fb-f800-4bf0-9efe-22b6e14499d1 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:40:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:40:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:22 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:40:22 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:40:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7593MB free_disk=25.476078033447266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 18aa0259-a720-42aa-be33-4a676dd4d0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 42760d1a-1d14-47bb-a602-6eb3ed5205d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 088f3f0c-2895-46f9-9697-a48d35a1f6f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 10a92792-5f02-42e5-8012-a022fc717797 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance a6571012-7707-47bc-a057-905eef9d762a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance bf300df0-a62b-4d1d-8b72-86678e2b69fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:40:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:40:23 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:40:23 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:40:23 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:40:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.698s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:40:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:40:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:40:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:40:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:40:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:25 user nova-compute[75210]: INFO nova.compute.manager [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Terminating instance
Nov 29 01:40:25 user nova-compute[75210]: DEBUG nova.compute.manager [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:40:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-360373fd-808b-463f-a8bf-6813e023d377 req-b29f8ee2-f360-4d9d-9a41-cd9c912f5a61 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-vif-unplugged-bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-360373fd-808b-463f-a8bf-6813e023d377 req-b29f8ee2-f360-4d9d-9a41-cd9c912f5a61 service nova] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-360373fd-808b-463f-a8bf-6813e023d377 req-b29f8ee2-f360-4d9d-9a41-cd9c912f5a61 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-360373fd-808b-463f-a8bf-6813e023d377 req-b29f8ee2-f360-4d9d-9a41-cd9c912f5a61 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-360373fd-808b-463f-a8bf-6813e023d377 req-b29f8ee2-f360-4d9d-9a41-cd9c912f5a61 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] No waiting events found dispatching network-vif-unplugged-bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-360373fd-808b-463f-a8bf-6813e023d377 req-b29f8ee2-f360-4d9d-9a41-cd9c912f5a61 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-vif-unplugged-bddbec43-276a-4a46-a083-2aa153ccd4db for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:40:26 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Instance destroyed successfully.
Nov 29 01:40:26 user nova-compute[75210]: DEBUG nova.objects.instance [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lazy-loading 'resources' on Instance uuid 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:36:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906023654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906023654',id=6,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmtm9Y/rL28hHvUP7150cqzO8TBgS/8Pwq7X/7Gtilm5Sd870B/ZK7bsEtY2wPDo+rNSG8X+Tp2Avrz3QbtDNgCJe0acCKnqRj8bkYwO8r/0na0wbSxh0PaL89RzsH/pA==',key_name='tempest-keypair-1039804411',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:37:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08d017f83b2449c18c70e3dbed78af01',ramdisk_id='',reservation_id='r-c01u2q0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1153284446',owner_user_name='tempest-TaggedAttachmentsTest-1153284446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:37:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='413fdbcc401e4fd99a537e93fea9eaa4',uuid=0d7f5bf7-edc1-465f-b24f-171d1481ffa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converting VIF {"id": "bddbec43-276a-4a46-a083-2aa153ccd4db", "address": "fa:16:3e:00:cd:81", "network": {"id": "84bcba04-97bf-40de-b5c5-68a41a393f11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1895782860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d017f83b2449c18c70e3dbed78af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddbec43-27", "ovs_interfaceid": "bddbec43-276a-4a46-a083-2aa153ccd4db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=bddbec43-276a-4a46-a083-2aa153ccd4db,network=Network(84bcba04-97bf-40de-b5c5-68a41a393f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddbec43-27') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG os_vif [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=bddbec43-276a-4a46-a083-2aa153ccd4db,network=Network(84bcba04-97bf-40de-b5c5-68a41a393f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddbec43-27') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbddbec43-27, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d68dda5-6d45-421b-9f53-aec0786d9fd8) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:26 user nova-compute[75210]: INFO os_vif [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=bddbec43-276a-4a46-a083-2aa153ccd4db,network=Network(84bcba04-97bf-40de-b5c5-68a41a393f11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddbec43-27')
Nov 29 01:40:26 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Deleting instance files /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0_del
Nov 29 01:40:26 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Deletion of /opt/stack/data/nova/instances/0d7f5bf7-edc1-465f-b24f-171d1481ffa0_del complete
Nov 29 01:40:26 user nova-compute[75210]: INFO nova.compute.manager [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 01:40:26 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:26 user nova-compute[75210]: INFO nova.compute.manager [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Terminating instance
Nov 29 01:40:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:27 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Instance destroyed successfully.
Nov 29 01:40:27 user nova-compute[75210]: DEBUG nova.objects.instance [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lazy-loading 'resources' on Instance uuid 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1250778166',display_name='tempest-TestVolumeSwap-server-1250778166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1250778166',id=4,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlK+etZe5D6/obD2kuediCpusEN1jvEHUepkxdJj5g3TkbOCUd0+tuiCW22XL1PWipKmFLQy4qMvev2/jGysNJeOZ5MedcpVJ1CJWgY4dJQNza6unhMRYsTFA2V2GfHag==',key_name='tempest-keypair-1839542723',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:36:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68ae9a24730042c7804b969aa21d7cbd',ramdisk_id='',reservation_id='r-r6m13lk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-6984957',owner_user_name='tempest-TestVolumeSwap-6984957-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40bd0a0fcbaa47deac0d46734d73eea1',uuid=6cb707b0-aa06-42ee-abd8-f18d01c7cef9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98e39171-cc87-49a9-ac90-e31419ea55df", "address": "fa:16:3e:dc:86:85", "network": {"id": "7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815609002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ae9a24730042c7804b969aa21d7cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e39171-cc", "ovs_interfaceid": "98e39171-cc87-49a9-ac90-e31419ea55df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Converting VIF {"id": "98e39171-cc87-49a9-ac90-e31419ea55df", "address": "fa:16:3e:dc:86:85", "network": {"id": "7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-815609002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68ae9a24730042c7804b969aa21d7cbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98e39171-cc", "ovs_interfaceid": "98e39171-cc87-49a9-ac90-e31419ea55df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:86:85,bridge_name='br-int',has_traffic_filtering=True,id=98e39171-cc87-49a9-ac90-e31419ea55df,network=Network(7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e39171-cc') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG os_vif [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:86:85,bridge_name='br-int',has_traffic_filtering=True,id=98e39171-cc87-49a9-ac90-e31419ea55df,network=Network(7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e39171-cc') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98e39171-cc, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3984de9-6403-4c73-965e-e66dfaebcc10) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:40:27 user nova-compute[75210]: INFO os_vif [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:86:85,bridge_name='br-int',has_traffic_filtering=True,id=98e39171-cc87-49a9-ac90-e31419ea55df,network=Network(7bd4b0f4-8aff-4e15-a952-f32f7fd6cedd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98e39171-cc')
Nov 29 01:40:27 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Deleting instance files /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9_del
Nov 29 01:40:27 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Deletion of /opt/stack/data/nova/instances/6cb707b0-aa06-42ee-abd8-f18d01c7cef9_del complete
Nov 29 01:40:27 user nova-compute[75210]: INFO nova.compute.manager [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 29 01:40:27 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:40:27 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:28 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Took 1.50 seconds to deallocate network for instance.
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-vif-plugged-bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] Acquiring lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] No waiting events found dispatching network-vif-plugged-bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:28 user nova-compute[75210]: WARNING nova.compute.manager [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received unexpected event network-vif-plugged-bddbec43-276a-4a46-a083-2aa153ccd4db for instance with vm_state active and task_state deleting.
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Received event network-vif-unplugged-98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] Acquiring lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] No waiting events found dispatching network-vif-unplugged-98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Received event network-vif-unplugged-98e39171-cc87-49a9-ac90-e31419ea55df for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Received event network-vif-plugged-98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] Acquiring lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] No waiting events found dispatching network-vif-plugged-98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:28 user nova-compute[75210]: WARNING nova.compute.manager [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Received unexpected event network-vif-plugged-98e39171-cc87-49a9-ac90-e31419ea55df for instance with vm_state active and task_state deleting.
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Received event network-vif-deleted-bddbec43-276a-4a46-a083-2aa153ccd4db {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:28 user nova-compute[75210]: INFO nova.compute.manager [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Neutron deleted interface bddbec43-276a-4a46-a083-2aa153ccd4db; detaching it from the instance and deleting it from the info cache
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.network.neutron [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-761bb615-39fe-429b-afb1-7970f505fdf6 req-a58cacbb-7449-4675-a747-620795b3c4e6 service nova] [instance: 0d7f5bf7-edc1-465f-b24f-171d1481ffa0] Detach interface failed, port_id=bddbec43-276a-4a46-a083-2aa153ccd4db, reason: Instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:28 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Deleted allocations for instance 0d7f5bf7-edc1-465f-b24f-171d1481ffa0
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7aa6e6ee-b37e-4f7a-81a7-af9d510264e2 tempest-TaggedAttachmentsTest-1153284446 tempest-TaggedAttachmentsTest-1153284446-project-member] Lock "0d7f5bf7-edc1-465f-b24f-171d1481ffa0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.056s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBkwNqWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:40:28 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:40:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:40:28 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:40:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:40:28 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e598bef9-5d39-4cde-a758-b50ad98ba43b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:40:28 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-9b8d763e-46db-4e34-92da-adf3246977d5 req-b690a4d3-1362-4587-b9df-282fa5c2b2db service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Received event network-changed-32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-9b8d763e-46db-4e34-92da-adf3246977d5 req-b690a4d3-1362-4587-b9df-282fa5c2b2db service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Refreshing instance network info cache due to event network-changed-32791716-b2e2-4d6f-ab3a-aba08aca4410. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9b8d763e-46db-4e34-92da-adf3246977d5 req-b690a4d3-1362-4587-b9df-282fa5c2b2db service nova] Acquiring lock "refresh_cache-bf300df0-a62b-4d1d-8b72-86678e2b69fc" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9b8d763e-46db-4e34-92da-adf3246977d5 req-b690a4d3-1362-4587-b9df-282fa5c2b2db service nova] Acquired lock "refresh_cache-bf300df0-a62b-4d1d-8b72-86678e2b69fc" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG nova.network.neutron [req-9b8d763e-46db-4e34-92da-adf3246977d5 req-b690a4d3-1362-4587-b9df-282fa5c2b2db service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Refreshing network info cache for port 32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:40:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[401e155c-5664-4c8d-8c01-42b3a4d0aad0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf] added
Nov 29 01:40:29 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[325642e1-88c0-450b-84dc-5da0f1d5c997]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c192e8-2bcf-4cdf-b422-2203bc0d418e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBkwNqWC {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBkwNqWC" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c95aaf-1201-4f53-a938-0dcbb1fd7adf]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pBkwNqWC'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb659be-01d9-4029-8b7c-59dded1d7e95]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dde86f-ab3a-4eaa-9d7c-5bb08b94f1be]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:40:29 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:40:29 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:40:29 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:40:29 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5bc3e9-0546-4b2f-975e-0419e3312e92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf, portal: 172.16.0.220,3260]
Nov 29 01:40:29 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf, portal: 172.16.0.220,3260] successful.
Nov 29 01:40:29 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[debca68d-af07-44dc-ad0d-4b36f188435e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2065738-1c12-4c42-b41c-f1c0e2a221fd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:40:29 user nova-compute[75210]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf (non-flash)
Nov 29 01:40:29 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:40:29 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:40:29 user nova-compute[75210]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf (non-flash)
Nov 29 01:40:29 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:40:29 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7df40a-28aa-49c6-9ff5-30c5f09f76dd]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBkwNqWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG nova.network.neutron [req-9b8d763e-46db-4e34-92da-adf3246977d5 req-b690a4d3-1362-4587-b9df-282fa5c2b2db service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Updated VIF entry in instance network info cache for port 32791716-b2e2-4d6f-ab3a-aba08aca4410. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG nova.network.neutron [req-9b8d763e-46db-4e34-92da-adf3246977d5 req-b690a4d3-1362-4587-b9df-282fa5c2b2db service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Updating instance_info_cache with network_info: [{"id": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "address": "fa:16:3e:80:c9:38", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32791716-b2", "ovs_interfaceid": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9b8d763e-46db-4e34-92da-adf3246977d5 req-b690a4d3-1362-4587-b9df-282fa5c2b2db service nova] Releasing lock "refresh_cache-bf300df0-a62b-4d1d-8b72-86678e2b69fc" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:29 user nova-compute[75210]: INFO nova.compute.manager [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Terminating instance
Nov 29 01:40:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:29 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Took 1.96 seconds to deallocate network for instance.
Nov 29 01:40:29 user nova-compute[75210]: DEBUG nova.compute.manager [req-2aed39f2-7628-4b56-8c9f-e9bee9bab415 req-866f6dec-ff52-4f90-b75e-9b5c21962a7b service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Received event network-vif-deleted-98e39171-cc87-49a9-ac90-e31419ea55df {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:29 user nova-compute[75210]: INFO nova.compute.manager [req-2aed39f2-7628-4b56-8c9f-e9bee9bab415 req-866f6dec-ff52-4f90-b75e-9b5c21962a7b service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Neutron deleted interface 98e39171-cc87-49a9-ac90-e31419ea55df; detaching it from the instance and deleting it from the info cache
Nov 29 01:40:29 user nova-compute[75210]: DEBUG nova.network.neutron [req-2aed39f2-7628-4b56-8c9f-e9bee9bab415 req-866f6dec-ff52-4f90-b75e-9b5c21962a7b service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG nova.compute.manager [req-2aed39f2-7628-4b56-8c9f-e9bee9bab415 req-866f6dec-ff52-4f90-b75e-9b5c21962a7b service nova] [instance: 6cb707b0-aa06-42ee-abd8-f18d01c7cef9] Detach interface failed, port_id=98e39171-cc87-49a9-ac90-e31419ea55df, reason: Instance 6cb707b0-aa06-42ee-abd8-f18d01c7cef9 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26261333331306238', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261333331306238', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lazy-loading 'flavor' on Instance uuid a6571012-7707-47bc-a057-905eef9d762a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:40:30 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:40:30 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:40:30 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:40:30 user nova-compute[75210]:   <serial>f677d10f-0bbe-41e8-b670-d0fb0d18b4cf</serial>
Nov 29 01:40:30 user nova-compute[75210]: </disk>
Nov 29 01:40:30 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:40:30 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Deleted allocations for instance 6cb707b0-aa06-42ee-abd8-f18d01c7cef9
Nov 29 01:40:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe5bdca0-1ce4-424d-aaa2-560c02826da3 tempest-TestVolumeSwap-6984957 tempest-TestVolumeSwap-6984957-project-member] Lock "6cb707b0-aa06-42ee-abd8-f18d01c7cef9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.534s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Instance destroyed successfully.
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.objects.instance [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'resources' on Instance uuid bf300df0-a62b-4d1d-8b72-86678e2b69fc {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:38:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1852680183',display_name='tempest-AttachVolumeNegativeTest-server-1852680183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1852680183',id=13,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRigEceDDGCXedowUGOxQ2ztU6CQgKHyOtuMgWedxdMUQ55ffa2Ex/1Hn01J0G3agcvJhXEmPG6hhgONatKmZKMz1dA4StvcDEm3dEJHdNV6IZ/e6VhgbJX8nWBiCWgKA==',key_name='tempest-keypair-1413432192',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:38:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18f1a3d6f5994f6eb15e0ab2294efd53',ramdisk_id='',reservation_id='r-a28gctyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-648523364',owner_user_name='tempest-AttachVolumeNegativeTest-648523364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:38:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd39b87d15084d84983873b59f36a211',uuid=bf300df0-a62b-4d1d-8b72-86678e2b69fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "address": "fa:16:3e:80:c9:38", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32791716-b2", "ovs_interfaceid": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converting VIF {"id": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "address": "fa:16:3e:80:c9:38", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32791716-b2", "ovs_interfaceid": "32791716-b2e2-4d6f-ab3a-aba08aca4410", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=32791716-b2e2-4d6f-ab3a-aba08aca4410,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32791716-b2') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG os_vif [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=32791716-b2e2-4d6f-ab3a-aba08aca4410,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32791716-b2') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32791716-b2, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c11ad1e2-6f0d-4fc1-bae8-af32c8c93a9e) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:30 user nova-compute[75210]: INFO os_vif [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:c9:38,bridge_name='br-int',has_traffic_filtering=True,id=32791716-b2e2-4d6f-ab3a-aba08aca4410,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32791716-b2')
Nov 29 01:40:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Deleting instance files /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc_del
Nov 29 01:40:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Deletion of /opt/stack/data/nova/instances/bf300df0-a62b-4d1d-8b72-86678e2b69fc_del complete
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] No VIF found with MAC fa:16:3e:ab:a3:78, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:40:30 user nova-compute[75210]: INFO nova.compute.manager [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 29 01:40:30 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:40:30 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:40:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2b0459b5-7764-4886-b56b-64b52e235888 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "a6571012-7707-47bc-a057-905eef9d762a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.348s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-037dcc90-b4d4-41f8-a985-4dfefb6fabe7 req-0da4f05e-002c-49bf-8f9b-d563fc477ced service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Received event network-vif-unplugged-32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-037dcc90-b4d4-41f8-a985-4dfefb6fabe7 req-0da4f05e-002c-49bf-8f9b-d563fc477ced service nova] Acquiring lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-037dcc90-b4d4-41f8-a985-4dfefb6fabe7 req-0da4f05e-002c-49bf-8f9b-d563fc477ced service nova] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-037dcc90-b4d4-41f8-a985-4dfefb6fabe7 req-0da4f05e-002c-49bf-8f9b-d563fc477ced service nova] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-037dcc90-b4d4-41f8-a985-4dfefb6fabe7 req-0da4f05e-002c-49bf-8f9b-d563fc477ced service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] No waiting events found dispatching network-vif-unplugged-32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-037dcc90-b4d4-41f8-a985-4dfefb6fabe7 req-0da4f05e-002c-49bf-8f9b-d563fc477ced service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Received event network-vif-unplugged-32791716-b2e2-4d6f-ab3a-aba08aca4410 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:40:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-037dcc90-b4d4-41f8-a985-4dfefb6fabe7 req-0da4f05e-002c-49bf-8f9b-d563fc477ced service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Received event network-vif-plugged-32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-037dcc90-b4d4-41f8-a985-4dfefb6fabe7 req-0da4f05e-002c-49bf-8f9b-d563fc477ced service nova] Acquiring lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-037dcc90-b4d4-41f8-a985-4dfefb6fabe7 req-0da4f05e-002c-49bf-8f9b-d563fc477ced service nova] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-037dcc90-b4d4-41f8-a985-4dfefb6fabe7 req-0da4f05e-002c-49bf-8f9b-d563fc477ced service nova] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-037dcc90-b4d4-41f8-a985-4dfefb6fabe7 req-0da4f05e-002c-49bf-8f9b-d563fc477ced service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] No waiting events found dispatching network-vif-plugged-32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:31 user nova-compute[75210]: WARNING nova.compute.manager [req-037dcc90-b4d4-41f8-a985-4dfefb6fabe7 req-0da4f05e-002c-49bf-8f9b-d563fc477ced service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Received unexpected event network-vif-plugged-32791716-b2e2-4d6f-ab3a-aba08aca4410 for instance with vm_state active and task_state deleting.
Nov 29 01:40:32 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:32 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Took 1.34 seconds to deallocate network for instance.
Nov 29 01:40:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:32 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:40:32 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:40:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:32 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Deleted allocations for instance bf300df0-a62b-4d1d-8b72-86678e2b69fc
Nov 29 01:40:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-724c6d27-09e5-4093-8144-77f2adfd52c8 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "bf300df0-a62b-4d1d-8b72-86678e2b69fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.190s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "a6571012-7707-47bc-a057-905eef9d762a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "a6571012-7707-47bc-a057-905eef9d762a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:33 user nova-compute[75210]: INFO nova.compute.manager [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Detaching volume f677d10f-0bbe-41e8-b670-d0fb0d18b4cf
Nov 29 01:40:33 user nova-compute[75210]: INFO nova.virt.block_device [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Attempting to driver detach volume f677d10f-0bbe-41e8-b670-d0fb0d18b4cf from mountpoint /dev/vdb
Nov 29 01:40:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Attempting to detach device vdb from instance a6571012-7707-47bc-a057-905eef9d762a from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:40:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:40:33 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:40:33 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:40:33 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:40:33 user nova-compute[75210]:   <serial>f677d10f-0bbe-41e8-b670-d0fb0d18b4cf</serial>
Nov 29 01:40:33 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:40:33 user nova-compute[75210]: </disk>
Nov 29 01:40:33 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:40:33 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Successfully detached device vdb from instance a6571012-7707-47bc-a057-905eef9d762a from the persistent domain config.
Nov 29 01:40:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6571012-7707-47bc-a057-905eef9d762a from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:40:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:40:33 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:40:33 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:40:33 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:40:33 user nova-compute[75210]:   <serial>f677d10f-0bbe-41e8-b670-d0fb0d18b4cf</serial>
Nov 29 01:40:33 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:40:33 user nova-compute[75210]: </disk>
Nov 29 01:40:33 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:40:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-a3fdb8e5-3322-408e-9618-6fffef1c8d48 req-82ead088-ae6a-4e41-9aec-3e6ca543152e service nova] [instance: bf300df0-a62b-4d1d-8b72-86678e2b69fc] Received event network-vif-deleted-32791716-b2e2-4d6f-ab3a-aba08aca4410 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6571012-7707-47bc-a057-905eef9d762a {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:40:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "996b4364-9920-4b91-8a06-0b6f2c138aab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:46 user nova-compute[75210]: DEBUG nova.compute.manager [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:40:47 user nova-compute[75210]: INFO nova.compute.claims [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Claim successful on node user
Nov 29 01:40:47 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG nova.network.neutron [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:40:47 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:40:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG nova.policy [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28fd6f01158e4dd7a7df3e04e815a9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34af8bfc0e1b4cbbb803c3bf6a8f7715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:40:47 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Creating image(s)
Nov 29 01:40:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "/opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "/opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "/opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk 1073741824" returned: 0 in 0.069s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Successfully created port: 7dba9f4e-29b3-4b8b-94e3-70b343004fcb {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Cannot resize image /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Ensure instance console log exists: /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Successfully updated port: 7dba9f4e-29b3-4b8b-94e3-70b343004fcb {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquired lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG nova.compute.manager [req-504b684e-a9da-4404-b27f-8758e76f91b5 req-7fd82f6b-9d4a-4650-90b4-d2139fbbe45b service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Received event network-changed-7dba9f4e-29b3-4b8b-94e3-70b343004fcb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG nova.compute.manager [req-504b684e-a9da-4404-b27f-8758e76f91b5 req-7fd82f6b-9d4a-4650-90b4-d2139fbbe45b service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Refreshing instance network info cache due to event network-changed-7dba9f4e-29b3-4b8b-94e3-70b343004fcb. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-504b684e-a9da-4404-b27f-8758e76f91b5 req-7fd82f6b-9d4a-4650-90b4-d2139fbbe45b service nova] Acquiring lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:40:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Updating instance_info_cache with network_info: [{"id": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "address": "fa:16:3e:e0:7c:09", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dba9f4e-29", "ovs_interfaceid": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Releasing lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.compute.manager [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Instance network_info: |[{"id": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "address": "fa:16:3e:e0:7c:09", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dba9f4e-29", "ovs_interfaceid": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-504b684e-a9da-4404-b27f-8758e76f91b5 req-7fd82f6b-9d4a-4650-90b4-d2139fbbe45b service nova] Acquired lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.network.neutron [req-504b684e-a9da-4404-b27f-8758e76f91b5 req-7fd82f6b-9d4a-4650-90b4-d2139fbbe45b service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Refreshing network info cache for port 7dba9f4e-29b3-4b8b-94e3-70b343004fcb {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Start _get_guest_xml network_info=[{"id": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "address": "fa:16:3e:e0:7c:09", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dba9f4e-29", "ovs_interfaceid": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:40:49 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:40:49 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1597633535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1597633535',id=15,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-4hnwwrkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:40:48Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=996b4364-9920-4b91-8a06-0b6f2c138aab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "address": "fa:16:3e:e0:7c:09", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dba9f4e-29", "ovs_interfaceid": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "address": "fa:16:3e:e0:7c:09", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dba9f4e-29", "ovs_interfaceid": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7c:09,bridge_name='br-int',has_traffic_filtering=True,id=7dba9f4e-29b3-4b8b-94e3-70b343004fcb,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dba9f4e-29') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.objects.instance [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'pci_devices' on Instance uuid 996b4364-9920-4b91-8a06-0b6f2c138aab {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:40:49 user nova-compute[75210]:   <uuid>996b4364-9920-4b91-8a06-0b6f2c138aab</uuid>
Nov 29 01:40:49 user nova-compute[75210]:   <name>instance-0000000f</name>
Nov 29 01:40:49 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:40:49 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:40:49 user nova-compute[75210]:   <metadata>
Nov 29 01:40:49 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:40:49 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:40:49 user nova-compute[75210]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1597633535</nova:name>
Nov 29 01:40:49 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:40:49</nova:creationTime>
Nov 29 01:40:49 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:40:49 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:40:49 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:40:49 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:40:49 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:40:49 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:40:49 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:40:49 user nova-compute[75210]:       <nova:owner>
Nov 29 01:40:49 user nova-compute[75210]:         <nova:user uuid="28fd6f01158e4dd7a7df3e04e815a9d0">tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member</nova:user>
Nov 29 01:40:49 user nova-compute[75210]:         <nova:project uuid="34af8bfc0e1b4cbbb803c3bf6a8f7715">tempest-ServerBootFromVolumeStableRescueTest-440893694</nova:project>
Nov 29 01:40:49 user nova-compute[75210]:       </nova:owner>
Nov 29 01:40:49 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:40:49 user nova-compute[75210]:       <nova:ports>
Nov 29 01:40:49 user nova-compute[75210]:         <nova:port uuid="7dba9f4e-29b3-4b8b-94e3-70b343004fcb">
Nov 29 01:40:49 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 01:40:49 user nova-compute[75210]:         </nova:port>
Nov 29 01:40:49 user nova-compute[75210]:       </nova:ports>
Nov 29 01:40:49 user nova-compute[75210]:     </nova:instance>
Nov 29 01:40:49 user nova-compute[75210]:   </metadata>
Nov 29 01:40:49 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:40:49 user nova-compute[75210]:     <system>
Nov 29 01:40:49 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:40:49 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:40:49 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:40:49 user nova-compute[75210]:       <entry name="serial">996b4364-9920-4b91-8a06-0b6f2c138aab</entry>
Nov 29 01:40:49 user nova-compute[75210]:       <entry name="uuid">996b4364-9920-4b91-8a06-0b6f2c138aab</entry>
Nov 29 01:40:49 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:40:49 user nova-compute[75210]:     </system>
Nov 29 01:40:49 user nova-compute[75210]:   </sysinfo>
Nov 29 01:40:49 user nova-compute[75210]:   <os>
Nov 29 01:40:49 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:40:49 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:40:49 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:40:49 user nova-compute[75210]:   </os>
Nov 29 01:40:49 user nova-compute[75210]:   <features>
Nov 29 01:40:49 user nova-compute[75210]:     <acpi/>
Nov 29 01:40:49 user nova-compute[75210]:     <apic/>
Nov 29 01:40:49 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:40:49 user nova-compute[75210]:   </features>
Nov 29 01:40:49 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:40:49 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:40:49 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:40:49 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:40:49 user nova-compute[75210]:   </clock>
Nov 29 01:40:49 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:40:49 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:40:49 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:40:49 user nova-compute[75210]:   </cpu>
Nov 29 01:40:49 user nova-compute[75210]:   <devices>
Nov 29 01:40:49 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:40:49 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:40:49 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk"/>
Nov 29 01:40:49 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:40:49 user nova-compute[75210]:     </disk>
Nov 29 01:40:49 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:40:49 user nova-compute[75210]:       <mac address="fa:16:3e:e0:7c:09"/>
Nov 29 01:40:49 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:40:49 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:40:49 user nova-compute[75210]:       <target dev="tap7dba9f4e-29"/>
Nov 29 01:40:49 user nova-compute[75210]:     </interface>
Nov 29 01:40:49 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:40:49 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/console.log" append="off"/>
Nov 29 01:40:49 user nova-compute[75210]:     </serial>
Nov 29 01:40:49 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:40:49 user nova-compute[75210]:     <video>
Nov 29 01:40:49 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:40:49 user nova-compute[75210]:     </video>
Nov 29 01:40:49 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:40:49 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:40:49 user nova-compute[75210]:     </rng>
Nov 29 01:40:49 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:40:49 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:40:49 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:40:49 user nova-compute[75210]:     </memballoon>
Nov 29 01:40:49 user nova-compute[75210]:   </devices>
Nov 29 01:40:49 user nova-compute[75210]: </domain>
Nov 29 01:40:49 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1597633535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1597633535',id=15,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-4hnwwrkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:40:48Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=996b4364-9920-4b91-8a06-0b6f2c138aab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "address": "fa:16:3e:e0:7c:09", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dba9f4e-29", "ovs_interfaceid": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "address": "fa:16:3e:e0:7c:09", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dba9f4e-29", "ovs_interfaceid": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7c:09,bridge_name='br-int',has_traffic_filtering=True,id=7dba9f4e-29b3-4b8b-94e3-70b343004fcb,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dba9f4e-29') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG os_vif [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7c:09,bridge_name='br-int',has_traffic_filtering=True,id=7dba9f4e-29b3-4b8b-94e3-70b343004fcb,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dba9f4e-29') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f604a36-019a-5a11-9a21-f9a886ada194', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dba9f4e-29, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7dba9f4e-29, col_values=(('qos', UUID('bec944cf-6a7c-48cb-9d91-414c77a5a647')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7dba9f4e-29, col_values=(('external_ids', {'iface-id': '7dba9f4e-29b3-4b8b-94e3-70b343004fcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:7c:09', 'vm-uuid': '996b4364-9920-4b91-8a06-0b6f2c138aab'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:49 user nova-compute[75210]: INFO os_vif [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7c:09,bridge_name='br-int',has_traffic_filtering=True,id=7dba9f4e-29b3-4b8b-94e3-70b343004fcb,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dba9f4e-29')
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No VIF found with MAC fa:16:3e:e0:7c:09, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.network.neutron [req-504b684e-a9da-4404-b27f-8758e76f91b5 req-7fd82f6b-9d4a-4650-90b4-d2139fbbe45b service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Updated VIF entry in instance network info cache for port 7dba9f4e-29b3-4b8b-94e3-70b343004fcb. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.network.neutron [req-504b684e-a9da-4404-b27f-8758e76f91b5 req-7fd82f6b-9d4a-4650-90b4-d2139fbbe45b service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Updating instance_info_cache with network_info: [{"id": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "address": "fa:16:3e:e0:7c:09", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dba9f4e-29", "ovs_interfaceid": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-504b684e-a9da-4404-b27f-8758e76f91b5 req-7fd82f6b-9d4a-4650-90b4-d2139fbbe45b service nova] Releasing lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "10a92792-5f02-42e5-8012-a022fc717797" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "10a92792-5f02-42e5-8012-a022fc717797" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "10a92792-5f02-42e5-8012-a022fc717797-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:49 user nova-compute[75210]: INFO nova.compute.manager [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Terminating instance
Nov 29 01:40:49 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-c8b39095-a5e5-4be5-ac28-6fa06c399355 req-8f69cdad-9a8c-4465-9c68-e741c5566d20 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received event network-vif-unplugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c8b39095-a5e5-4be5-ac28-6fa06c399355 req-8f69cdad-9a8c-4465-9c68-e741c5566d20 service nova] Acquiring lock "10a92792-5f02-42e5-8012-a022fc717797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c8b39095-a5e5-4be5-ac28-6fa06c399355 req-8f69cdad-9a8c-4465-9c68-e741c5566d20 service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c8b39095-a5e5-4be5-ac28-6fa06c399355 req-8f69cdad-9a8c-4465-9c68-e741c5566d20 service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-c8b39095-a5e5-4be5-ac28-6fa06c399355 req-8f69cdad-9a8c-4465-9c68-e741c5566d20 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] No waiting events found dispatching network-vif-unplugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-c8b39095-a5e5-4be5-ac28-6fa06c399355 req-8f69cdad-9a8c-4465-9c68-e741c5566d20 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received event network-vif-unplugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:40:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:51 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Instance destroyed successfully.
Nov 29 01:40:51 user nova-compute[75210]: DEBUG nova.objects.instance [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lazy-loading 'resources' on Instance uuid 10a92792-5f02-42e5-8012-a022fc717797 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T01:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2066306463',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-270978347',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGU0DOtHsgsIIlh0yZXrpDNtdGQqQOnDnHoYuM6y1g9Epjtm7yg8pFsSH/xmwlmyR3J6FK80EjbFlCtWmdPs07pGLRnJSll8hIizePLsEmCf5a2RfdkfGukgo+XphH4Xw==',key_name='tempest-keypair-496495817',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:39:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d20161f567a4c50956fda3ec66ea74b',ramdisk_id='',reservation_id='r-eq4oj3h7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-974565393',owner_user_name='tempest-ServerActionsV293TestJSON-974565393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:39:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed9ecba6c9944ba5804dc45e4e107f08',uuid=10a92792-5f02-42e5-8012-a022fc717797,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Converting VIF {"id": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "address": "fa:16:3e:2a:a4:15", "network": {"id": "5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1600653104-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d20161f567a4c50956fda3ec66ea74b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0fd23c3-61", "ovs_interfaceid": "c0fd23c3-6145-4950-ac75-4af31b96ed5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_vif [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0fd23c3-61, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2e156f6-da66-4cd7-b804-49770f9ae06d) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:51 user nova-compute[75210]: INFO os_vif [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:a4:15,bridge_name='br-int',has_traffic_filtering=True,id=c0fd23c3-6145-4950-ac75-4af31b96ed5e,network=Network(5bd1b01d-b8f0-4dc2-8dfb-6fdbd260b9a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0fd23c3-61')
Nov 29 01:40:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUIVBpEv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:40:51 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00f4230-2552-45de-a178-05c761d2a1a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:40:51 user nova-compute[75210]: No targets found.
Nov 29 01:40:51 user nova-compute[75210]: iSNS:
Nov 29 01:40:51 user nova-compute[75210]: No targets found.
Nov 29 01:40:51 user nova-compute[75210]: STATIC:
Nov 29 01:40:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:40:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:40:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:40:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb
Nov 29 01:40:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:40:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:40:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf
Nov 29 01:40:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:40:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:40:51 user nova-compute[75210]: FIRMWARE:
Nov 29 01:40:51 user nova-compute[75210]: No targets found.
Nov 29 01:40:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:40:51 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:40:51 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c1cab3-f535-44e2-b2ab-2c3992eb7f46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b935ea-e1c8-4c0d-bd54-e25f38233524]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:40:51 user nova-compute[75210]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf (non-flash)
Nov 29 01:40:51 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:40:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb (non-flash)
Nov 29 01:40:51 user nova-compute[75210]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf (non-flash)
Nov 29 01:40:51 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:40:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f2f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[647f8bb0-1535-4126-a7d4-707e7ba02409]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac230d2a-3b2a-4628-a95e-d5394bc01925]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e2e1dc-8aee-4ff6-8659-0db1fdbb3e26]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cf077a-7d5c-42cb-aadb-ec3c3cd9fe3f]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2cfff7-4099-4c39-a14e-bc63826c8b3b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f6d723-5c50-4924-a141-a6c749ce7193]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260]
Nov 29 01:40:51 user nova-compute[75210]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb, portal: 172.16.0.220,3260] successful.
Nov 29 01:40:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-74eb141c-0010-4597-9496-630970f8226c req-46700207-5628-4fbe-80cd-f4340ca39cf8 service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Received event network-vif-plugged-7dba9f4e-29b3-4b8b-94e3-70b343004fcb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-74eb141c-0010-4597-9496-630970f8226c req-46700207-5628-4fbe-80cd-f4340ca39cf8 service nova] Acquiring lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-74eb141c-0010-4597-9496-630970f8226c req-46700207-5628-4fbe-80cd-f4340ca39cf8 service nova] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-74eb141c-0010-4597-9496-630970f8226c req-46700207-5628-4fbe-80cd-f4340ca39cf8 service nova] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-74eb141c-0010-4597-9496-630970f8226c req-46700207-5628-4fbe-80cd-f4340ca39cf8 service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] No waiting events found dispatching network-vif-plugged-7dba9f4e-29b3-4b8b-94e3-70b343004fcb {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:51 user nova-compute[75210]: WARNING nova.compute.manager [req-74eb141c-0010-4597-9496-630970f8226c req-46700207-5628-4fbe-80cd-f4340ca39cf8 service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Received unexpected event network-vif-plugged-7dba9f4e-29b3-4b8b-94e3-70b343004fcb for instance with vm_state building and task_state spawning.
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f315778-a694-4266-8fec-4d9cc29e76bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[51951cce-06d0-4b65-8da4-ee718642804a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] <== disconnect_volume: return (387ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:40:51 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Deleting instance files /opt/stack/data/nova/instances/10a92792-5f02-42e5-8012-a022fc717797_del
Nov 29 01:40:51 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Deletion of /opt/stack/data/nova/instances/10a92792-5f02-42e5-8012-a022fc717797_del complete
Nov 29 01:40:51 user nova-compute[75210]: INFO nova.compute.manager [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Took 2.10 seconds to destroy the instance on the hypervisor.
Nov 29 01:40:51 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 10a92792-5f02-42e5-8012-a022fc717797] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:40:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-e72ca11c-a0f0-4b88-a92e-96c2f2fb7c11 req-fea28e94-f27a-48a5-9963-271ef652f842 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received event network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e72ca11c-a0f0-4b88-a92e-96c2f2fb7c11 req-fea28e94-f27a-48a5-9963-271ef652f842 service nova] Acquiring lock "10a92792-5f02-42e5-8012-a022fc717797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e72ca11c-a0f0-4b88-a92e-96c2f2fb7c11 req-fea28e94-f27a-48a5-9963-271ef652f842 service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e72ca11c-a0f0-4b88-a92e-96c2f2fb7c11 req-fea28e94-f27a-48a5-9963-271ef652f842 service nova] Lock "10a92792-5f02-42e5-8012-a022fc717797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-e72ca11c-a0f0-4b88-a92e-96c2f2fb7c11 req-fea28e94-f27a-48a5-9963-271ef652f842 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] No waiting events found dispatching network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:52 user nova-compute[75210]: WARNING nova.compute.manager [req-e72ca11c-a0f0-4b88-a92e-96c2f2fb7c11 req-fea28e94-f27a-48a5-9963-271ef652f842 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received unexpected event network-vif-plugged-c0fd23c3-6145-4950-ac75-4af31b96ed5e for instance with vm_state active and task_state deleting.
Nov 29 01:40:52 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:52 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Took 0.66 seconds to deallocate network for instance.
Nov 29 01:40:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-848e7dc5-37ce-45c1-aca6-86b7c49adb80 req-9de39df8-be24-4292-a239-5681ee9aa021 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Received event network-vif-deleted-c0fd23c3-6145-4950-ac75-4af31b96ed5e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:52 user nova-compute[75210]: INFO nova.compute.manager [req-848e7dc5-37ce-45c1-aca6-86b7c49adb80 req-9de39df8-be24-4292-a239-5681ee9aa021 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Neutron deleted interface c0fd23c3-6145-4950-ac75-4af31b96ed5e; detaching it from the instance and deleting it from the info cache
Nov 29 01:40:52 user nova-compute[75210]: DEBUG nova.network.neutron [req-848e7dc5-37ce-45c1-aca6-86b7c49adb80 req-9de39df8-be24-4292-a239-5681ee9aa021 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:40:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-848e7dc5-37ce-45c1-aca6-86b7c49adb80 req-9de39df8-be24-4292-a239-5681ee9aa021 service nova] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Detach interface failed, port_id=c0fd23c3-6145-4950-ac75-4af31b96ed5e, reason: Instance 10a92792-5f02-42e5-8012-a022fc717797 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:40:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:53 user nova-compute[75210]: INFO nova.compute.manager [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Took 1.00 seconds to detach 1 volumes for instance.
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] [instance: 10a92792-5f02-42e5-8012-a022fc717797] Deleting volume: 9f315778-a694-4266-8fec-4d9cc29e76bb {{(pid=75210) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:40:53 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Instance spawned successfully.
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:53 user nova-compute[75210]: INFO nova.compute.manager [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.compute.manager [req-73d1e2fd-58ee-487c-9536-f426877c2f8d req-c254d1c1-6d28-4fa2-9749-cc693299439f service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Received event network-vif-plugged-7dba9f4e-29b3-4b8b-94e3-70b343004fcb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-73d1e2fd-58ee-487c-9536-f426877c2f8d req-c254d1c1-6d28-4fa2-9749-cc693299439f service nova] Acquiring lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-73d1e2fd-58ee-487c-9536-f426877c2f8d req-c254d1c1-6d28-4fa2-9749-cc693299439f service nova] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-73d1e2fd-58ee-487c-9536-f426877c2f8d req-c254d1c1-6d28-4fa2-9749-cc693299439f service nova] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.compute.manager [req-73d1e2fd-58ee-487c-9536-f426877c2f8d req-c254d1c1-6d28-4fa2-9749-cc693299439f service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] No waiting events found dispatching network-vif-plugged-7dba9f4e-29b3-4b8b-94e3-70b343004fcb {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:40:53 user nova-compute[75210]: WARNING nova.compute.manager [req-73d1e2fd-58ee-487c-9536-f426877c2f8d req-c254d1c1-6d28-4fa2-9749-cc693299439f service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Received unexpected event network-vif-plugged-7dba9f4e-29b3-4b8b-94e3-70b343004fcb for instance with vm_state building and task_state spawning.
Nov 29 01:40:53 user nova-compute[75210]: INFO nova.compute.manager [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Took 6.84 seconds to build instance.
Nov 29 01:40:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-876799d0-cf22-4a0f-9c2f-448877fb8342 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.944s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:40:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:54 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Deleted allocations for instance 10a92792-5f02-42e5-8012-a022fc717797
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1e616a34-a23d-4a7a-ba95-89e636021eda tempest-ServerActionsV293TestJSON-974565393 tempest-ServerActionsV293TestJSON-974565393-project-member] Lock "10a92792-5f02-42e5-8012-a022fc717797" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.363s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:54 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6571012-7707-47bc-a057-905eef9d762a is timed out.
Nov 29 01:40:54 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Successfully detached device vdb from instance a6571012-7707-47bc-a057-905eef9d762a from the live domain config.
Nov 29 01:40:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBkwNqWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:40:54 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ceb130-50c8-49b9-a452-91bd963b5061]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:40:54 user nova-compute[75210]: No targets found.
Nov 29 01:40:54 user nova-compute[75210]: iSNS:
Nov 29 01:40:54 user nova-compute[75210]: No targets found.
Nov 29 01:40:54 user nova-compute[75210]: STATIC:
Nov 29 01:40:54 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:40:54 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:40:54 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:40:54 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf
Nov 29 01:40:54 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:40:54 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:40:54 user nova-compute[75210]: FIRMWARE:
Nov 29 01:40:54 user nova-compute[75210]: No targets found.
Nov 29 01:40:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:40:54 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:40:54 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e9938e-dab9-45e6-bb49-6b086cd78c25]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3988363-4732-4af9-ae28-13d3fa351673]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf (non-flash)
Nov 29 01:40:54 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:40:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf (non-flash)
Nov 29 01:40:54 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:40:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f1ea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bc56f6-7830-42f2-a1cf-d763599d83b3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8deefa7-ab86-4b13-a341-6516bcbad1c8]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa67921c-ea68-44f4-bdf9-b79864227fcc]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c2809b-3fe5-4b0d-9714-25a418b00415]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c299314f-4585-4169-9a6e-2799e267deff]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9db5d51-c80e-4aa0-861b-8e0c336d889e]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf, portal: 172.16.0.220,3260]
Nov 29 01:40:54 user nova-compute[75210]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf, portal: 172.16.0.220,3260] successful.
Nov 29 01:40:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f677d10f-0bbe-41e8-b670-d0fb0d18b4cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d531e06a-3d44-44d1-9158-101804b1f488]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] <== disconnect_volume: return (329ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:40:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:40:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:56 user nova-compute[75210]: DEBUG nova.objects.instance [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lazy-loading 'flavor' on Instance uuid a6571012-7707-47bc-a057-905eef9d762a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:40:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-384912ff-b8dc-4b0a-b3f1-e6d5f56970b5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "a6571012-7707-47bc-a057-905eef9d762a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.299s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:40:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:40:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:41:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:41:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:16 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:41:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:18 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:41:18 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:41:18 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Didn't find any instances for network info cache update. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 01:41:19 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:41:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:19 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:41:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:22 user nova-compute[75210]: INFO nova.compute.manager [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Detaching volume 1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:41:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:22 user nova-compute[75210]: INFO nova.virt.block_device [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Attempting to driver detach volume 1276decd-1dec-4a6d-924e-45bdcad8896a from mountpoint /dev/vdb
Nov 29 01:41:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Attempting to detach device vdb from instance 42760d1a-1d14-47bb-a602-6eb3ed5205d4 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:41:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:41:22 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:41:22 user nova-compute[75210]:   <source dev="/dev/sdf"/>
Nov 29 01:41:22 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:41:22 user nova-compute[75210]:   <serial>1276decd-1dec-4a6d-924e-45bdcad8896a</serial>
Nov 29 01:41:22 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:41:22 user nova-compute[75210]: </disk>
Nov 29 01:41:22 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:41:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:22 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully detached device vdb from instance 42760d1a-1d14-47bb-a602-6eb3ed5205d4 from the persistent domain config.
Nov 29 01:41:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42760d1a-1d14-47bb-a602-6eb3ed5205d4 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:41:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:41:22 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:41:22 user nova-compute[75210]:   <source dev="/dev/sdf"/>
Nov 29 01:41:22 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:41:22 user nova-compute[75210]:   <serial>1276decd-1dec-4a6d-924e-45bdcad8896a</serial>
Nov 29 01:41:22 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:41:22 user nova-compute[75210]: </disk>
Nov 29 01:41:22 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:41:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42760d1a-1d14-47bb-a602-6eb3ed5205d4 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:41:22 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:41:22 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:41:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8035MB free_disk=25.555984497070312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:41:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:23 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 18aa0259-a720-42aa-be33-4a676dd4d0e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:41:23 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 42760d1a-1d14-47bb-a602-6eb3ed5205d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:41:23 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 088f3f0c-2895-46f9-9697-a48d35a1f6f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:41:23 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance a6571012-7707-47bc-a057-905eef9d762a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:41:23 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:41:23 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:41:23 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:41:23 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:41:23 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:41:23 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:41:23 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:41:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:25 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:41:25 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:41:25 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:41:25 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:41:25 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:41:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:41:29 user nova-compute[75210]: INFO nova.compute.manager [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] instance snapshotting
Nov 29 01:41:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Beginning live snapshot process
Nov 29 01:41:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json -f qcow2 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json -f qcow2 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.217s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0vj7cz9n/64576b66f34d48dba32cc51fd0737765.delta 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0vj7cz9n/64576b66f34d48dba32cc51fd0737765.delta 1073741824" returned: 0 in 0.058s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 01:41:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] COPY block job progress, current cursor: 393216 final cursor: 75563008 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:41:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:41:32 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 01:41:32 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 01:41:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0vj7cz9n/64576b66f34d48dba32cc51fd0737765.delta /opt/stack/data/nova/instances/snapshots/tmp0vj7cz9n/64576b66f34d48dba32cc51fd0737765 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0vj7cz9n/64576b66f34d48dba32cc51fd0737765.delta /opt/stack/data/nova/instances/snapshots/tmp0vj7cz9n/64576b66f34d48dba32cc51fd0737765" returned: 0 in 0.561s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:32 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Snapshot extracted, beginning image upload
Nov 29 01:41:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:41:36 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Snapshot image upload complete
Nov 29 01:41:36 user nova-compute[75210]: INFO nova.compute.manager [None req-cc16347a-45c2-4ba9-a933-128e56c70a9f tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Took 6.80 seconds to snapshot the instance on the hypervisor.
Nov 29 01:41:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:39 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:41:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:39 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:41:39 user nova-compute[75210]: INFO nova.compute.claims [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Claim successful on node user
Nov 29 01:41:39 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:41:39 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:41:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:39 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:41:39 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:41:39 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:41:39 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:41:39 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:41:39 user nova-compute[75210]: DEBUG nova.policy [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff068faa6b454eada6a4e1c37a3b0887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b78c3f7409946e18c85ab8bc938d53d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:41:40 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:41:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:41:40 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Creating image(s)
Nov 29 01:41:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "/opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "/opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "/opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "8cb6d9aefb62b86ca4007043af38b63d8a2c1c62" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "8cb6d9aefb62b86ca4007043af38b63d8a2c1c62" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62.part --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:41 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Successfully created port: baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:41:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:41 user nova-compute[75210]: DEBUG nova.virt.images [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] b063c5c8-5ea7-414c-93c1-fc7f5de30114 was qcow2, converting to raw {{(pid=75210) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 01:41:41 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 01:41:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62.part /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62.converted {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:42 user nova-compute[75210]: INFO nova.compute.manager [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Terminating instance
Nov 29 01:41:42 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62.part /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62.converted" returned: 0 in 0.315s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62.converted --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62.converted --force-share --output=json" returned: 0 in 0.273s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "8cb6d9aefb62b86ca4007043af38b63d8a2c1c62" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.553s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-289eb267-9f1a-4700-aa0c-c0dcbac4634b req-f72d61a4-d858-47f4-842c-b28df8ccb866 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Received event network-vif-unplugged-cab8d54d-c948-4e8f-a543-2f999336ef32 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-289eb267-9f1a-4700-aa0c-c0dcbac4634b req-f72d61a4-d858-47f4-842c-b28df8ccb866 service nova] Acquiring lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-289eb267-9f1a-4700-aa0c-c0dcbac4634b req-f72d61a4-d858-47f4-842c-b28df8ccb866 service nova] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-289eb267-9f1a-4700-aa0c-c0dcbac4634b req-f72d61a4-d858-47f4-842c-b28df8ccb866 service nova] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-289eb267-9f1a-4700-aa0c-c0dcbac4634b req-f72d61a4-d858-47f4-842c-b28df8ccb866 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] No waiting events found dispatching network-vif-unplugged-cab8d54d-c948-4e8f-a543-2f999336ef32 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-289eb267-9f1a-4700-aa0c-c0dcbac4634b req-f72d61a4-d858-47f4-842c-b28df8ccb866 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Received event network-vif-unplugged-cab8d54d-c948-4e8f-a543-2f999336ef32 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62 --force-share --output=json" returned: 0 in 0.243s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "8cb6d9aefb62b86ca4007043af38b63d8a2c1c62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "8cb6d9aefb62b86ca4007043af38b63d8a2c1c62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:42 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 42760d1a-1d14-47bb-a602-6eb3ed5205d4 is timed out.
Nov 29 01:41:42 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully detached device vdb from instance 42760d1a-1d14-47bb-a602-6eb3ed5205d4 from the live domain config.
Nov 29 01:41:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jlprIUDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:41:42 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:41:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:42 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Instance destroyed successfully.
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c3d780-94e8-4c93-99f6-b6104a01c8db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afc34248-82ad-41c3-8aa4-0b3b4aca18c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG nova.objects.instance [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lazy-loading 'resources' on Instance uuid 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:41:42 user nova-compute[75210]: No targets found.
Nov 29 01:41:42 user nova-compute[75210]: iSNS:
Nov 29 01:41:42 user nova-compute[75210]: No targets found.
Nov 29 01:41:42 user nova-compute[75210]: STATIC:
Nov 29 01:41:42 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a
Nov 29 01:41:42 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:41:42 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:41:42 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:afc34248-82ad-41c3-8aa4-0b3b4aca18c2
Nov 29 01:41:42 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:41:42 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:41:42 user nova-compute[75210]: FIRMWARE:
Nov 29 01:41:42 user nova-compute[75210]: No targets found.
Nov 29 01:41:42 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:41:42 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:41:42 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1178143244',display_name='tempest-VolumesAdminNegativeTest-server-1178143244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1178143244',id=14,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:39:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='633ac01a07914222b8d881ce54802dbd',ramdisk_id='',reservation_id='r-nqbhz84v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1252348372',owner_user_name='tempest-VolumesAdminNegativeTest-1252348372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:39:49Z,user_data=None,user_id='b74bb613cf57414b8495c3391821442e',uuid=7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cab8d54d-c948-4e8f-a543-2f999336ef32", "address": "fa:16:3e:81:05:66", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab8d54d-c9", "ovs_interfaceid": "cab8d54d-c948-4e8f-a543-2f999336ef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Converting VIF {"id": "cab8d54d-c948-4e8f-a543-2f999336ef32", "address": "fa:16:3e:81:05:66", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcab8d54d-c9", "ovs_interfaceid": "cab8d54d-c948-4e8f-a543-2f999336ef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:05:66,bridge_name='br-int',has_traffic_filtering=True,id=cab8d54d-c948-4e8f-a543-2f999336ef32,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab8d54d-c9') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG os_vif [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:05:66,bridge_name='br-int',has_traffic_filtering=True,id=cab8d54d-c948-4e8f-a543-2f999336ef32,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab8d54d-c9') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcab8d54d-c9, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced6f88b-a413-4106-8e1e-571ddd01c1ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afc34248-82ad-41c3-8aa4-0b3b4aca18c2\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0e0039d-e3a7-42f6-9b8c-e0d3a0e91d7e) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:42 user nova-compute[75210]: INFO os_vif [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:05:66,bridge_name='br-int',has_traffic_filtering=True,id=cab8d54d-c948-4e8f-a543-2f999336ef32,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcab8d54d-c9')
Nov 29 01:41:42 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Deleting instance files /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2_del
Nov 29 01:41:42 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Deletion of /opt/stack/data/nova/instances/7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2_del complete
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f63f0e7-0eed-480e-ab81-0a1889f712dc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc34248-82ad-41c3-8aa4-0b3b4aca18c2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc34248-82ad-41c3-8aa4-0b3b4aca18c2 (non-flash)
Nov 29 01:41:43 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:41:43 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afc34248-82ad-41c3-8aa4-0b3b4aca18c2 (non-flash)
Nov 29 01:41:43 user nova-compute[75210]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a (non-flash)
Nov 29 01:41:43 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f03370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a'): ({'sdf'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Removing single pathed devices sdf {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62 --force-share --output=json" returned: 0 in 0.211s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62,backing_fmt=raw /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[51590989-64fd-413b-8b0a-92e5781b2599]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:43 user nova-compute[75210]: INFO nova.compute.manager [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff91f144-d112-4de6-8eb7-0742de38453d]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62,backing_fmt=raw /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk 1073741824" returned: 0 in 0.169s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Flushing IO for device /dev/sdf {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "8cb6d9aefb62b86ca4007043af38b63d8a2c1c62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.385s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e64c68-83cf-41b4-b8c8-989b2108f8d3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.129s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[398b13bc-50db-4342-87a7-75410ff2dd10]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] SCSI volumes sdf have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d615174-bbc7-4879-b2d4-a3eeb924187a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62 --force-share --output=json" returned: 0 in 0.216s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Ensure instance console log exists: /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --logout" returned: 0 in 0.133s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[489609e5-64e6-4484-aba0-da30329b7312]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a, portal: 172.16.0.220,3260]
Nov 29 01:41:43 user nova-compute[75210]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a, portal: 172.16.0.220,3260] successful.
Nov 29 01:41:43 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1276decd-1dec-4a6d-924e-45bdcad8896a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5244297-65ec-41dc-ada9-c30a5d9504a1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.691s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] <== disconnect_volume: return (693ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:41:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:41:44 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Took 0.98 seconds to deallocate network for instance.
Nov 29 01:41:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-6010a78f-3348-430a-97d3-071da65dccf4 req-515347f2-c647-4f4f-b5be-d17ce71ccbd1 service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Received event network-vif-deleted-cab8d54d-c948-4e8f-a543-2f999336ef32 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Successfully updated port: baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "refresh_cache-71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquired lock "refresh_cache-71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:41:44 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Deleted allocations for instance 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2
Nov 29 01:41:44 user nova-compute[75210]: DEBUG nova.objects.instance [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'flavor' on Instance uuid 42760d1a-1d14-47bb-a602-6eb3ed5205d4 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9f94300d-d9e0-4a86-976c-6e08f5daed96 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.874s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Received event network-vif-plugged-cab8d54d-c948-4e8f-a543-2f999336ef32 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] Acquiring lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] No waiting events found dispatching network-vif-plugged-cab8d54d-c948-4e8f-a543-2f999336ef32 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:41:44 user nova-compute[75210]: WARNING nova.compute.manager [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] [instance: 7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2] Received unexpected event network-vif-plugged-cab8d54d-c948-4e8f-a543-2f999336ef32 for instance with vm_state deleted and task_state None.
Nov 29 01:41:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Received event network-changed-baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Refreshing instance network info cache due to event network-changed-baede4c5-9db8-44da-89d3-aaa96db265ff. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] Acquiring lock "refresh_cache-71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:41:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f54de03-4d0c-4724-aca8-b2fd09c92e39 tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "7ddb32f5-d3ca-45e2-a5a4-18019a66d0a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.807s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Updating instance_info_cache with network_info: [{"id": "baede4c5-9db8-44da-89d3-aaa96db265ff", "address": "fa:16:3e:87:f6:47", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaede4c5-9d", "ovs_interfaceid": "baede4c5-9db8-44da-89d3-aaa96db265ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Releasing lock "refresh_cache-71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Instance network_info: |[{"id": "baede4c5-9db8-44da-89d3-aaa96db265ff", "address": "fa:16:3e:87:f6:47", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaede4c5-9d", "ovs_interfaceid": "baede4c5-9db8-44da-89d3-aaa96db265ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] Acquired lock "refresh_cache-71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.network.neutron [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Refreshing network info cache for port baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Start _get_guest_xml network_info=[{"id": "baede4c5-9db8-44da-89d3-aaa96db265ff", "address": "fa:16:3e:87:f6:47", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaede4c5-9d", "ovs_interfaceid": "baede4c5-9db8-44da-89d3-aaa96db265ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9c4f8fcc68901e2ea1e83136b64c0bc9',container_format='bare',created_at=2023-11-29T01:41:29Z,direct_url=<?>,disk_format='qcow2',id=b063c5c8-5ea7-414c-93c1-fc7f5de30114,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1977980194',owner='2b78c3f7409946e18c85ab8bc938d53d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T01:41:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': 'b063c5c8-5ea7-414c-93c1-fc7f5de30114'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:41:45 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:41:45 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9c4f8fcc68901e2ea1e83136b64c0bc9',container_format='bare',created_at=2023-11-29T01:41:29Z,direct_url=<?>,disk_format='qcow2',id=b063c5c8-5ea7-414c-93c1-fc7f5de30114,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1977980194',owner='2b78c3f7409946e18c85ab8bc938d53d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-29T01:41:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:41:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2144443046',display_name='tempest-TestStampPattern-server-2144443046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2144443046',id=16,image_ref='b063c5c8-5ea7-414c-93c1-fc7f5de30114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxZJUo/Epb5CYlFBfChMG1V1BPL8V9TPJTvnIOTNFLljvoxCnu1eTJ8d58HUXoSa4EQGvcboO4Biiz1zA+SH1SEBmtS+A0p9yWGjhjTSTNMhoJMfxAVBrvRKESIp2RgtQ==',key_name='tempest-TestStampPattern-770112348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b78c3f7409946e18c85ab8bc938d53d',ramdisk_id='',reservation_id='r-bl5aaepq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a6571012-7707-47bc-a057-905eef9d762a',image_min_disk='1',image_min_ram='0',image_owner_id='2b78c3f7409946e18c85ab8bc938d53d',image_owner_project_name='tempest-TestStampPattern-1188739187',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1188739187-project-member',image_user_id='ff068faa6b454eada6a4e1c37a3b0887',network_allocated='True',owner_project_name='tempest-TestStampPattern-1188739187',owner_user_name='tempest-TestStampPattern-1188739187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:40Z,user_data=None,user_id='ff068faa6b454eada6a4e1c37a3b0887',uuid=71a14c13-ff4b-4ab4-bea7-6f3b51be4fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baede4c5-9db8-44da-89d3-aaa96db265ff", "address": "fa:16:3e:87:f6:47", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaede4c5-9d", "ovs_interfaceid": "baede4c5-9db8-44da-89d3-aaa96db265ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Converting VIF {"id": "baede4c5-9db8-44da-89d3-aaa96db265ff", "address": "fa:16:3e:87:f6:47", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaede4c5-9d", "ovs_interfaceid": "baede4c5-9db8-44da-89d3-aaa96db265ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:47,bridge_name='br-int',has_traffic_filtering=True,id=baede4c5-9db8-44da-89d3-aaa96db265ff,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaede4c5-9d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.objects.instance [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lazy-loading 'pci_devices' on Instance uuid 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:41:45 user nova-compute[75210]:   <uuid>71a14c13-ff4b-4ab4-bea7-6f3b51be4fef</uuid>
Nov 29 01:41:45 user nova-compute[75210]:   <name>instance-00000010</name>
Nov 29 01:41:45 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:41:45 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:41:45 user nova-compute[75210]:   <metadata>
Nov 29 01:41:45 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:41:45 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:41:45 user nova-compute[75210]:       <nova:name>tempest-TestStampPattern-server-2144443046</nova:name>
Nov 29 01:41:45 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:41:45</nova:creationTime>
Nov 29 01:41:45 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:41:45 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:41:45 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:41:45 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:41:45 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:41:45 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:41:45 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:41:45 user nova-compute[75210]:       <nova:owner>
Nov 29 01:41:45 user nova-compute[75210]:         <nova:user uuid="ff068faa6b454eada6a4e1c37a3b0887">tempest-TestStampPattern-1188739187-project-member</nova:user>
Nov 29 01:41:45 user nova-compute[75210]:         <nova:project uuid="2b78c3f7409946e18c85ab8bc938d53d">tempest-TestStampPattern-1188739187</nova:project>
Nov 29 01:41:45 user nova-compute[75210]:       </nova:owner>
Nov 29 01:41:45 user nova-compute[75210]:       <nova:root type="image" uuid="b063c5c8-5ea7-414c-93c1-fc7f5de30114"/>
Nov 29 01:41:45 user nova-compute[75210]:       <nova:ports>
Nov 29 01:41:45 user nova-compute[75210]:         <nova:port uuid="baede4c5-9db8-44da-89d3-aaa96db265ff">
Nov 29 01:41:45 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 01:41:45 user nova-compute[75210]:         </nova:port>
Nov 29 01:41:45 user nova-compute[75210]:       </nova:ports>
Nov 29 01:41:45 user nova-compute[75210]:     </nova:instance>
Nov 29 01:41:45 user nova-compute[75210]:   </metadata>
Nov 29 01:41:45 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:41:45 user nova-compute[75210]:     <system>
Nov 29 01:41:45 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:41:45 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:41:45 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:41:45 user nova-compute[75210]:       <entry name="serial">71a14c13-ff4b-4ab4-bea7-6f3b51be4fef</entry>
Nov 29 01:41:45 user nova-compute[75210]:       <entry name="uuid">71a14c13-ff4b-4ab4-bea7-6f3b51be4fef</entry>
Nov 29 01:41:45 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:41:45 user nova-compute[75210]:     </system>
Nov 29 01:41:45 user nova-compute[75210]:   </sysinfo>
Nov 29 01:41:45 user nova-compute[75210]:   <os>
Nov 29 01:41:45 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:41:45 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:41:45 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:41:45 user nova-compute[75210]:   </os>
Nov 29 01:41:45 user nova-compute[75210]:   <features>
Nov 29 01:41:45 user nova-compute[75210]:     <acpi/>
Nov 29 01:41:45 user nova-compute[75210]:     <apic/>
Nov 29 01:41:45 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:41:45 user nova-compute[75210]:   </features>
Nov 29 01:41:45 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:41:45 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:41:45 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:41:45 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:41:45 user nova-compute[75210]:   </clock>
Nov 29 01:41:45 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:41:45 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:41:45 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:41:45 user nova-compute[75210]:   </cpu>
Nov 29 01:41:45 user nova-compute[75210]:   <devices>
Nov 29 01:41:45 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:41:45 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:41:45 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk"/>
Nov 29 01:41:45 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:41:45 user nova-compute[75210]:     </disk>
Nov 29 01:41:45 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:41:45 user nova-compute[75210]:       <mac address="fa:16:3e:87:f6:47"/>
Nov 29 01:41:45 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:41:45 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:41:45 user nova-compute[75210]:       <target dev="tapbaede4c5-9d"/>
Nov 29 01:41:45 user nova-compute[75210]:     </interface>
Nov 29 01:41:45 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:41:45 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/console.log" append="off"/>
Nov 29 01:41:45 user nova-compute[75210]:     </serial>
Nov 29 01:41:45 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:41:45 user nova-compute[75210]:     <video>
Nov 29 01:41:45 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:41:45 user nova-compute[75210]:     </video>
Nov 29 01:41:45 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:41:45 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:41:45 user nova-compute[75210]:     </rng>
Nov 29 01:41:45 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:41:45 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:41:45 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:41:45 user nova-compute[75210]:     </memballoon>
Nov 29 01:41:45 user nova-compute[75210]:   </devices>
Nov 29 01:41:45 user nova-compute[75210]: </domain>
Nov 29 01:41:45 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:41:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2144443046',display_name='tempest-TestStampPattern-server-2144443046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2144443046',id=16,image_ref='b063c5c8-5ea7-414c-93c1-fc7f5de30114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxZJUo/Epb5CYlFBfChMG1V1BPL8V9TPJTvnIOTNFLljvoxCnu1eTJ8d58HUXoSa4EQGvcboO4Biiz1zA+SH1SEBmtS+A0p9yWGjhjTSTNMhoJMfxAVBrvRKESIp2RgtQ==',key_name='tempest-TestStampPattern-770112348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b78c3f7409946e18c85ab8bc938d53d',ramdisk_id='',reservation_id='r-bl5aaepq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a6571012-7707-47bc-a057-905eef9d762a',image_min_disk='1',image_min_ram='0',image_owner_id='2b78c3f7409946e18c85ab8bc938d53d',image_owner_project_name='tempest-TestStampPattern-1188739187',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1188739187-project-member',image_user_id='ff068faa6b454eada6a4e1c37a3b0887',network_allocated='True',owner_project_name='tempest-TestStampPattern-1188739187',owner_user_name='tempest-TestStampPattern-1188739187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:40Z,user_data=None,user_id='ff068faa6b454eada6a4e1c37a3b0887',uuid=71a14c13-ff4b-4ab4-bea7-6f3b51be4fef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baede4c5-9db8-44da-89d3-aaa96db265ff", "address": "fa:16:3e:87:f6:47", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaede4c5-9d", "ovs_interfaceid": "baede4c5-9db8-44da-89d3-aaa96db265ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Converting VIF {"id": "baede4c5-9db8-44da-89d3-aaa96db265ff", "address": "fa:16:3e:87:f6:47", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaede4c5-9d", "ovs_interfaceid": "baede4c5-9db8-44da-89d3-aaa96db265ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:47,bridge_name='br-int',has_traffic_filtering=True,id=baede4c5-9db8-44da-89d3-aaa96db265ff,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaede4c5-9d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG os_vif [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:47,bridge_name='br-int',has_traffic_filtering=True,id=baede4c5-9db8-44da-89d3-aaa96db265ff,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaede4c5-9d') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '067924d5-bc5e-5350-9328-d542e1d7a289', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbaede4c5-9d, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbaede4c5-9d, col_values=(('qos', UUID('477ff9e1-879a-447a-a52c-41471cce88a0')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbaede4c5-9d, col_values=(('external_ids', {'iface-id': 'baede4c5-9db8-44da-89d3-aaa96db265ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:f6:47', 'vm-uuid': '71a14c13-ff4b-4ab4-bea7-6f3b51be4fef'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:45 user nova-compute[75210]: INFO os_vif [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f6:47,bridge_name='br-int',has_traffic_filtering=True,id=baede4c5-9db8-44da-89d3-aaa96db265ff,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaede4c5-9d')
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] No VIF found with MAC fa:16:3e:87:f6:47, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.network.neutron [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Updated VIF entry in instance network info cache for port baede4c5-9db8-44da-89d3-aaa96db265ff. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG nova.network.neutron [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Updating instance_info_cache with network_info: [{"id": "baede4c5-9db8-44da-89d3-aaa96db265ff", "address": "fa:16:3e:87:f6:47", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaede4c5-9d", "ovs_interfaceid": "baede4c5-9db8-44da-89d3-aaa96db265ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:41:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-351b3b11-b62a-4145-b373-5ce7a1446f42 req-3127e54f-00d5-4b64-8f49-69f2c8251c4c service nova] Releasing lock "refresh_cache-71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:41:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:47 user nova-compute[75210]: DEBUG nova.compute.manager [req-1e635eaf-d5d4-4061-8078-b808f040b789 req-84fa0998-1878-4956-8a7f-7afe6c49a093 service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Received event network-vif-plugged-baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:41:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1e635eaf-d5d4-4061-8078-b808f040b789 req-84fa0998-1878-4956-8a7f-7afe6c49a093 service nova] Acquiring lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1e635eaf-d5d4-4061-8078-b808f040b789 req-84fa0998-1878-4956-8a7f-7afe6c49a093 service nova] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1e635eaf-d5d4-4061-8078-b808f040b789 req-84fa0998-1878-4956-8a7f-7afe6c49a093 service nova] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:47 user nova-compute[75210]: DEBUG nova.compute.manager [req-1e635eaf-d5d4-4061-8078-b808f040b789 req-84fa0998-1878-4956-8a7f-7afe6c49a093 service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] No waiting events found dispatching network-vif-plugged-baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:41:47 user nova-compute[75210]: WARNING nova.compute.manager [req-1e635eaf-d5d4-4061-8078-b808f040b789 req-84fa0998-1878-4956-8a7f-7afe6c49a093 service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Received unexpected event network-vif-plugged-baede4c5-9db8-44da-89d3-aaa96db265ff for instance with vm_state building and task_state spawning.
Nov 29 01:41:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-417dc122-1e65-4061-b861-6272f85885cb req-670657c9-8335-4802-958f-0d9b9cb2f53f service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Received event network-vif-plugged-baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:41:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-417dc122-1e65-4061-b861-6272f85885cb req-670657c9-8335-4802-958f-0d9b9cb2f53f service nova] Acquiring lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-417dc122-1e65-4061-b861-6272f85885cb req-670657c9-8335-4802-958f-0d9b9cb2f53f service nova] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-417dc122-1e65-4061-b861-6272f85885cb req-670657c9-8335-4802-958f-0d9b9cb2f53f service nova] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-417dc122-1e65-4061-b861-6272f85885cb req-670657c9-8335-4802-958f-0d9b9cb2f53f service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] No waiting events found dispatching network-vif-plugged-baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:41:49 user nova-compute[75210]: WARNING nova.compute.manager [req-417dc122-1e65-4061-b861-6272f85885cb req-670657c9-8335-4802-958f-0d9b9cb2f53f service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Received unexpected event network-vif-plugged-baede4c5-9db8-44da-89d3-aaa96db265ff for instance with vm_state building and task_state spawning.
Nov 29 01:41:49 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:41:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:41:49 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Instance spawned successfully.
Nov 29 01:41:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:41:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:41:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:41:49 user nova-compute[75210]: INFO nova.compute.manager [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Took 9.84 seconds to spawn the instance on the hypervisor.
Nov 29 01:41:49 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:41:49 user nova-compute[75210]: INFO nova.compute.manager [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Took 10.70 seconds to build instance.
Nov 29 01:41:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6455e261-64c7-4352-9c66-44e96d2d360b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.852s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:41:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:41:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:41:55 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:41:55 user nova-compute[75210]: INFO nova.compute.claims [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Claim successful on node user
Nov 29 01:41:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:55 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:41:55 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:41:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:41:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:41:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:41:55 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:41:55 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:41:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:41:56 user nova-compute[75210]: INFO nova.virt.block_device [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Booting with volume 234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e at /dev/vda
Nov 29 01:41:56 user nova-compute[75210]: DEBUG os_brick.utils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dffc4a-1ec0-4a63-95e9-8332c5046332]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4decd2-10e7-4770-a5c9-76fcdd127201]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6404b90-183d-4956-8ef3-7281d8a54995]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef85c9c6-bae8-4505-b50f-874bdf8a6345]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG nova.policy [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3274c54e33ca46cb83f6c899090be306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bfe843dfdc4752a350bcacc36a31cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:41:56 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:41:56 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d212fc3-4db9-4582-a3fc-60f365a962d9]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG os_brick.utils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:41:56 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating existing volume attachment record: 63562222-142b-42db-ad57-5fa141af4b1a {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:41:57 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Successfully created port: 4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:41:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:41:58 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Successfully created port: fc03e817-29d6-4294-996b-a9f19842a31f {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:41:59 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Successfully created port: e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:42:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:00 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Successfully created port: fd63e4ca-60d0-4187-aea7-05ac89a7ded0 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:42:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:42:02 user nova-compute[75210]: INFO nova.compute.claims [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Claim successful on node user
Nov 29 01:42:02 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG nova.network.neutron [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:42:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:42:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG nova.policy [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d98e0c98f554dd5b8a84f9b3933cf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30940563d2c94d87b2e350faf4d0c5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Successfully created port: 4972db17-fd95-4e98-a344-c1f398acb7e1 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:42:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Creating image(s)
Nov 29 01:42:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "/opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "/opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "/opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.216s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.230s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk 1073741824" returned: 0 in 0.068s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Successfully updated port: 4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-fa52e909-d116-4702-b406-1e8b66ad74bb req-7ab0802c-5e36-4185-967f-201aa36872b5 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-changed-4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-fa52e909-d116-4702-b406-1e8b66ad74bb req-7ab0802c-5e36-4185-967f-201aa36872b5 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing instance network info cache due to event network-changed-4c0c5ded-879a-4468-947e-6350e7e6fcfb. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fa52e909-d116-4702-b406-1e8b66ad74bb req-7ab0802c-5e36-4185-967f-201aa36872b5 service nova] Acquiring lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fa52e909-d116-4702-b406-1e8b66ad74bb req-7ab0802c-5e36-4185-967f-201aa36872b5 service nova] Acquired lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG nova.network.neutron [req-fa52e909-d116-4702-b406-1e8b66ad74bb req-7ab0802c-5e36-4185-967f-201aa36872b5 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing network info cache for port 4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.273s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG nova.network.neutron [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Successfully created port: 91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG nova.network.neutron [req-fa52e909-d116-4702-b406-1e8b66ad74bb req-7ab0802c-5e36-4185-967f-201aa36872b5 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Cannot resize image /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Ensure instance console log exists: /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:04 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:42:04 user nova-compute[75210]: INFO nova.compute.claims [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Claim successful on node user
Nov 29 01:42:04 user nova-compute[75210]: DEBUG nova.network.neutron [req-fa52e909-d116-4702-b406-1e8b66ad74bb req-7ab0802c-5e36-4185-967f-201aa36872b5 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fa52e909-d116-4702-b406-1e8b66ad74bb req-7ab0802c-5e36-4185-967f-201aa36872b5 service nova] Releasing lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.810s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Successfully updated port: b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Successfully updated port: 91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquired lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-f4fe3551-e0ee-4ea8-a979-1848f7f15200 req-4d84c749-e74b-4502-8ad0-a6572790d9dd service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Received event network-changed-91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-f4fe3551-e0ee-4ea8-a979-1848f7f15200 req-4d84c749-e74b-4502-8ad0-a6572790d9dd service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Refreshing instance network info cache due to event network-changed-91762155-8cec-4ac5-aeea-fe198c706136. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f4fe3551-e0ee-4ea8-a979-1848f7f15200 req-4d84c749-e74b-4502-8ad0-a6572790d9dd service nova] Acquiring lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.policy [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '339a0127c78144a989498320081f2c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea74c32e3354c9bb76465b39f437026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-93727d68-f83a-4b30-952d-7da38434ab96 req-8b96756a-8be2-4604-ae09-dd3398c05ed9 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-changed-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-93727d68-f83a-4b30-952d-7da38434ab96 req-8b96756a-8be2-4604-ae09-dd3398c05ed9 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing instance network info cache due to event network-changed-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-93727d68-f83a-4b30-952d-7da38434ab96 req-8b96756a-8be2-4604-ae09-dd3398c05ed9 service nova] Acquiring lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-93727d68-f83a-4b30-952d-7da38434ab96 req-8b96756a-8be2-4604-ae09-dd3398c05ed9 service nova] Acquired lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.network.neutron [req-93727d68-f83a-4b30-952d-7da38434ab96 req-8b96756a-8be2-4604-ae09-dd3398c05ed9 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing network info cache for port b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:42:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Creating image(s)
Nov 29 01:42:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "/opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "/opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "/opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.network.neutron [req-93727d68-f83a-4b30-952d-7da38434ab96 req-8b96756a-8be2-4604-ae09-dd3398c05ed9 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "fa020b7e-c088-4c40-878d-27e43dca4ad0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:42:06 user nova-compute[75210]: INFO nova.virt.block_device [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Booting with volume 1cb50d8a-f810-4511-ae25-b0bfd424bbee at /dev/vdb
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.259s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG os_brick.utils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56424ab-9b17-4922-8be5-dc94e0885f29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:42:06 user nova-compute[75210]: INFO nova.compute.claims [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Claim successful on node user
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e6ac6c-0894-4712-b786-05c3d9f2e937]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[61573686-7e3f-4dee-8251-a298a2420b02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a921e1bc-48b3-4093-a502-a46d4575d10e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.network.neutron [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updating instance_info_cache with network_info: [{"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:42:06 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2685ae2a-4bbe-4be2-9fa7-02a1cf338b53]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.282s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG os_brick.utils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] <== get_connector_properties: return (252ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating existing volume attachment record: 88f96c20-8986-45d2-b8be-822e9fd5c389 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Releasing lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.compute.manager [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Instance network_info: |[{"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f4fe3551-e0ee-4ea8-a979-1848f7f15200 req-4d84c749-e74b-4502-8ad0-a6572790d9dd service nova] Acquired lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.network.neutron [req-f4fe3551-e0ee-4ea8-a979-1848f7f15200 req-4d84c749-e74b-4502-8ad0-a6572790d9dd service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Refreshing network info cache for port 91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Start _get_guest_xml network_info=[{"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk 1073741824" returned: 0 in 0.089s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:06 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:42:06 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-987495974',display_name='tempest-ServerActionsTestOtherA-server-987495974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-987495974',id=18,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0ZPcsrrZ0p77iZVF3hXrlbitPxsOMUk6lEgPtIOZB1sypvzBAvVGb9BhgWOjWjr7Z8pdmqoU3sXtItuyafViUIU/dnioTrc/zJIESKhxOMP7SI+ZANtu7hU2Hj6RuPWQ==',key_name='tempest-keypair-192951479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-cn58y5m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:42:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=3042fea8-4bfc-4ae1-8f06-e0a39bd362e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:e6:d1,bridge_name='br-int',has_traffic_filtering=True,id=91762155-8cec-4ac5-aeea-fe198c706136,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91762155-8c') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.objects.instance [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lazy-loading 'pci_devices' on Instance uuid 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:42:06 user nova-compute[75210]:   <uuid>3042fea8-4bfc-4ae1-8f06-e0a39bd362e5</uuid>
Nov 29 01:42:06 user nova-compute[75210]:   <name>instance-00000012</name>
Nov 29 01:42:06 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:42:06 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:42:06 user nova-compute[75210]:   <metadata>
Nov 29 01:42:06 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:42:06 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:42:06 user nova-compute[75210]:       <nova:name>tempest-ServerActionsTestOtherA-server-987495974</nova:name>
Nov 29 01:42:06 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:42:06</nova:creationTime>
Nov 29 01:42:06 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:42:06 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:42:06 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:42:06 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:42:06 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:42:06 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:42:06 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:42:06 user nova-compute[75210]:       <nova:owner>
Nov 29 01:42:06 user nova-compute[75210]:         <nova:user uuid="2d98e0c98f554dd5b8a84f9b3933cf1a">tempest-ServerActionsTestOtherA-1921082789-project-member</nova:user>
Nov 29 01:42:06 user nova-compute[75210]:         <nova:project uuid="30940563d2c94d87b2e350faf4d0c5b0">tempest-ServerActionsTestOtherA-1921082789</nova:project>
Nov 29 01:42:06 user nova-compute[75210]:       </nova:owner>
Nov 29 01:42:06 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:42:06 user nova-compute[75210]:       <nova:ports>
Nov 29 01:42:06 user nova-compute[75210]:         <nova:port uuid="91762155-8cec-4ac5-aeea-fe198c706136">
Nov 29 01:42:06 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 01:42:06 user nova-compute[75210]:         </nova:port>
Nov 29 01:42:06 user nova-compute[75210]:       </nova:ports>
Nov 29 01:42:06 user nova-compute[75210]:     </nova:instance>
Nov 29 01:42:06 user nova-compute[75210]:   </metadata>
Nov 29 01:42:06 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:42:06 user nova-compute[75210]:     <system>
Nov 29 01:42:06 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:42:06 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:42:06 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:42:06 user nova-compute[75210]:       <entry name="serial">3042fea8-4bfc-4ae1-8f06-e0a39bd362e5</entry>
Nov 29 01:42:06 user nova-compute[75210]:       <entry name="uuid">3042fea8-4bfc-4ae1-8f06-e0a39bd362e5</entry>
Nov 29 01:42:06 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:42:06 user nova-compute[75210]:     </system>
Nov 29 01:42:06 user nova-compute[75210]:   </sysinfo>
Nov 29 01:42:06 user nova-compute[75210]:   <os>
Nov 29 01:42:06 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:42:06 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:42:06 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:42:06 user nova-compute[75210]:   </os>
Nov 29 01:42:06 user nova-compute[75210]:   <features>
Nov 29 01:42:06 user nova-compute[75210]:     <acpi/>
Nov 29 01:42:06 user nova-compute[75210]:     <apic/>
Nov 29 01:42:06 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:42:06 user nova-compute[75210]:   </features>
Nov 29 01:42:06 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:42:06 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:42:06 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:42:06 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:42:06 user nova-compute[75210]:   </clock>
Nov 29 01:42:06 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:42:06 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:42:06 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:42:06 user nova-compute[75210]:   </cpu>
Nov 29 01:42:06 user nova-compute[75210]:   <devices>
Nov 29 01:42:06 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:42:06 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:42:06 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk"/>
Nov 29 01:42:06 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:42:06 user nova-compute[75210]:     </disk>
Nov 29 01:42:06 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:42:06 user nova-compute[75210]:       <mac address="fa:16:3e:90:e6:d1"/>
Nov 29 01:42:06 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:06 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:42:06 user nova-compute[75210]:       <target dev="tap91762155-8c"/>
Nov 29 01:42:06 user nova-compute[75210]:     </interface>
Nov 29 01:42:06 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:42:06 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/console.log" append="off"/>
Nov 29 01:42:06 user nova-compute[75210]:     </serial>
Nov 29 01:42:06 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:42:06 user nova-compute[75210]:     <video>
Nov 29 01:42:06 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:06 user nova-compute[75210]:     </video>
Nov 29 01:42:06 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:42:06 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:42:06 user nova-compute[75210]:     </rng>
Nov 29 01:42:06 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:42:06 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:42:06 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:42:06 user nova-compute[75210]:     </memballoon>
Nov 29 01:42:06 user nova-compute[75210]:   </devices>
Nov 29 01:42:06 user nova-compute[75210]: </domain>
Nov 29 01:42:06 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-987495974',display_name='tempest-ServerActionsTestOtherA-server-987495974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-987495974',id=18,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0ZPcsrrZ0p77iZVF3hXrlbitPxsOMUk6lEgPtIOZB1sypvzBAvVGb9BhgWOjWjr7Z8pdmqoU3sXtItuyafViUIU/dnioTrc/zJIESKhxOMP7SI+ZANtu7hU2Hj6RuPWQ==',key_name='tempest-keypair-192951479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-cn58y5m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:42:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=3042fea8-4bfc-4ae1-8f06-e0a39bd362e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:e6:d1,bridge_name='br-int',has_traffic_filtering=True,id=91762155-8cec-4ac5-aeea-fe198c706136,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91762155-8c') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG os_vif [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:e6:d1,bridge_name='br-int',has_traffic_filtering=True,id=91762155-8cec-4ac5-aeea-fe198c706136,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91762155-8c') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a93e3be-1e9c-55c4-86d2-35733c430001', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91762155-8c, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91762155-8c, col_values=(('qos', UUID('449e98e3-96dd-4a7e-835a-0235d06cb8ba')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91762155-8c, col_values=(('external_ids', {'iface-id': '91762155-8cec-4ac5-aeea-fe198c706136', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:e6:d1', 'vm-uuid': '3042fea8-4bfc-4ae1-8f06-e0a39bd362e5'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.227s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:06 user nova-compute[75210]: INFO os_vif [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:e6:d1,bridge_name='br-int',has_traffic_filtering=True,id=91762155-8cec-4ac5-aeea-fe198c706136,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91762155-8c')
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Successfully created port: 81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.network.neutron [req-93727d68-f83a-4b30-952d-7da38434ab96 req-8b96756a-8be2-4604-ae09-dd3398c05ed9 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-93727d68-f83a-4b30-952d-7da38434ab96 req-8b96756a-8be2-4604-ae09-dd3398c05ed9 service nova] Releasing lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No VIF found with MAC fa:16:3e:90:e6:d1, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Cannot resize image /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Ensure instance console log exists: /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.876s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:42:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.policy [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '339a0127c78144a989498320081f2c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea74c32e3354c9bb76465b39f437026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:42:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Creating image(s)
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "/opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "/opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Successfully updated port: 364b4f4d-0e28-46e2-abb2-6e4742a8caf2 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.201s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-7721ae8d-1afa-4791-8f62-3e37b6148bd0 req-d5cf76ad-aaf5-4f17-b0ad-7a4a1d7d34c2 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-changed-364b4f4d-0e28-46e2-abb2-6e4742a8caf2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-7721ae8d-1afa-4791-8f62-3e37b6148bd0 req-d5cf76ad-aaf5-4f17-b0ad-7a4a1d7d34c2 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing instance network info cache due to event network-changed-364b4f4d-0e28-46e2-abb2-6e4742a8caf2. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7721ae8d-1afa-4791-8f62-3e37b6148bd0 req-d5cf76ad-aaf5-4f17-b0ad-7a4a1d7d34c2 service nova] Acquiring lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7721ae8d-1afa-4791-8f62-3e37b6148bd0 req-d5cf76ad-aaf5-4f17-b0ad-7a4a1d7d34c2 service nova] Acquired lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.network.neutron [req-7721ae8d-1afa-4791-8f62-3e37b6148bd0 req-d5cf76ad-aaf5-4f17-b0ad-7a4a1d7d34c2 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing network info cache for port 364b4f4d-0e28-46e2-abb2-6e4742a8caf2 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.network.neutron [req-f4fe3551-e0ee-4ea8-a979-1848f7f15200 req-4d84c749-e74b-4502-8ad0-a6572790d9dd service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updated VIF entry in instance network info cache for port 91762155-8cec-4ac5-aeea-fe198c706136. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.network.neutron [req-f4fe3551-e0ee-4ea8-a979-1848f7f15200 req-4d84c749-e74b-4502-8ad0-a6572790d9dd service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updating instance_info_cache with network_info: [{"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f4fe3551-e0ee-4ea8-a979-1848f7f15200 req-4d84c749-e74b-4502-8ad0-a6572790d9dd service nova] Releasing lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.242s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG nova.network.neutron [req-7721ae8d-1afa-4791-8f62-3e37b6148bd0 req-d5cf76ad-aaf5-4f17-b0ad-7a4a1d7d34c2 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk 1073741824" returned: 0 in 0.065s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.250s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Successfully updated port: 81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquired lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-5421a666-f1f7-4ff4-bba3-5ea9102b9b75 req-9acbdefd-8a9d-46ab-9f67-24a1672081cc service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-changed-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-5421a666-f1f7-4ff4-bba3-5ea9102b9b75 req-9acbdefd-8a9d-46ab-9f67-24a1672081cc service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Refreshing instance network info cache due to event network-changed-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5421a666-f1f7-4ff4-bba3-5ea9102b9b75 req-9acbdefd-8a9d-46ab-9f67-24a1672081cc service nova] Acquiring lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Cannot resize image /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Ensure instance console log exists: /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Successfully created port: 430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Successfully updated port: fc03e817-29d6-4294-996b-a9f19842a31f {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Updating instance_info_cache with network_info: [{"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Releasing lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Instance network_info: |[{"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5421a666-f1f7-4ff4-bba3-5ea9102b9b75 req-9acbdefd-8a9d-46ab-9f67-24a1672081cc service nova] Acquired lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.network.neutron [req-5421a666-f1f7-4ff4-bba3-5ea9102b9b75 req-9acbdefd-8a9d-46ab-9f67-24a1672081cc service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Refreshing network info cache for port 81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Start _get_guest_xml network_info=[{"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:42:08 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:42:08 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2054332848',display_name='tempest-ServerRescueNegativeTestJSON-server-2054332848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2054332848',id=19,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea74c32e3354c9bb76465b39f437026',ramdisk_id='',reservation_id='r-fr65hu1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-948038897',owner_user_name='tempest-ServerRescueNegativeTestJSON-948038897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:42:06Z,user_data=None,user_id='339a0127c78144a989498320081f2c15',uuid=391642f0-2293-46bf-a93a-c6f2e61698f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converting VIF {"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=81029dcc-8ce3-4765-b4a9-9dbe2860f2cd,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81029dcc-8c') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:08 user nova-compute[75210]: DEBUG nova.objects.instance [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'pci_devices' on Instance uuid 391642f0-2293-46bf-a93a-c6f2e61698f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:42:09 user nova-compute[75210]:   <uuid>391642f0-2293-46bf-a93a-c6f2e61698f6</uuid>
Nov 29 01:42:09 user nova-compute[75210]:   <name>instance-00000013</name>
Nov 29 01:42:09 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:42:09 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:42:09 user nova-compute[75210]:   <metadata>
Nov 29 01:42:09 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:42:09 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:42:09 user nova-compute[75210]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2054332848</nova:name>
Nov 29 01:42:09 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:42:08</nova:creationTime>
Nov 29 01:42:09 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:42:09 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:42:09 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:42:09 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:42:09 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:42:09 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:42:09 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:42:09 user nova-compute[75210]:       <nova:owner>
Nov 29 01:42:09 user nova-compute[75210]:         <nova:user uuid="339a0127c78144a989498320081f2c15">tempest-ServerRescueNegativeTestJSON-948038897-project-member</nova:user>
Nov 29 01:42:09 user nova-compute[75210]:         <nova:project uuid="9ea74c32e3354c9bb76465b39f437026">tempest-ServerRescueNegativeTestJSON-948038897</nova:project>
Nov 29 01:42:09 user nova-compute[75210]:       </nova:owner>
Nov 29 01:42:09 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:42:09 user nova-compute[75210]:       <nova:ports>
Nov 29 01:42:09 user nova-compute[75210]:         <nova:port uuid="81029dcc-8ce3-4765-b4a9-9dbe2860f2cd">
Nov 29 01:42:09 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 01:42:09 user nova-compute[75210]:         </nova:port>
Nov 29 01:42:09 user nova-compute[75210]:       </nova:ports>
Nov 29 01:42:09 user nova-compute[75210]:     </nova:instance>
Nov 29 01:42:09 user nova-compute[75210]:   </metadata>
Nov 29 01:42:09 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:42:09 user nova-compute[75210]:     <system>
Nov 29 01:42:09 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:42:09 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:42:09 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:42:09 user nova-compute[75210]:       <entry name="serial">391642f0-2293-46bf-a93a-c6f2e61698f6</entry>
Nov 29 01:42:09 user nova-compute[75210]:       <entry name="uuid">391642f0-2293-46bf-a93a-c6f2e61698f6</entry>
Nov 29 01:42:09 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:42:09 user nova-compute[75210]:     </system>
Nov 29 01:42:09 user nova-compute[75210]:   </sysinfo>
Nov 29 01:42:09 user nova-compute[75210]:   <os>
Nov 29 01:42:09 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:42:09 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:42:09 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:42:09 user nova-compute[75210]:   </os>
Nov 29 01:42:09 user nova-compute[75210]:   <features>
Nov 29 01:42:09 user nova-compute[75210]:     <acpi/>
Nov 29 01:42:09 user nova-compute[75210]:     <apic/>
Nov 29 01:42:09 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:42:09 user nova-compute[75210]:   </features>
Nov 29 01:42:09 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:42:09 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:42:09 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:42:09 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:42:09 user nova-compute[75210]:   </clock>
Nov 29 01:42:09 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:42:09 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:42:09 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:42:09 user nova-compute[75210]:   </cpu>
Nov 29 01:42:09 user nova-compute[75210]:   <devices>
Nov 29 01:42:09 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:42:09 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:42:09 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk"/>
Nov 29 01:42:09 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:42:09 user nova-compute[75210]:     </disk>
Nov 29 01:42:09 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:42:09 user nova-compute[75210]:       <mac address="fa:16:3e:57:a8:7e"/>
Nov 29 01:42:09 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:09 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:42:09 user nova-compute[75210]:       <target dev="tap81029dcc-8c"/>
Nov 29 01:42:09 user nova-compute[75210]:     </interface>
Nov 29 01:42:09 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:42:09 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/console.log" append="off"/>
Nov 29 01:42:09 user nova-compute[75210]:     </serial>
Nov 29 01:42:09 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:42:09 user nova-compute[75210]:     <video>
Nov 29 01:42:09 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:09 user nova-compute[75210]:     </video>
Nov 29 01:42:09 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:42:09 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:42:09 user nova-compute[75210]:     </rng>
Nov 29 01:42:09 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:42:09 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:42:09 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:42:09 user nova-compute[75210]:     </memballoon>
Nov 29 01:42:09 user nova-compute[75210]:   </devices>
Nov 29 01:42:09 user nova-compute[75210]: </domain>
Nov 29 01:42:09 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2054332848',display_name='tempest-ServerRescueNegativeTestJSON-server-2054332848',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2054332848',id=19,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea74c32e3354c9bb76465b39f437026',ramdisk_id='',reservation_id='r-fr65hu1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-948038897',owner_user_name='tempest-ServerRescueNegativeTestJSON-948038897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:42:06Z,user_data=None,user_id='339a0127c78144a989498320081f2c15',uuid=391642f0-2293-46bf-a93a-c6f2e61698f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converting VIF {"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=81029dcc-8ce3-4765-b4a9-9dbe2860f2cd,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81029dcc-8c') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG os_vif [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=81029dcc-8ce3-4765-b4a9-9dbe2860f2cd,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81029dcc-8c') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b65325f9-fff4-5fb4-a8de-e9b00ec2ea49', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81029dcc-8c, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81029dcc-8c, col_values=(('qos', UUID('d82b1d79-7800-4b94-8f2c-0aa82527fda8')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81029dcc-8c, col_values=(('external_ids', {'iface-id': '81029dcc-8ce3-4765-b4a9-9dbe2860f2cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:a8:7e', 'vm-uuid': '391642f0-2293-46bf-a93a-c6f2e61698f6'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.network.neutron [req-7721ae8d-1afa-4791-8f62-3e37b6148bd0 req-d5cf76ad-aaf5-4f17-b0ad-7a4a1d7d34c2 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:09 user nova-compute[75210]: INFO os_vif [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=81029dcc-8ce3-4765-b4a9-9dbe2860f2cd,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81029dcc-8c')
Nov 29 01:42:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7721ae8d-1afa-4791-8f62-3e37b6148bd0 req-d5cf76ad-aaf5-4f17-b0ad-7a4a1d7d34c2 service nova] Releasing lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No VIF found with MAC fa:16:3e:57:a8:7e, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.network.neutron [req-5421a666-f1f7-4ff4-bba3-5ea9102b9b75 req-9acbdefd-8a9d-46ab-9f67-24a1672081cc service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Updated VIF entry in instance network info cache for port 81029dcc-8ce3-4765-b4a9-9dbe2860f2cd. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.network.neutron [req-5421a666-f1f7-4ff4-bba3-5ea9102b9b75 req-9acbdefd-8a9d-46ab-9f67-24a1672081cc service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Updating instance_info_cache with network_info: [{"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5421a666-f1f7-4ff4-bba3-5ea9102b9b75 req-9acbdefd-8a9d-46ab-9f67-24a1672081cc service nova] Releasing lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-548ad3a8-866c-4865-8540-37895ffabe3a req-77fa4574-d176-4029-8651-df5c56af34b7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-changed-fc03e817-29d6-4294-996b-a9f19842a31f {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-548ad3a8-866c-4865-8540-37895ffabe3a req-77fa4574-d176-4029-8651-df5c56af34b7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing instance network info cache due to event network-changed-fc03e817-29d6-4294-996b-a9f19842a31f. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-548ad3a8-866c-4865-8540-37895ffabe3a req-77fa4574-d176-4029-8651-df5c56af34b7 service nova] Acquiring lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-548ad3a8-866c-4865-8540-37895ffabe3a req-77fa4574-d176-4029-8651-df5c56af34b7 service nova] Acquired lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.network.neutron [req-548ad3a8-866c-4865-8540-37895ffabe3a req-77fa4574-d176-4029-8651-df5c56af34b7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing network info cache for port fc03e817-29d6-4294-996b-a9f19842a31f {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Successfully updated port: 430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Successfully updated port: e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquired lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:42:09 user nova-compute[75210]: DEBUG nova.network.neutron [req-548ad3a8-866c-4865-8540-37895ffabe3a req-77fa4574-d176-4029-8651-df5c56af34b7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.network.neutron [req-548ad3a8-866c-4865-8540-37895ffabe3a req-77fa4574-d176-4029-8651-df5c56af34b7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-548ad3a8-866c-4865-8540-37895ffabe3a req-77fa4574-d176-4029-8651-df5c56af34b7 service nova] Releasing lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Updating instance_info_cache with network_info: [{"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Releasing lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Instance network_info: |[{"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Start _get_guest_xml network_info=[{"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Received event network-vif-plugged-91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] Acquiring lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] No waiting events found dispatching network-vif-plugged-91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:10 user nova-compute[75210]: WARNING nova.compute.manager [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Received unexpected event network-vif-plugged-91762155-8cec-4ac5-aeea-fe198c706136 for instance with vm_state building and task_state spawning.
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Received event network-vif-plugged-91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] Acquiring lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] No waiting events found dispatching network-vif-plugged-91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:10 user nova-compute[75210]: WARNING nova.compute.manager [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Received unexpected event network-vif-plugged-91762155-8cec-4ac5-aeea-fe198c706136 for instance with vm_state building and task_state spawning.
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-changed-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing instance network info cache due to event network-changed-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] Acquiring lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] Acquired lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.network.neutron [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing network info cache for port e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:42:10 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:42:10 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-767989198',display_name='tempest-ServerRescueNegativeTestJSON-server-767989198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-767989198',id=20,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea74c32e3354c9bb76465b39f437026',ramdisk_id='',reservation_id='r-zpy2v0bg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-948038897',owner_user_name='tempest-ServerRescueNegativeTestJSON-948038897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:42:07Z,user_data=None,user_id='339a0127c78144a989498320081f2c15',uuid=fa020b7e-c088-4c40-878d-27e43dca4ad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converting VIF {"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:38:41,bridge_name='br-int',has_traffic_filtering=True,id=430b36ae-28e1-4a6b-860f-86b336fb10b3,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430b36ae-28') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.objects.instance [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'pci_devices' on Instance uuid fa020b7e-c088-4c40-878d-27e43dca4ad0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:42:10 user nova-compute[75210]:   <uuid>fa020b7e-c088-4c40-878d-27e43dca4ad0</uuid>
Nov 29 01:42:10 user nova-compute[75210]:   <name>instance-00000014</name>
Nov 29 01:42:10 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:42:10 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:42:10 user nova-compute[75210]:   <metadata>
Nov 29 01:42:10 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:42:10 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:42:10 user nova-compute[75210]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-767989198</nova:name>
Nov 29 01:42:10 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:42:10</nova:creationTime>
Nov 29 01:42:10 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:42:10 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:42:10 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:42:10 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:42:10 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:42:10 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:42:10 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:42:10 user nova-compute[75210]:       <nova:owner>
Nov 29 01:42:10 user nova-compute[75210]:         <nova:user uuid="339a0127c78144a989498320081f2c15">tempest-ServerRescueNegativeTestJSON-948038897-project-member</nova:user>
Nov 29 01:42:10 user nova-compute[75210]:         <nova:project uuid="9ea74c32e3354c9bb76465b39f437026">tempest-ServerRescueNegativeTestJSON-948038897</nova:project>
Nov 29 01:42:10 user nova-compute[75210]:       </nova:owner>
Nov 29 01:42:10 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:42:10 user nova-compute[75210]:       <nova:ports>
Nov 29 01:42:10 user nova-compute[75210]:         <nova:port uuid="430b36ae-28e1-4a6b-860f-86b336fb10b3">
Nov 29 01:42:10 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 01:42:10 user nova-compute[75210]:         </nova:port>
Nov 29 01:42:10 user nova-compute[75210]:       </nova:ports>
Nov 29 01:42:10 user nova-compute[75210]:     </nova:instance>
Nov 29 01:42:10 user nova-compute[75210]:   </metadata>
Nov 29 01:42:10 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:42:10 user nova-compute[75210]:     <system>
Nov 29 01:42:10 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:42:10 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:42:10 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:42:10 user nova-compute[75210]:       <entry name="serial">fa020b7e-c088-4c40-878d-27e43dca4ad0</entry>
Nov 29 01:42:10 user nova-compute[75210]:       <entry name="uuid">fa020b7e-c088-4c40-878d-27e43dca4ad0</entry>
Nov 29 01:42:10 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:42:10 user nova-compute[75210]:     </system>
Nov 29 01:42:10 user nova-compute[75210]:   </sysinfo>
Nov 29 01:42:10 user nova-compute[75210]:   <os>
Nov 29 01:42:10 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:42:10 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:42:10 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:42:10 user nova-compute[75210]:   </os>
Nov 29 01:42:10 user nova-compute[75210]:   <features>
Nov 29 01:42:10 user nova-compute[75210]:     <acpi/>
Nov 29 01:42:10 user nova-compute[75210]:     <apic/>
Nov 29 01:42:10 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:42:10 user nova-compute[75210]:   </features>
Nov 29 01:42:10 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:42:10 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:42:10 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:42:10 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:42:10 user nova-compute[75210]:   </clock>
Nov 29 01:42:10 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:42:10 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:42:10 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:42:10 user nova-compute[75210]:   </cpu>
Nov 29 01:42:10 user nova-compute[75210]:   <devices>
Nov 29 01:42:10 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:42:10 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:42:10 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk"/>
Nov 29 01:42:10 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:42:10 user nova-compute[75210]:     </disk>
Nov 29 01:42:10 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:42:10 user nova-compute[75210]:       <mac address="fa:16:3e:50:38:41"/>
Nov 29 01:42:10 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:10 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:42:10 user nova-compute[75210]:       <target dev="tap430b36ae-28"/>
Nov 29 01:42:10 user nova-compute[75210]:     </interface>
Nov 29 01:42:10 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:42:10 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/console.log" append="off"/>
Nov 29 01:42:10 user nova-compute[75210]:     </serial>
Nov 29 01:42:10 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:42:10 user nova-compute[75210]:     <video>
Nov 29 01:42:10 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:10 user nova-compute[75210]:     </video>
Nov 29 01:42:10 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:42:10 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:42:10 user nova-compute[75210]:     </rng>
Nov 29 01:42:10 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:42:10 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:42:10 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:42:10 user nova-compute[75210]:     </memballoon>
Nov 29 01:42:10 user nova-compute[75210]:   </devices>
Nov 29 01:42:10 user nova-compute[75210]: </domain>
Nov 29 01:42:10 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-767989198',display_name='tempest-ServerRescueNegativeTestJSON-server-767989198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-767989198',id=20,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea74c32e3354c9bb76465b39f437026',ramdisk_id='',reservation_id='r-zpy2v0bg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-948038897',owner_user_name='tempest-ServerRescueNegativeTestJSON-948038897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:42:07Z,user_data=None,user_id='339a0127c78144a989498320081f2c15',uuid=fa020b7e-c088-4c40-878d-27e43dca4ad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converting VIF {"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:38:41,bridge_name='br-int',has_traffic_filtering=True,id=430b36ae-28e1-4a6b-860f-86b336fb10b3,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430b36ae-28') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG os_vif [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:38:41,bridge_name='br-int',has_traffic_filtering=True,id=430b36ae-28e1-4a6b-860f-86b336fb10b3,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430b36ae-28') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e4ec985-e42c-5ef3-b561-3bbe1a231d30', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap430b36ae-28, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap430b36ae-28, col_values=(('qos', UUID('ce8f3423-039b-4339-9577-f5910f3fd7a5')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap430b36ae-28, col_values=(('external_ids', {'iface-id': '430b36ae-28e1-4a6b-860f-86b336fb10b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:38:41', 'vm-uuid': 'fa020b7e-c088-4c40-878d-27e43dca4ad0'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:10 user nova-compute[75210]: INFO os_vif [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:38:41,bridge_name='br-int',has_traffic_filtering=True,id=430b36ae-28e1-4a6b-860f-86b336fb10b3,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430b36ae-28')
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No VIF found with MAC fa:16:3e:50:38:41, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG nova.network.neutron [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.network.neutron [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:42:11 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Instance spawned successfully.
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-acee64a6-9c87-445c-9850-e618b9a9b407 req-d23cfc39-77c8-41de-b02b-c37771f15d23 service nova] Releasing lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:11 user nova-compute[75210]: INFO nova.compute.manager [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Took 8.43 seconds to spawn the instance on the hypervisor.
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:42:11 user nova-compute[75210]: INFO nova.compute.manager [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Took 9.44 seconds to build instance.
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Successfully updated port: fd63e4ca-60d0-4187-aea7-05ac89a7ded0 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17948749-1fc1-4fe5-a986-eddf6fc940bb tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.585s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received event network-changed-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Refreshing instance network info cache due to event network-changed-430b36ae-28e1-4a6b-860f-86b336fb10b3. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] Acquiring lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] Acquired lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:11 user nova-compute[75210]: DEBUG nova.network.neutron [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Refreshing network info cache for port 430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:12 user nova-compute[75210]: INFO nova.compute.manager [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Terminating instance
Nov 29 01:42:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-53f6394a-ec76-451b-a7ed-a727ab0d07db req-be91ad37-7d94-4c1f-b39e-483fcca28aa3 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-53f6394a-ec76-451b-a7ed-a727ab0d07db req-be91ad37-7d94-4c1f-b39e-483fcca28aa3 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-53f6394a-ec76-451b-a7ed-a727ab0d07db req-be91ad37-7d94-4c1f-b39e-483fcca28aa3 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-53f6394a-ec76-451b-a7ed-a727ab0d07db req-be91ad37-7d94-4c1f-b39e-483fcca28aa3 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-53f6394a-ec76-451b-a7ed-a727ab0d07db req-be91ad37-7d94-4c1f-b39e-483fcca28aa3 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:12 user nova-compute[75210]: WARNING nova.compute.manager [req-53f6394a-ec76-451b-a7ed-a727ab0d07db req-be91ad37-7d94-4c1f-b39e-483fcca28aa3 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state building and task_state spawning.
Nov 29 01:42:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-53f6394a-ec76-451b-a7ed-a727ab0d07db req-be91ad37-7d94-4c1f-b39e-483fcca28aa3 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-53f6394a-ec76-451b-a7ed-a727ab0d07db req-be91ad37-7d94-4c1f-b39e-483fcca28aa3 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-53f6394a-ec76-451b-a7ed-a727ab0d07db req-be91ad37-7d94-4c1f-b39e-483fcca28aa3 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-53f6394a-ec76-451b-a7ed-a727ab0d07db req-be91ad37-7d94-4c1f-b39e-483fcca28aa3 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-53f6394a-ec76-451b-a7ed-a727ab0d07db req-be91ad37-7d94-4c1f-b39e-483fcca28aa3 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:12 user nova-compute[75210]: WARNING nova.compute.manager [req-53f6394a-ec76-451b-a7ed-a727ab0d07db req-be91ad37-7d94-4c1f-b39e-483fcca28aa3 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state building and task_state spawning.
Nov 29 01:42:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.network.neutron [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Updated VIF entry in instance network info cache for port 430b36ae-28e1-4a6b-860f-86b336fb10b3. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.network.neutron [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Updating instance_info_cache with network_info: [{"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] Releasing lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-changed-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing instance network info cache due to event network-changed-fd63e4ca-60d0-4187-aea7-05ac89a7ded0. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] Acquiring lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] Acquired lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.network.neutron [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing network info cache for port fd63e4ca-60d0-4187-aea7-05ac89a7ded0 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.network.neutron [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:13 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Instance destroyed successfully.
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.objects.instance [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'resources' on Instance uuid 42760d1a-1d14-47bb-a602-6eb3ed5205d4 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2032096304',display_name='tempest-AttachVolumeNegativeTest-server-2032096304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2032096304',id=2,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFki8rGEeYwlTJ6VZmSW6HvMwoFgfz2AbyUWqlbAWrVTvNMpttmtTrMMaSXUNN4EzYC2Ycm0RnaCP+vIwNXYe0/1suCwGsCzNG+uEYXy5P32t8Z2wOiPras2/Y0PFVNOBg==',key_name='tempest-keypair-523617607',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18f1a3d6f5994f6eb15e0ab2294efd53',ramdisk_id='',reservation_id='r-u6v3eet4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-648523364',owner_user_name='tempest-AttachVolumeNegativeTest-648523364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:36:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd39b87d15084d84983873b59f36a211',uuid=42760d1a-1d14-47bb-a602-6eb3ed5205d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "address": "fa:16:3e:1d:ad:ca", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb15f2-12", "ovs_interfaceid": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converting VIF {"id": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "address": "fa:16:3e:1d:ad:ca", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4bb15f2-12", "ovs_interfaceid": "c4bb15f2-129e-4c14-bc47-ebe84aec2d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ad:ca,bridge_name='br-int',has_traffic_filtering=True,id=c4bb15f2-129e-4c14-bc47-ebe84aec2d7e,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb15f2-12') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG os_vif [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ad:ca,bridge_name='br-int',has_traffic_filtering=True,id=c4bb15f2-129e-4c14-bc47-ebe84aec2d7e,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb15f2-12') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4bb15f2-12, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f439a9c2-2884-4d74-928f-d2b3ffc9a35a) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:13 user nova-compute[75210]: INFO os_vif [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:ad:ca,bridge_name='br-int',has_traffic_filtering=True,id=c4bb15f2-129e-4c14-bc47-ebe84aec2d7e,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4bb15f2-12')
Nov 29 01:42:13 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Deleting instance files /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4_del
Nov 29 01:42:13 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Deletion of /opt/stack/data/nova/instances/42760d1a-1d14-47bb-a602-6eb3ed5205d4_del complete
Nov 29 01:42:13 user nova-compute[75210]: INFO nova.compute.manager [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 29 01:42:13 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.network.neutron [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-21e8d0c7-d27b-4640-b75c-2c604067d079 req-29fe6962-660a-449b-870a-53f126dcaa79 service nova] Releasing lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Successfully updated port: 4972db17-fd95-4e98-a344-c1f398acb7e1 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquired lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:13 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-changed-4972db17-fd95-4e98-a344-c1f398acb7e1 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing instance network info cache due to event network-changed-4972db17-fd95-4e98-a344-c1f398acb7e1. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] Acquiring lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-354ef2d7-c282-4448-95a4-94d2046412b1 req-33b9813d-2e5b-42e7-9d0e-cc1cfa235efb service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Received event network-vif-unplugged-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-354ef2d7-c282-4448-95a4-94d2046412b1 req-33b9813d-2e5b-42e7-9d0e-cc1cfa235efb service nova] Acquiring lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-354ef2d7-c282-4448-95a4-94d2046412b1 req-33b9813d-2e5b-42e7-9d0e-cc1cfa235efb service nova] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-354ef2d7-c282-4448-95a4-94d2046412b1 req-33b9813d-2e5b-42e7-9d0e-cc1cfa235efb service nova] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-354ef2d7-c282-4448-95a4-94d2046412b1 req-33b9813d-2e5b-42e7-9d0e-cc1cfa235efb service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] No waiting events found dispatching network-vif-unplugged-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-354ef2d7-c282-4448-95a4-94d2046412b1 req-33b9813d-2e5b-42e7-9d0e-cc1cfa235efb service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Received event network-vif-unplugged-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-354ef2d7-c282-4448-95a4-94d2046412b1 req-33b9813d-2e5b-42e7-9d0e-cc1cfa235efb service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Received event network-vif-plugged-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-354ef2d7-c282-4448-95a4-94d2046412b1 req-33b9813d-2e5b-42e7-9d0e-cc1cfa235efb service nova] Acquiring lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-354ef2d7-c282-4448-95a4-94d2046412b1 req-33b9813d-2e5b-42e7-9d0e-cc1cfa235efb service nova] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-354ef2d7-c282-4448-95a4-94d2046412b1 req-33b9813d-2e5b-42e7-9d0e-cc1cfa235efb service nova] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-354ef2d7-c282-4448-95a4-94d2046412b1 req-33b9813d-2e5b-42e7-9d0e-cc1cfa235efb service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] No waiting events found dispatching network-vif-plugged-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:14 user nova-compute[75210]: WARNING nova.compute.manager [req-354ef2d7-c282-4448-95a4-94d2046412b1 req-33b9813d-2e5b-42e7-9d0e-cc1cfa235efb service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Received unexpected event network-vif-plugged-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e for instance with vm_state active and task_state deleting.
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:14 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Took 1.22 seconds to deallocate network for instance.
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:42:14 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Instance spawned successfully.
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:15 user nova-compute[75210]: INFO nova.compute.manager [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Took 9.28 seconds to spawn the instance on the hypervisor.
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:42:15 user nova-compute[75210]: INFO nova.compute.manager [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Took 11.26 seconds to build instance.
Nov 29 01:42:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b5b840d7-9e7d-43b9-b9a1-00f18f9f6268 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.457s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:15 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Deleted allocations for instance 42760d1a-1d14-47bb-a602-6eb3ed5205d4
Nov 29 01:42:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6c62daa8-ca42-4c38-9130-d1c84743b40f tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "42760d1a-1d14-47bb-a602-6eb3ed5205d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.468s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:42:15 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Instance spawned successfully.
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:16 user nova-compute[75210]: INFO nova.compute.manager [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Took 8.60 seconds to spawn the instance on the hypervisor.
Nov 29 01:42:16 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:42:16 user nova-compute[75210]: INFO nova.compute.manager [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Took 9.97 seconds to build instance.
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c3b2872-5cb9-4dab-92a3-451fc67b0108 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.245s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:16 user nova-compute[75210]: INFO nova.virt.block_device [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Booting with volume 2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 at /dev/vdc
Nov 29 01:42:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-30433eaf-6679-4138-a054-5715081efa31 req-28874da8-bf06-4582-b937-3a42c797901d service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received event network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-30433eaf-6679-4138-a054-5715081efa31 req-28874da8-bf06-4582-b937-3a42c797901d service nova] Acquiring lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-30433eaf-6679-4138-a054-5715081efa31 req-28874da8-bf06-4582-b937-3a42c797901d service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-30433eaf-6679-4138-a054-5715081efa31 req-28874da8-bf06-4582-b937-3a42c797901d service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-30433eaf-6679-4138-a054-5715081efa31 req-28874da8-bf06-4582-b937-3a42c797901d service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] No waiting events found dispatching network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:16 user nova-compute[75210]: WARNING nova.compute.manager [req-30433eaf-6679-4138-a054-5715081efa31 req-28874da8-bf06-4582-b937-3a42c797901d service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received unexpected event network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 for instance with vm_state active and task_state None.
Nov 29 01:42:16 user nova-compute[75210]: DEBUG os_brick.utils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bf0683-1c8a-418b-8d71-713985248dde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[750f146e-9271-4a73-b058-b21668434fce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[faef322a-5abd-4306-94b2-52c0d8c90f65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c85db6c-89e4-45af-aa0c-cfa57a71e1ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:42:16 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:42:16 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfedd3f8-eb01-4cfa-89f2-9ad4ba275f38]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG os_brick.utils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating existing volume attachment record: cd3396d5-cdc8-44cc-bb1a-542457c55128 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:42:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-b91419e4-b174-4629-866d-07e3f75ed1f4 req-023b5eeb-056d-4999-b20c-8e053ab22137 service nova] [instance: 42760d1a-1d14-47bb-a602-6eb3ed5205d4] Received event network-vif-deleted-c4bb15f2-129e-4c14-bc47-ebe84aec2d7e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:17 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:17 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [{"id": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "address": "fa:16:3e:82:71:41", "network": {"id": "092bfddb-7c3c-4089-9dce-e1b268de7b95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-57509714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0c5ded-87", "ovs_interfaceid": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fc03e817-29d6-4294-996b-a9f19842a31f", "address": "fa:16:3e:73:a6:3e", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03e817-29", "ovs_interfaceid": "fc03e817-29d6-4294-996b-a9f19842a31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4972db17-fd95-4e98-a344-c1f398acb7e1", "address": "fa:16:3e:a5:cb:6f", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972db17-fd", "ovs_interfaceid": "4972db17-fd95-4e98-a344-c1f398acb7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Releasing lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:17 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Instance network_info: |[{"id": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "address": "fa:16:3e:82:71:41", "network": {"id": "092bfddb-7c3c-4089-9dce-e1b268de7b95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-57509714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0c5ded-87", "ovs_interfaceid": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fc03e817-29d6-4294-996b-a9f19842a31f", "address": "fa:16:3e:73:a6:3e", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03e817-29", "ovs_interfaceid": "fc03e817-29d6-4294-996b-a9f19842a31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4972db17-fd95-4e98-a344-c1f398acb7e1", "address": "fa:16:3e:a5:cb:6f", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972db17-fd", "ovs_interfaceid": "4972db17-fd95-4e98-a344-c1f398acb7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:42:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] Acquired lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing network info cache for port 4972db17-fd95-4e98-a344-c1f398acb7e1 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:42:18 user nova-compute[75210]: DEBUG nova.network.neutron [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updated VIF entry in instance network info cache for port 4972db17-fd95-4e98-a344-c1f398acb7e1. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:42:18 user nova-compute[75210]: DEBUG nova.network.neutron [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [{"id": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "address": "fa:16:3e:82:71:41", "network": {"id": "092bfddb-7c3c-4089-9dce-e1b268de7b95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-57509714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0c5ded-87", "ovs_interfaceid": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fc03e817-29d6-4294-996b-a9f19842a31f", "address": "fa:16:3e:73:a6:3e", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03e817-29", "ovs_interfaceid": "fc03e817-29d6-4294-996b-a9f19842a31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4972db17-fd95-4e98-a344-c1f398acb7e1", "address": "fa:16:3e:a5:cb:6f", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972db17-fd", "ovs_interfaceid": "4972db17-fd95-4e98-a344-c1f398acb7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] Releasing lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received event network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] Acquiring lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] No waiting events found dispatching network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:18 user nova-compute[75210]: WARNING nova.compute.manager [req-5f0de814-978d-4ed3-b88d-85ce86b16237 req-91fbe7d9-61f9-46ef-927f-3ce461a8fc22 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received unexpected event network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 for instance with vm_state building and task_state spawning.
Nov 29 01:42:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:19 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:19 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:42:19 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 01:42:19 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Skipping network cache update for instance because it is Building. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 01:42:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-18aa0259-a720-42aa-be33-4a676dd4d0e7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-18aa0259-a720-42aa-be33-4a676dd4d0e7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:19 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:42:19 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid 18aa0259-a720-42aa-be33-4a676dd4d0e7 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Updating instance_info_cache with network_info: [{"id": "d660481b-c417-49b9-9efe-9a11b09edc5b", "address": "fa:16:3e:69:ed:7f", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd660481b-c4", "ovs_interfaceid": "d660481b-c417-49b9-9efe-9a11b09edc5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-18aa0259-a720-42aa-be33-4a676dd4d0e7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] There are 0 instances to clean {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "97c600c5-63b4-43da-9d80-7ceb3489d338" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG nova.compute.manager [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:42:21 user nova-compute[75210]: INFO nova.compute.claims [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Claim successful on node user
Nov 29 01:42:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:21 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Refreshing inventories for resource provider 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Updating ProviderTree inventory for provider 28871a06-d5c8-43d0-87af-3689cd143011 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Updating inventory in ProviderTree for provider 28871a06-d5c8-43d0-87af-3689cd143011 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Refreshing aggregate associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, aggregates: None {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Refreshing trait associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, traits: HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.010s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG nova.compute.manager [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG nova.compute.manager [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:42:22 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:42:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG nova.compute.manager [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:42:22 user nova-compute[75210]: DEBUG nova.policy [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56716f093b9044078cb70385c84d53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab6f8371c2b41d6b8a56647698c9639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:42:23 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Creating image(s)
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "/opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "/opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "/opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk --force-share --output=json" returned: 0 in 0.537s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG nova.network.neutron [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Successfully created port: 74e012be-53a7-46e7-910f-d59991008302 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.249s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.216s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk 1073741824" returned: 0 in 0.060s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.200s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG nova.network.neutron [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Successfully updated port: 74e012be-53a7-46e7-910f-d59991008302 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Cannot resize image /opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Ensure instance console log exists: /opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-69ee0826-b500-437a-b313-ab4e297fe97c req-62c4d905-ebd0-4ee3-897a-719db9bedf15 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Received event network-changed-74e012be-53a7-46e7-910f-d59991008302 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-69ee0826-b500-437a-b313-ab4e297fe97c req-62c4d905-ebd0-4ee3-897a-719db9bedf15 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Refreshing instance network info cache due to event network-changed-74e012be-53a7-46e7-910f-d59991008302. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-69ee0826-b500-437a-b313-ab4e297fe97c req-62c4d905-ebd0-4ee3-897a-719db9bedf15 service nova] Acquiring lock "refresh_cache-97c600c5-63b4-43da-9d80-7ceb3489d338" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-69ee0826-b500-437a-b313-ab4e297fe97c req-62c4d905-ebd0-4ee3-897a-719db9bedf15 service nova] Acquired lock "refresh_cache-97c600c5-63b4-43da-9d80-7ceb3489d338" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG nova.network.neutron [req-69ee0826-b500-437a-b313-ab4e297fe97c req-62c4d905-ebd0-4ee3-897a-719db9bedf15 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Refreshing network info cache for port 74e012be-53a7-46e7-910f-d59991008302 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "refresh_cache-97c600c5-63b4-43da-9d80-7ceb3489d338" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG nova.network.neutron [req-69ee0826-b500-437a-b313-ab4e297fe97c req-62c4d905-ebd0-4ee3-897a-719db9bedf15 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG nova.network.neutron [req-69ee0826-b500-437a-b313-ab4e297fe97c req-62c4d905-ebd0-4ee3-897a-719db9bedf15 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-69ee0826-b500-437a-b313-ab4e297fe97c req-62c4d905-ebd0-4ee3-897a-719db9bedf15 service nova] Releasing lock "refresh_cache-97c600c5-63b4-43da-9d80-7ceb3489d338" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquired lock "refresh_cache-97c600c5-63b4-43da-9d80-7ceb3489d338" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG nova.network.neutron [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG nova.network.neutron [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:42:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:25 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:42:25 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7966MB free_disk=25.42229461669922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.network.neutron [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Updating instance_info_cache with network_info: [{"id": "74e012be-53a7-46e7-910f-d59991008302", "address": "fa:16:3e:d8:51:24", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e012be-53", "ovs_interfaceid": "74e012be-53a7-46e7-910f-d59991008302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 18aa0259-a720-42aa-be33-4a676dd4d0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 088f3f0c-2895-46f9-9697-a48d35a1f6f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance a6571012-7707-47bc-a057-905eef9d762a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance d58c8996-9d2f-4dee-93ea-494d976d21a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 97c600c5-63b4-43da-9d80-7ceb3489d338 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Releasing lock "refresh_cache-97c600c5-63b4-43da-9d80-7ceb3489d338" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.compute.manager [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Instance network_info: |[{"id": "74e012be-53a7-46e7-910f-d59991008302", "address": "fa:16:3e:d8:51:24", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e012be-53", "ovs_interfaceid": "74e012be-53a7-46e7-910f-d59991008302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Start _get_guest_xml network_info=[{"id": "74e012be-53a7-46e7-910f-d59991008302", "address": "fa:16:3e:d8:51:24", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e012be-53", "ovs_interfaceid": "74e012be-53a7-46e7-910f-d59991008302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:42:25 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:42:25 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1276104920',display_name='tempest-VolumesActionsTest-instance-1276104920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1276104920',id=21,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab6f8371c2b41d6b8a56647698c9639',ramdisk_id='',reservation_id='r-l9ka8msf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1214713951',owner_user_name='tempest-VolumesActionsTest-1214713951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:42:23Z,user_data=None,user_id='56716f093b9044078cb70385c84d53bf',uuid=97c600c5-63b4-43da-9d80-7ceb3489d338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74e012be-53a7-46e7-910f-d59991008302", "address": "fa:16:3e:d8:51:24", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e012be-53", "ovs_interfaceid": "74e012be-53a7-46e7-910f-d59991008302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Converting VIF {"id": "74e012be-53a7-46e7-910f-d59991008302", "address": "fa:16:3e:d8:51:24", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e012be-53", "ovs_interfaceid": "74e012be-53a7-46e7-910f-d59991008302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:51:24,bridge_name='br-int',has_traffic_filtering=True,id=74e012be-53a7-46e7-910f-d59991008302,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e012be-53') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.objects.instance [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lazy-loading 'pci_devices' on Instance uuid 97c600c5-63b4-43da-9d80-7ceb3489d338 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:42:25 user nova-compute[75210]:   <uuid>97c600c5-63b4-43da-9d80-7ceb3489d338</uuid>
Nov 29 01:42:25 user nova-compute[75210]:   <name>instance-00000015</name>
Nov 29 01:42:25 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:42:25 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:42:25 user nova-compute[75210]:   <metadata>
Nov 29 01:42:25 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:42:25 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:42:25 user nova-compute[75210]:       <nova:name>tempest-VolumesActionsTest-instance-1276104920</nova:name>
Nov 29 01:42:25 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:42:25</nova:creationTime>
Nov 29 01:42:25 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:42:25 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:42:25 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:42:25 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:42:25 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:42:25 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:42:25 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:42:25 user nova-compute[75210]:       <nova:owner>
Nov 29 01:42:25 user nova-compute[75210]:         <nova:user uuid="56716f093b9044078cb70385c84d53bf">tempest-VolumesActionsTest-1214713951-project-member</nova:user>
Nov 29 01:42:25 user nova-compute[75210]:         <nova:project uuid="2ab6f8371c2b41d6b8a56647698c9639">tempest-VolumesActionsTest-1214713951</nova:project>
Nov 29 01:42:25 user nova-compute[75210]:       </nova:owner>
Nov 29 01:42:25 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:42:25 user nova-compute[75210]:       <nova:ports>
Nov 29 01:42:25 user nova-compute[75210]:         <nova:port uuid="74e012be-53a7-46e7-910f-d59991008302">
Nov 29 01:42:25 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 29 01:42:25 user nova-compute[75210]:         </nova:port>
Nov 29 01:42:25 user nova-compute[75210]:       </nova:ports>
Nov 29 01:42:25 user nova-compute[75210]:     </nova:instance>
Nov 29 01:42:25 user nova-compute[75210]:   </metadata>
Nov 29 01:42:25 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:42:25 user nova-compute[75210]:     <system>
Nov 29 01:42:25 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:42:25 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:42:25 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:42:25 user nova-compute[75210]:       <entry name="serial">97c600c5-63b4-43da-9d80-7ceb3489d338</entry>
Nov 29 01:42:25 user nova-compute[75210]:       <entry name="uuid">97c600c5-63b4-43da-9d80-7ceb3489d338</entry>
Nov 29 01:42:25 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:42:25 user nova-compute[75210]:     </system>
Nov 29 01:42:25 user nova-compute[75210]:   </sysinfo>
Nov 29 01:42:25 user nova-compute[75210]:   <os>
Nov 29 01:42:25 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:42:25 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:42:25 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:42:25 user nova-compute[75210]:   </os>
Nov 29 01:42:25 user nova-compute[75210]:   <features>
Nov 29 01:42:25 user nova-compute[75210]:     <acpi/>
Nov 29 01:42:25 user nova-compute[75210]:     <apic/>
Nov 29 01:42:25 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:42:25 user nova-compute[75210]:   </features>
Nov 29 01:42:25 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:42:25 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:42:25 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:42:25 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:42:25 user nova-compute[75210]:   </clock>
Nov 29 01:42:25 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:42:25 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:42:25 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:42:25 user nova-compute[75210]:   </cpu>
Nov 29 01:42:25 user nova-compute[75210]:   <devices>
Nov 29 01:42:25 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:42:25 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:42:25 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk"/>
Nov 29 01:42:25 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:42:25 user nova-compute[75210]:     </disk>
Nov 29 01:42:25 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:42:25 user nova-compute[75210]:       <mac address="fa:16:3e:d8:51:24"/>
Nov 29 01:42:25 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:25 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:42:25 user nova-compute[75210]:       <target dev="tap74e012be-53"/>
Nov 29 01:42:25 user nova-compute[75210]:     </interface>
Nov 29 01:42:25 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:42:25 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/console.log" append="off"/>
Nov 29 01:42:25 user nova-compute[75210]:     </serial>
Nov 29 01:42:25 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:42:25 user nova-compute[75210]:     <video>
Nov 29 01:42:25 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:25 user nova-compute[75210]:     </video>
Nov 29 01:42:25 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:42:25 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:42:25 user nova-compute[75210]:     </rng>
Nov 29 01:42:25 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:42:25 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:42:25 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:42:25 user nova-compute[75210]:     </memballoon>
Nov 29 01:42:25 user nova-compute[75210]:   </devices>
Nov 29 01:42:25 user nova-compute[75210]: </domain>
Nov 29 01:42:25 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1276104920',display_name='tempest-VolumesActionsTest-instance-1276104920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1276104920',id=21,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab6f8371c2b41d6b8a56647698c9639',ramdisk_id='',reservation_id='r-l9ka8msf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1214713951',owner_user_name='tempest-VolumesActionsTest-1214713951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:42:23Z,user_data=None,user_id='56716f093b9044078cb70385c84d53bf',uuid=97c600c5-63b4-43da-9d80-7ceb3489d338,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74e012be-53a7-46e7-910f-d59991008302", "address": "fa:16:3e:d8:51:24", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e012be-53", "ovs_interfaceid": "74e012be-53a7-46e7-910f-d59991008302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Converting VIF {"id": "74e012be-53a7-46e7-910f-d59991008302", "address": "fa:16:3e:d8:51:24", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e012be-53", "ovs_interfaceid": "74e012be-53a7-46e7-910f-d59991008302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:51:24,bridge_name='br-int',has_traffic_filtering=True,id=74e012be-53a7-46e7-910f-d59991008302,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e012be-53') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG os_vif [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:51:24,bridge_name='br-int',has_traffic_filtering=True,id=74e012be-53a7-46e7-910f-d59991008302,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e012be-53') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93d04079-9d79-5b9a-9d00-ec88c366eed0', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74e012be-53, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74e012be-53, col_values=(('qos', UUID('3494fa2b-fd5d-4b30-b846-5e84847864ac')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74e012be-53, col_values=(('external_ids', {'iface-id': '74e012be-53a7-46e7-910f-d59991008302', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:51:24', 'vm-uuid': '97c600c5-63b4-43da-9d80-7ceb3489d338'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:25 user nova-compute[75210]: INFO os_vif [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:51:24,bridge_name='br-int',has_traffic_filtering=True,id=74e012be-53a7-46e7-910f-d59991008302,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e012be-53')
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:42:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] No VIF found with MAC fa:16:3e:d8:51:24, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.667s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances with incomplete migration  {{(pid=75210) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:42:26 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Creating image(s)
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Ensure instance console log exists: /opt/stack/data/nova/instances/d58c8996-9d2f-4dee-93ea-494d976d21a3/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Start _get_guest_xml network_info=[{"id": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "address": "fa:16:3e:82:71:41", "network": {"id": "092bfddb-7c3c-4089-9dce-e1b268de7b95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-57509714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0c5ded-87", "ovs_interfaceid": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fc03e817-29d6-4294-996b-a9f19842a31f", "address": "fa:16:3e:73:a6:3e", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03e817-29", "ovs_interfaceid": "fc03e817-29d6-4294-996b-a9f19842a31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4972db17-fd95-4e98-a344-c1f398acb7e1", "address": "fa:16:3e:a5:cb:6f", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972db17-fd", "ovs_interfaceid": "4972db17-fd95-4e98-a344-c1f398acb7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '63562222-142b-42db-ad57-5fa141af4b1a', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKPaLJjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd58c8996-9d2f-4dee-93ea-494d976d21a3', 'attached_at': '', 'detached_at': '', 'volume_id': '234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e', 'serial': '234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'attachment_id': '88f96c20-8986-45d2-b8be-822e9fd5c389', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsCAWjvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd58c8996-9d2f-4dee-93ea-494d976d21a3', 'attached_at': '', 'detached_at': '', 'volume_id': '1cb50d8a-f810-4511-ae25-b0bfd424bbee', 'serial': '1cb50d8a-f810-4511-ae25-b0bfd424bbee'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'cd3396d5-cdc8-44cc-bb1a-542457c55128', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTgIRGtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd58c8996-9d2f-4dee-93ea-494d976d21a3', 'attached_at': '', 'detached_at': '', 'volume_id': '2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390', 'serial': '2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:42:26 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:42:26 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKPaLJjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:42:26 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:42:26 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:42:26 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98c58c5-5dfe-4ed5-b6b8-14059ac47982]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:42:26 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e86e08f-96e4-4549-adef-1f51e0c86874]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e] added
Nov 29 01:42:26 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c6bbce-a01c-4bc4-82d2-a752c7064fe8]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a04d7cc-aedb-4714-b3a9-7c2059190f85]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKPaLJjZ {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKPaLJjZ" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7602bf-1e2b-47ea-bceb-5b3860ee9679]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pKPaLJjZ'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[435c5763-d2f7-4934-b71e-0b20ad7d692a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2665b8e1-fe80-4a06-a343-0951f35ede80]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 01:42:26 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 01:42:26 user nova-compute[75210]:  {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:42:26 user nova-compute[75210]: WARNING os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 01:42:26 user nova-compute[75210]: 
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[640b7278-7f00-4988-ab03-d1c3f2ac7e9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e, portal: 172.16.0.220,3260]
Nov 29 01:42:26 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e, portal: 172.16.0.220,3260] successful.
Nov 29 01:42:26 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada99a36-f0bd-4585-8277-53082b2dd98d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acadb28-4a30-4a8c-9867-1f613570b2b3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:42:26 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:42:26 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea2cd28-6e77-45ed-abe9-f19f69044268]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:42:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKPaLJjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23264353637376639', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264353637376639', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsCAWjvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:42:27 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:42:27 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:42:27 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6934885-114b-4b8d-a26e-7c2c493b1fb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:42:27 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb38489-d764-4118-a092-fa05fd117045]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee] added
Nov 29 01:42:27 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-9357e44c-4bb2-43c8-91ad-7e9dc2ce7f24 req-9371e16d-b048-4168-b12d-e53f5b1759d1 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Received event network-vif-plugged-74e012be-53a7-46e7-910f-d59991008302 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9357e44c-4bb2-43c8-91ad-7e9dc2ce7f24 req-9371e16d-b048-4168-b12d-e53f5b1759d1 service nova] Acquiring lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9357e44c-4bb2-43c8-91ad-7e9dc2ce7f24 req-9371e16d-b048-4168-b12d-e53f5b1759d1 service nova] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9357e44c-4bb2-43c8-91ad-7e9dc2ce7f24 req-9371e16d-b048-4168-b12d-e53f5b1759d1 service nova] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-9357e44c-4bb2-43c8-91ad-7e9dc2ce7f24 req-9371e16d-b048-4168-b12d-e53f5b1759d1 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] No waiting events found dispatching network-vif-plugged-74e012be-53a7-46e7-910f-d59991008302 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:27 user nova-compute[75210]: WARNING nova.compute.manager [req-9357e44c-4bb2-43c8-91ad-7e9dc2ce7f24 req-9371e16d-b048-4168-b12d-e53f5b1759d1 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Received unexpected event network-vif-plugged-74e012be-53a7-46e7-910f-d59991008302 for instance with vm_state building and task_state spawning.
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[93523f46-4f9c-4545-86b6-0f75295be6bf]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1b7457-658e-4abf-a465-ed22d2db47d7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RsCAWjvi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RsCAWjvi" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be14a57-26d9-4a78-ba16-2fbfdc1331db]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RsCAWjvi'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0282a92b-42c7-4c97-bf50-9fa3952b3446]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f34ec5-4579-4844-8935-04e1b3d2d72b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:42:27 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:42:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:42:27 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6c5680-72d6-49a3-9134-2f2c9b36f7aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee, portal: 172.16.0.220,3260]
Nov 29 01:42:28 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee, portal: 172.16.0.220,3260] successful.
Nov 29 01:42:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaf3301-aef3-4cab-bf37-b59b19aaa8e0]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6248b7-7a8a-45d4-8bc3-7a4ebd8b363c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:42:28 user nova-compute[75210]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)
Nov 29 01:42:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:42:28 user nova-compute[75210]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)
Nov 29 01:42:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[186ee1fb-e354-405f-977a-e9a2490ce412]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsCAWjvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23264656263376364', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264656263376364', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTgIRGtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:42:29 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:42:29 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:42:29 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28e2d88-bfbb-41ae-be06-5c0bf6ae15f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:42:29 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[25099275-dfad-4ece-b22b-40df32997b8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390] added
Nov 29 01:42:29 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b203f3ea-9ef2-4919-82eb-4409c74de3be]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1640aaf-60ad-4645-af37-0910a594d6e6]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OTgIRGtm {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OTgIRGtm" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a0dfb3-2c93-4c89-8074-7f4a90acdef0]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OTgIRGtm'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898df12-393a-47c8-a58c-acc814b7abd8]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0014a0-c645-41a7-85de-de82748c65ae]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:42:29 user nova-compute[75210]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)
Nov 29 01:42:29 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:42:29 user nova-compute[75210]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)
Nov 29 01:42:29 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc061d55-2564-453b-b9c3-87b7ab9288d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390, portal: 172.16.0.220,3260]
Nov 29 01:42:29 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390, portal: 172.16.0.220,3260] successful.
Nov 29 01:42:29 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e584b745-77ae-4807-a0a3-4c6f9505e895]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede2e793-bac3-469d-8cba-fba99be90ace]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:42:29 user nova-compute[75210]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)
Nov 29 01:42:29 user nova-compute[75210]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)
Nov 29 01:42:29 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:42:29 user nova-compute[75210]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)
Nov 29 01:42:29 user nova-compute[75210]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)
Nov 29 01:42:29 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[531b0e16-73e1-433a-a904-d043999f0ee9]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTgIRGtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:42:29 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Instance spawned successfully.
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:29 user nova-compute[75210]: INFO nova.compute.manager [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.compute.manager [req-00c66abc-445d-4c69-8219-97b520cfd49b req-bb02bc24-e79f-4473-90b6-4c9ff17e6be1 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Received event network-vif-plugged-74e012be-53a7-46e7-910f-d59991008302 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-00c66abc-445d-4c69-8219-97b520cfd49b req-bb02bc24-e79f-4473-90b6-4c9ff17e6be1 service nova] Acquiring lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-00c66abc-445d-4c69-8219-97b520cfd49b req-bb02bc24-e79f-4473-90b6-4c9ff17e6be1 service nova] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-00c66abc-445d-4c69-8219-97b520cfd49b req-bb02bc24-e79f-4473-90b6-4c9ff17e6be1 service nova] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:29 user nova-compute[75210]: DEBUG nova.compute.manager [req-00c66abc-445d-4c69-8219-97b520cfd49b req-bb02bc24-e79f-4473-90b6-4c9ff17e6be1 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] No waiting events found dispatching network-vif-plugged-74e012be-53a7-46e7-910f-d59991008302 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:29 user nova-compute[75210]: WARNING nova.compute.manager [req-00c66abc-445d-4c69-8219-97b520cfd49b req-bb02bc24-e79f-4473-90b6-4c9ff17e6be1 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Received unexpected event network-vif-plugged-74e012be-53a7-46e7-910f-d59991008302 for instance with vm_state building and task_state spawning.
Nov 29 01:42:30 user nova-compute[75210]: INFO nova.compute.manager [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Took 8.66 seconds to build instance.
Nov 29 01:42:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-675df1f0-7940-4bca-aa5f-13ce0cfa716c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.773s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23839353838376537', 'path': '/dev/sdd'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839353838376537', 'path': '/dev/sdd'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "address": "fa:16:3e:82:71:41", "network": {"id": "092bfddb-7c3c-4089-9dce-e1b268de7b95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-57509714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0c5ded-87", "ovs_interfaceid": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "address": "fa:16:3e:82:71:41", "network": {"id": "092bfddb-7c3c-4089-9dce-e1b268de7b95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-57509714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0c5ded-87", "ovs_interfaceid": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:71:41,bridge_name='br-int',has_traffic_filtering=True,id=4c0c5ded-879a-4468-947e-6350e7e6fcfb,network=Network(092bfddb-7c3c-4089-9dce-e1b268de7b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0c5ded-87') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:97:72,bridge_name='br-int',has_traffic_filtering=True,id=b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb45ea8d7-0f') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:39:15,bridge_name='br-int',has_traffic_filtering=True,id=364b4f4d-0e28-46e2-abb2-6e4742a8caf2,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap364b4f4d-0e') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc03e817-29d6-4294-996b-a9f19842a31f", "address": "fa:16:3e:73:a6:3e", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03e817-29", "ovs_interfaceid": "fc03e817-29d6-4294-996b-a9f19842a31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "fc03e817-29d6-4294-996b-a9f19842a31f", "address": "fa:16:3e:73:a6:3e", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03e817-29", "ovs_interfaceid": "fc03e817-29d6-4294-996b-a9f19842a31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fc03e817-29d6-4294-996b-a9f19842a31f,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03e817-29') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3f3c7-0f') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ef:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd63e4ca-60d0-4187-aea7-05ac89a7ded0,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd63e4ca-60') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4972db17-fd95-4e98-a344-c1f398acb7e1", "address": "fa:16:3e:a5:cb:6f", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972db17-fd", "ovs_interfaceid": "4972db17-fd95-4e98-a344-c1f398acb7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "4972db17-fd95-4e98-a344-c1f398acb7e1", "address": "fa:16:3e:a5:cb:6f", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972db17-fd", "ovs_interfaceid": "4972db17-fd95-4e98-a344-c1f398acb7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cb:6f,bridge_name='br-int',has_traffic_filtering=True,id=4972db17-fd95-4e98-a344-c1f398acb7e1,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972db17-fd') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.objects.instance [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lazy-loading 'pci_devices' on Instance uuid d58c8996-9d2f-4dee-93ea-494d976d21a3 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:42:30 user nova-compute[75210]:   <uuid>d58c8996-9d2f-4dee-93ea-494d976d21a3</uuid>
Nov 29 01:42:30 user nova-compute[75210]:   <name>instance-00000011</name>
Nov 29 01:42:30 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:42:30 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:42:30 user nova-compute[75210]:   <metadata>
Nov 29 01:42:30 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:42:30 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:42:30 user nova-compute[75210]:       <nova:name>tempest-device-tagging-server-1072582985</nova:name>
Nov 29 01:42:30 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:42:26</nova:creationTime>
Nov 29 01:42:30 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:42:30 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:42:30 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:42:30 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:42:30 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:42:30 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:42:30 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:42:30 user nova-compute[75210]:       <nova:owner>
Nov 29 01:42:30 user nova-compute[75210]:         <nova:user uuid="3274c54e33ca46cb83f6c899090be306">tempest-TaggedBootDevicesTest-596152178-project-member</nova:user>
Nov 29 01:42:30 user nova-compute[75210]:         <nova:project uuid="75bfe843dfdc4752a350bcacc36a31cd">tempest-TaggedBootDevicesTest-596152178</nova:project>
Nov 29 01:42:30 user nova-compute[75210]:       </nova:owner>
Nov 29 01:42:30 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:42:30 user nova-compute[75210]:       <nova:ports>
Nov 29 01:42:30 user nova-compute[75210]:         <nova:port uuid="4c0c5ded-879a-4468-947e-6350e7e6fcfb">
Nov 29 01:42:30 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 01:42:30 user nova-compute[75210]:         </nova:port>
Nov 29 01:42:30 user nova-compute[75210]:         <nova:port uuid="b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a">
Nov 29 01:42:30 user nova-compute[75210]:           <nova:ip type="fixed" address="10.1.1.227" ipVersion="4"/>
Nov 29 01:42:30 user nova-compute[75210]:         </nova:port>
Nov 29 01:42:30 user nova-compute[75210]:         <nova:port uuid="364b4f4d-0e28-46e2-abb2-6e4742a8caf2">
Nov 29 01:42:30 user nova-compute[75210]:           <nova:ip type="fixed" address="10.1.1.22" ipVersion="4"/>
Nov 29 01:42:30 user nova-compute[75210]:         </nova:port>
Nov 29 01:42:30 user nova-compute[75210]:         <nova:port uuid="fc03e817-29d6-4294-996b-a9f19842a31f">
Nov 29 01:42:30 user nova-compute[75210]:           <nova:ip type="fixed" address="10.1.1.108" ipVersion="4"/>
Nov 29 01:42:30 user nova-compute[75210]:         </nova:port>
Nov 29 01:42:30 user nova-compute[75210]:         <nova:port uuid="e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea">
Nov 29 01:42:30 user nova-compute[75210]:           <nova:ip type="fixed" address="10.1.1.75" ipVersion="4"/>
Nov 29 01:42:30 user nova-compute[75210]:         </nova:port>
Nov 29 01:42:30 user nova-compute[75210]:         <nova:port uuid="fd63e4ca-60d0-4187-aea7-05ac89a7ded0">
Nov 29 01:42:30 user nova-compute[75210]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 29 01:42:30 user nova-compute[75210]:         </nova:port>
Nov 29 01:42:30 user nova-compute[75210]:         <nova:port uuid="4972db17-fd95-4e98-a344-c1f398acb7e1">
Nov 29 01:42:30 user nova-compute[75210]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 29 01:42:30 user nova-compute[75210]:         </nova:port>
Nov 29 01:42:30 user nova-compute[75210]:       </nova:ports>
Nov 29 01:42:30 user nova-compute[75210]:     </nova:instance>
Nov 29 01:42:30 user nova-compute[75210]:   </metadata>
Nov 29 01:42:30 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:42:30 user nova-compute[75210]:     <system>
Nov 29 01:42:30 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:42:30 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:42:30 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:42:30 user nova-compute[75210]:       <entry name="serial">d58c8996-9d2f-4dee-93ea-494d976d21a3</entry>
Nov 29 01:42:30 user nova-compute[75210]:       <entry name="uuid">d58c8996-9d2f-4dee-93ea-494d976d21a3</entry>
Nov 29 01:42:30 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:42:30 user nova-compute[75210]:     </system>
Nov 29 01:42:30 user nova-compute[75210]:   </sysinfo>
Nov 29 01:42:30 user nova-compute[75210]:   <os>
Nov 29 01:42:30 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:42:30 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:42:30 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:42:30 user nova-compute[75210]:   </os>
Nov 29 01:42:30 user nova-compute[75210]:   <features>
Nov 29 01:42:30 user nova-compute[75210]:     <acpi/>
Nov 29 01:42:30 user nova-compute[75210]:     <apic/>
Nov 29 01:42:30 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:42:30 user nova-compute[75210]:   </features>
Nov 29 01:42:30 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:42:30 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:42:30 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:42:30 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:42:30 user nova-compute[75210]:   </clock>
Nov 29 01:42:30 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:42:30 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:42:30 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:42:30 user nova-compute[75210]:   </cpu>
Nov 29 01:42:30 user nova-compute[75210]:   <devices>
Nov 29 01:42:30 user nova-compute[75210]:     <disk type="file" device="cdrom">
Nov 29 01:42:30 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none"/>
Nov 29 01:42:30 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/d58c8996-9d2f-4dee-93ea-494d976d21a3/disk.config"/>
Nov 29 01:42:30 user nova-compute[75210]:       <target dev="hda" bus="ide"/>
Nov 29 01:42:30 user nova-compute[75210]:     </disk>
Nov 29 01:42:30 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:42:30 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:42:30 user nova-compute[75210]:       <source dev="/dev/sdb"/>
Nov 29 01:42:30 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:42:30 user nova-compute[75210]:       <serial>234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e</serial>
Nov 29 01:42:30 user nova-compute[75210]:     </disk>
Nov 29 01:42:30 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:42:30 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:42:30 user nova-compute[75210]:       <source dev="/dev/sdc"/>
Nov 29 01:42:30 user nova-compute[75210]:       <target dev="vdb" bus="virtio"/>
Nov 29 01:42:30 user nova-compute[75210]:       <serial>1cb50d8a-f810-4511-ae25-b0bfd424bbee</serial>
Nov 29 01:42:30 user nova-compute[75210]:     </disk>
Nov 29 01:42:30 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:42:30 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:42:30 user nova-compute[75210]:       <source dev="/dev/sdd"/>
Nov 29 01:42:30 user nova-compute[75210]:       <target dev="vdc" bus="virtio"/>
Nov 29 01:42:30 user nova-compute[75210]:       <serial>2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390</serial>
Nov 29 01:42:30 user nova-compute[75210]:     </disk>
Nov 29 01:42:30 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:42:30 user nova-compute[75210]:       <mac address="fa:16:3e:82:71:41"/>
Nov 29 01:42:30 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:30 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:42:30 user nova-compute[75210]:       <target dev="tap4c0c5ded-87"/>
Nov 29 01:42:30 user nova-compute[75210]:     </interface>
Nov 29 01:42:30 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:42:30 user nova-compute[75210]:       <mac address="fa:16:3e:39:97:72"/>
Nov 29 01:42:30 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:30 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:42:30 user nova-compute[75210]:       <target dev="tapb45ea8d7-0f"/>
Nov 29 01:42:30 user nova-compute[75210]:     </interface>
Nov 29 01:42:30 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:42:30 user nova-compute[75210]:       <mac address="fa:16:3e:fc:39:15"/>
Nov 29 01:42:30 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:30 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:42:30 user nova-compute[75210]:       <target dev="tap364b4f4d-0e"/>
Nov 29 01:42:30 user nova-compute[75210]:     </interface>
Nov 29 01:42:30 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:42:30 user nova-compute[75210]:       <mac address="fa:16:3e:73:a6:3e"/>
Nov 29 01:42:30 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:30 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:42:30 user nova-compute[75210]:       <target dev="tapfc03e817-29"/>
Nov 29 01:42:30 user nova-compute[75210]:     </interface>
Nov 29 01:42:30 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:42:30 user nova-compute[75210]:       <mac address="fa:16:3e:e9:60:a3"/>
Nov 29 01:42:30 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:30 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:42:30 user nova-compute[75210]:       <target dev="tape5f3f3c7-0f"/>
Nov 29 01:42:30 user nova-compute[75210]:     </interface>
Nov 29 01:42:30 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:42:30 user nova-compute[75210]:       <mac address="fa:16:3e:e0:ef:6c"/>
Nov 29 01:42:30 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:30 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:42:30 user nova-compute[75210]:       <target dev="tapfd63e4ca-60"/>
Nov 29 01:42:30 user nova-compute[75210]:     </interface>
Nov 29 01:42:30 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:42:30 user nova-compute[75210]:       <mac address="fa:16:3e:a5:cb:6f"/>
Nov 29 01:42:30 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:30 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:42:30 user nova-compute[75210]:       <target dev="tap4972db17-fd"/>
Nov 29 01:42:30 user nova-compute[75210]:     </interface>
Nov 29 01:42:30 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:42:30 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/d58c8996-9d2f-4dee-93ea-494d976d21a3/console.log" append="off"/>
Nov 29 01:42:30 user nova-compute[75210]:     </serial>
Nov 29 01:42:30 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:42:30 user nova-compute[75210]:     <video>
Nov 29 01:42:30 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:42:30 user nova-compute[75210]:     </video>
Nov 29 01:42:30 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:42:30 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:42:30 user nova-compute[75210]:     </rng>
Nov 29 01:42:30 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:42:30 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:42:30 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:42:30 user nova-compute[75210]:     </memballoon>
Nov 29 01:42:30 user nova-compute[75210]:   </devices>
Nov 29 01:42:30 user nova-compute[75210]: </domain>
Nov 29 01:42:30 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "address": "fa:16:3e:82:71:41", "network": {"id": "092bfddb-7c3c-4089-9dce-e1b268de7b95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-57509714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0c5ded-87", "ovs_interfaceid": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "address": "fa:16:3e:82:71:41", "network": {"id": "092bfddb-7c3c-4089-9dce-e1b268de7b95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-57509714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0c5ded-87", "ovs_interfaceid": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:71:41,bridge_name='br-int',has_traffic_filtering=True,id=4c0c5ded-879a-4468-947e-6350e7e6fcfb,network=Network(092bfddb-7c3c-4089-9dce-e1b268de7b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0c5ded-87') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:71:41,bridge_name='br-int',has_traffic_filtering=True,id=4c0c5ded-879a-4468-947e-6350e7e6fcfb,network=Network(092bfddb-7c3c-4089-9dce-e1b268de7b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0c5ded-87') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e62b6d5-3c5d-5948-b62d-6ca665d4b5b0', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c0c5ded-87, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c0c5ded-87, col_values=(('qos', UUID('7af90a87-1b82-4055-8096-a255b01fb49c')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c0c5ded-87, col_values=(('external_ids', {'iface-id': '4c0c5ded-879a-4468-947e-6350e7e6fcfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:71:41', 'vm-uuid': 'd58c8996-9d2f-4dee-93ea-494d976d21a3'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: INFO os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:71:41,bridge_name='br-int',has_traffic_filtering=True,id=4c0c5ded-879a-4468-947e-6350e7e6fcfb,network=Network(092bfddb-7c3c-4089-9dce-e1b268de7b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0c5ded-87')
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:97:72,bridge_name='br-int',has_traffic_filtering=True,id=b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb45ea8d7-0f') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:97:72,bridge_name='br-int',has_traffic_filtering=True,id=b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb45ea8d7-0f') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '746de575-4f50-5a4a-a68d-93a432ae99c8', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb45ea8d7-0f, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb45ea8d7-0f, col_values=(('qos', UUID('b9573e12-c7ad-4d93-b548-bad213098b14')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb45ea8d7-0f, col_values=(('external_ids', {'iface-id': 'b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:97:72', 'vm-uuid': 'd58c8996-9d2f-4dee-93ea-494d976d21a3'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: INFO os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:97:72,bridge_name='br-int',has_traffic_filtering=True,id=b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb45ea8d7-0f')
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:39:15,bridge_name='br-int',has_traffic_filtering=True,id=364b4f4d-0e28-46e2-abb2-6e4742a8caf2,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap364b4f4d-0e') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:39:15,bridge_name='br-int',has_traffic_filtering=True,id=364b4f4d-0e28-46e2-abb2-6e4742a8caf2,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap364b4f4d-0e') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae826ea9-573a-51c0-b4f0-7ce4169cb4a9', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap364b4f4d-0e, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap364b4f4d-0e, col_values=(('qos', UUID('a1454608-b560-40b5-a4b6-7264d5e2fa77')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap364b4f4d-0e, col_values=(('external_ids', {'iface-id': '364b4f4d-0e28-46e2-abb2-6e4742a8caf2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:39:15', 'vm-uuid': 'd58c8996-9d2f-4dee-93ea-494d976d21a3'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: INFO os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:39:15,bridge_name='br-int',has_traffic_filtering=True,id=364b4f4d-0e28-46e2-abb2-6e4742a8caf2,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap364b4f4d-0e')
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc03e817-29d6-4294-996b-a9f19842a31f", "address": "fa:16:3e:73:a6:3e", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03e817-29", "ovs_interfaceid": "fc03e817-29d6-4294-996b-a9f19842a31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "fc03e817-29d6-4294-996b-a9f19842a31f", "address": "fa:16:3e:73:a6:3e", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03e817-29", "ovs_interfaceid": "fc03e817-29d6-4294-996b-a9f19842a31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fc03e817-29d6-4294-996b-a9f19842a31f,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03e817-29') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fc03e817-29d6-4294-996b-a9f19842a31f,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03e817-29') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9d208ee-825c-5e4b-98a2-46ed98386613', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc03e817-29, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfc03e817-29, col_values=(('qos', UUID('9cc72d56-fe47-4cea-be27-8adbd353d8ce')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfc03e817-29, col_values=(('external_ids', {'iface-id': 'fc03e817-29d6-4294-996b-a9f19842a31f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:a6:3e', 'vm-uuid': 'd58c8996-9d2f-4dee-93ea-494d976d21a3'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: INFO os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fc03e817-29d6-4294-996b-a9f19842a31f,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03e817-29')
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3f3c7-0f') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3f3c7-0f') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ada52566-42cf-566a-bf1a-0fe29d9b0a4a', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5f3f3c7-0f, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5f3f3c7-0f, col_values=(('qos', UUID('453a28a8-7826-448b-8961-32c6423f7651')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5f3f3c7-0f, col_values=(('external_ids', {'iface-id': 'e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:60:a3', 'vm-uuid': 'd58c8996-9d2f-4dee-93ea-494d976d21a3'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: INFO os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3f3c7-0f')
Nov 29 01:42:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ef:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd63e4ca-60d0-4187-aea7-05ac89a7ded0,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd63e4ca-60') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ef:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd63e4ca-60d0-4187-aea7-05ac89a7ded0,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd63e4ca-60') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0dfffed1-7bdc-5aaa-abdd-822fbd99bc7b', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd63e4ca-60, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd63e4ca-60, col_values=(('qos', UUID('16ba824c-e7ab-4a08-b2ca-821f23af2d7b')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd63e4ca-60, col_values=(('external_ids', {'iface-id': 'fd63e4ca-60d0-4187-aea7-05ac89a7ded0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:ef:6c', 'vm-uuid': 'd58c8996-9d2f-4dee-93ea-494d976d21a3'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: INFO os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ef:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd63e4ca-60d0-4187-aea7-05ac89a7ded0,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd63e4ca-60')
Nov 29 01:42:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4972db17-fd95-4e98-a344-c1f398acb7e1", "address": "fa:16:3e:a5:cb:6f", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972db17-fd", "ovs_interfaceid": "4972db17-fd95-4e98-a344-c1f398acb7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "4972db17-fd95-4e98-a344-c1f398acb7e1", "address": "fa:16:3e:a5:cb:6f", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972db17-fd", "ovs_interfaceid": "4972db17-fd95-4e98-a344-c1f398acb7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cb:6f,bridge_name='br-int',has_traffic_filtering=True,id=4972db17-fd95-4e98-a344-c1f398acb7e1,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972db17-fd') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cb:6f,bridge_name='br-int',has_traffic_filtering=True,id=4972db17-fd95-4e98-a344-c1f398acb7e1,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972db17-fd') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '235d07ae-e6fc-5dc7-b5e8-af7c41633ce9', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4972db17-fd, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4972db17-fd, col_values=(('qos', UUID('1cf1eec4-ad4f-4a5b-91c7-5280ce0da417')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4972db17-fd, col_values=(('external_ids', {'iface-id': '4972db17-fd95-4e98-a344-c1f398acb7e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:cb:6f', 'vm-uuid': 'd58c8996-9d2f-4dee-93ea-494d976d21a3'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:31 user nova-compute[75210]: INFO os_vif [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cb:6f,bridge_name='br-int',has_traffic_filtering=True,id=4972db17-fd95-4e98-a344-c1f398acb7e1,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972db17-fd')
Nov 29 01:42:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] No BDM found with device name hda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] No VIF found with MAC fa:16:3e:82:71:41, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] No VIF found with MAC fa:16:3e:e9:60:a3, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:42:31 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Using config drive
Nov 29 01:42:31 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Creating config drive at /opt/stack/data/nova/instances/d58c8996-9d2f-4dee-93ea-494d976d21a3/disk.config
Nov 29 01:42:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d58c8996-9d2f-4dee-93ea-494d976d21a3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0ncx9mj2 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d58c8996-9d2f-4dee-93ea-494d976d21a3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0ncx9mj2" returned: 0 in 0.065s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-de91fd51-fdea-4428-a75d-15811ed0341e req-3fc5b0b0-e92d-4b39-a076-37009a0c6e64 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-de91fd51-fdea-4428-a75d-15811ed0341e req-3fc5b0b0-e92d-4b39-a076-37009a0c6e64 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-de91fd51-fdea-4428-a75d-15811ed0341e req-3fc5b0b0-e92d-4b39-a076-37009a0c6e64 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-de91fd51-fdea-4428-a75d-15811ed0341e req-3fc5b0b0-e92d-4b39-a076-37009a0c6e64 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-de91fd51-fdea-4428-a75d-15811ed0341e req-3fc5b0b0-e92d-4b39-a076-37009a0c6e64 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:34 user nova-compute[75210]: WARNING nova.compute.manager [req-de91fd51-fdea-4428-a75d-15811ed0341e req-3fc5b0b0-e92d-4b39-a076-37009a0c6e64 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-4c0c5ded-879a-4468-947e-6350e7e6fcfb for instance with vm_state building and task_state spawning.
Nov 29 01:42:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-bebea8aa-648c-49fd-b86b-48ba48646168 req-090a5c9f-1974-4a70-859e-939245e555cc service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bebea8aa-648c-49fd-b86b-48ba48646168 req-090a5c9f-1974-4a70-859e-939245e555cc service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bebea8aa-648c-49fd-b86b-48ba48646168 req-090a5c9f-1974-4a70-859e-939245e555cc service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bebea8aa-648c-49fd-b86b-48ba48646168 req-090a5c9f-1974-4a70-859e-939245e555cc service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-bebea8aa-648c-49fd-b86b-48ba48646168 req-090a5c9f-1974-4a70-859e-939245e555cc service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:35 user nova-compute[75210]: WARNING nova.compute.manager [req-bebea8aa-648c-49fd-b86b-48ba48646168 req-090a5c9f-1974-4a70-859e-939245e555cc service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a for instance with vm_state building and task_state spawning.
Nov 29 01:42:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:36 user nova-compute[75210]: WARNING nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-4c0c5ded-879a-4468-947e-6350e7e6fcfb for instance with vm_state building and task_state spawning.
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-364b4f4d-0e28-46e2-abb2-6e4742a8caf2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-364b4f4d-0e28-46e2-abb2-6e4742a8caf2 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:36 user nova-compute[75210]: WARNING nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-364b4f4d-0e28-46e2-abb2-6e4742a8caf2 for instance with vm_state building and task_state spawning.
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-364b4f4d-0e28-46e2-abb2-6e4742a8caf2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-364b4f4d-0e28-46e2-abb2-6e4742a8caf2 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:36 user nova-compute[75210]: WARNING nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-364b4f4d-0e28-46e2-abb2-6e4742a8caf2 for instance with vm_state building and task_state spawning.
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-fc03e817-29d6-4294-996b-a9f19842a31f {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-fc03e817-29d6-4294-996b-a9f19842a31f {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:36 user nova-compute[75210]: WARNING nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-fc03e817-29d6-4294-996b-a9f19842a31f for instance with vm_state building and task_state spawning.
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-fc03e817-29d6-4294-996b-a9f19842a31f {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-fc03e817-29d6-4294-996b-a9f19842a31f {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:36 user nova-compute[75210]: WARNING nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-fc03e817-29d6-4294-996b-a9f19842a31f for instance with vm_state building and task_state spawning.
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:36 user nova-compute[75210]: WARNING nova.compute.manager [req-6a581431-b586-4feb-90e0-c2839a0046b1 req-4408ef9e-876c-48ce-9e29-3fa1e8c88185 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 for instance with vm_state building and task_state spawning.
Nov 29 01:42:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-9e88d014-bfcb-48b7-996a-4c6c276d3c5d req-6862a59c-8ba4-4650-bc7f-405db0efdae4 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-4972db17-fd95-4e98-a344-c1f398acb7e1 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9e88d014-bfcb-48b7-996a-4c6c276d3c5d req-6862a59c-8ba4-4650-bc7f-405db0efdae4 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9e88d014-bfcb-48b7-996a-4c6c276d3c5d req-6862a59c-8ba4-4650-bc7f-405db0efdae4 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9e88d014-bfcb-48b7-996a-4c6c276d3c5d req-6862a59c-8ba4-4650-bc7f-405db0efdae4 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-9e88d014-bfcb-48b7-996a-4c6c276d3c5d req-6862a59c-8ba4-4650-bc7f-405db0efdae4 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-4972db17-fd95-4e98-a344-c1f398acb7e1 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:36 user nova-compute[75210]: WARNING nova.compute.manager [req-9e88d014-bfcb-48b7-996a-4c6c276d3c5d req-6862a59c-8ba4-4650-bc7f-405db0efdae4 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-4972db17-fd95-4e98-a344-c1f398acb7e1 for instance with vm_state building and task_state spawning.
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:36 user nova-compute[75210]: INFO nova.compute.manager [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Terminating instance
Nov 29 01:42:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:37 user nova-compute[75210]: WARNING nova.compute.manager [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a for instance with vm_state building and task_state spawning.
Nov 29 01:42:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:37 user nova-compute[75210]: WARNING nova.compute.manager [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea for instance with vm_state building and task_state spawning.
Nov 29 01:42:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:37 user nova-compute[75210]: WARNING nova.compute.manager [req-5d441238-c2f6-488a-b19f-6f57203af808 req-b35351eb-b711-4985-b84a-70e0724a5661 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea for instance with vm_state building and task_state spawning.
Nov 29 01:42:37 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Instance destroyed successfully.
Nov 29 01:42:37 user nova-compute[75210]: DEBUG nova.objects.instance [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lazy-loading 'resources' on Instance uuid 088f3f0c-2895-46f9-9697-a48d35a1f6f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-257372102',display_name='tempest-VolumesAdminNegativeTest-server-257372102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-257372102',id=3,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgUcdoVWAcvPBZ+dc6nsBHB90VLo6JfjCA06Cky09pTVFthdIM2RwEB1nq9ZPo4SwgON4K8u77ijWOBMbbzLj0G3Xg24Oc6wK02UQIwqnDDKq4aVQ5I5JcNlNH9756Ncg==',key_name='tempest-keypair-1711966757',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:36:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='633ac01a07914222b8d881ce54802dbd',ramdisk_id='',reservation_id='r-6386qqyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1252348372',owner_user_name='tempest-VolumesAdminNegativeTest-1252348372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b74bb613cf57414b8495c3391821442e',uuid=088f3f0c-2895-46f9-9697-a48d35a1f6f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b7af5ad-622c-41e2-a119-90373684cf5b", "address": "fa:16:3e:f8:8f:ff", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b7af5ad-62", "ovs_interfaceid": "5b7af5ad-622c-41e2-a119-90373684cf5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Converting VIF {"id": "5b7af5ad-622c-41e2-a119-90373684cf5b", "address": "fa:16:3e:f8:8f:ff", "network": {"id": "5b04cd74-6d6f-4410-847c-9ce37de81449", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-997123413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633ac01a07914222b8d881ce54802dbd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b7af5ad-62", "ovs_interfaceid": "5b7af5ad-622c-41e2-a119-90373684cf5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:8f:ff,bridge_name='br-int',has_traffic_filtering=True,id=5b7af5ad-622c-41e2-a119-90373684cf5b,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b7af5ad-62') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG os_vif [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:8f:ff,bridge_name='br-int',has_traffic_filtering=True,id=5b7af5ad-622c-41e2-a119-90373684cf5b,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b7af5ad-62') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b7af5ad-62, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04d6b9ef-7ac0-4768-90a9-d3c1149b0dc2) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:42:37 user nova-compute[75210]: INFO os_vif [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:8f:ff,bridge_name='br-int',has_traffic_filtering=True,id=5b7af5ad-622c-41e2-a119-90373684cf5b,network=Network(5b04cd74-6d6f-4410-847c-9ce37de81449),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b7af5ad-62')
Nov 29 01:42:37 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Deleting instance files /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6_del
Nov 29 01:42:37 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Deletion of /opt/stack/data/nova/instances/088f3f0c-2895-46f9-9697-a48d35a1f6f6_del complete
Nov 29 01:42:37 user nova-compute[75210]: INFO nova.compute.manager [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 29 01:42:37 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-e874ce59-44ec-4851-adca-3c197f0ad788 req-c5f37390-0764-43b5-be05-580cc839d922 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-4972db17-fd95-4e98-a344-c1f398acb7e1 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e874ce59-44ec-4851-adca-3c197f0ad788 req-c5f37390-0764-43b5-be05-580cc839d922 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e874ce59-44ec-4851-adca-3c197f0ad788 req-c5f37390-0764-43b5-be05-580cc839d922 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e874ce59-44ec-4851-adca-3c197f0ad788 req-c5f37390-0764-43b5-be05-580cc839d922 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-e874ce59-44ec-4851-adca-3c197f0ad788 req-c5f37390-0764-43b5-be05-580cc839d922 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-4972db17-fd95-4e98-a344-c1f398acb7e1 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:38 user nova-compute[75210]: WARNING nova.compute.manager [req-e874ce59-44ec-4851-adca-3c197f0ad788 req-c5f37390-0764-43b5-be05-580cc839d922 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-4972db17-fd95-4e98-a344-c1f398acb7e1 for instance with vm_state building and task_state spawning.
Nov 29 01:42:38 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Took 1.04 seconds to deallocate network for instance.
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:42:38 user nova-compute[75210]: INFO nova.compute.manager [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] instance snapshotting
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:38 user nova-compute[75210]: WARNING nova.compute.manager [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 for instance with vm_state building and task_state spawning.
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Received event network-vif-unplugged-5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] Acquiring lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] No waiting events found dispatching network-vif-unplugged-5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:38 user nova-compute[75210]: WARNING nova.compute.manager [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Received unexpected event network-vif-unplugged-5b7af5ad-622c-41e2-a119-90373684cf5b for instance with vm_state deleted and task_state None.
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Received event network-vif-plugged-5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] Acquiring lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] No waiting events found dispatching network-vif-plugged-5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:42:38 user nova-compute[75210]: WARNING nova.compute.manager [req-fb781ae2-ec3c-457c-af0f-5eb35ab55963 req-06dbfed5-3c41-4d2a-a9b8-0b5baa84a558 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Received unexpected event network-vif-plugged-5b7af5ad-622c-41e2-a119-90373684cf5b for instance with vm_state deleted and task_state None.
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:42:38 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Instance spawned successfully.
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:42:38 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Beginning live snapshot process
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:42:39 user nova-compute[75210]: INFO nova.compute.manager [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Took 12.79 seconds to spawn the instance on the hypervisor.
Nov 29 01:42:39 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:42:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json -f qcow2 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:39 user nova-compute[75210]: INFO nova.compute.manager [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Took 44.11 seconds to build instance.
Nov 29 01:42:39 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:42:39 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:42:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e4af6ec2-2be8-4ae0-be2a-9a26d77ba4d5 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.281s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.570s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:39 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Deleted allocations for instance 088f3f0c-2895-46f9-9697-a48d35a1f6f6
Nov 29 01:42:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json -f qcow2 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5b63bbc3-3e17-44dd-9163-ef535548842a tempest-VolumesAdminNegativeTest-1252348372 tempest-VolumesAdminNegativeTest-1252348372-project-member] Lock "088f3f0c-2895-46f9-9697-a48d35a1f6f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.896s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptcx57l2c/0bf8db59674d436596d477e2a455a5f3.delta 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptcx57l2c/0bf8db59674d436596d477e2a455a5f3.delta 1073741824" returned: 0 in 0.052s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:39 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 01:42:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:42:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-9de6c100-a2b0-45a2-8c51-4f788ab40811 req-a387d7cb-4ff2-47f7-950c-c530850ded06 service nova] [instance: 088f3f0c-2895-46f9-9697-a48d35a1f6f6] Received event network-vif-deleted-5b7af5ad-622c-41e2-a119-90373684cf5b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:42:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:42:41 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 01:42:41 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 01:42:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptcx57l2c/0bf8db59674d436596d477e2a455a5f3.delta /opt/stack/data/nova/instances/snapshots/tmptcx57l2c/0bf8db59674d436596d477e2a455a5f3 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:42:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptcx57l2c/0bf8db59674d436596d477e2a455a5f3.delta /opt/stack/data/nova/instances/snapshots/tmptcx57l2c/0bf8db59674d436596d477e2a455a5f3" returned: 0 in 0.465s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:42:41 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Snapshot extracted, beginning image upload
Nov 29 01:42:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:44 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Snapshot image upload complete
Nov 29 01:42:44 user nova-compute[75210]: INFO nova.compute.manager [None req-bbde37c0-2c1e-4be2-928a-223f356571a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Took 5.90 seconds to snapshot the instance on the hypervisor.
Nov 29 01:42:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_power_states {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 18aa0259-a720-42aa-be33-4a676dd4d0e7 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid a6571012-7707-47bc-a057-905eef9d762a {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 996b4364-9920-4b91-8a06-0b6f2c138aab {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid d58c8996-9d2f-4dee-93ea-494d976d21a3 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 391642f0-2293-46bf-a93a-c6f2e61698f6 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid fa020b7e-c088-4c40-878d-27e43dca4ad0 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 97c600c5-63b4-43da-9d80-7ceb3489d338 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "18aa0259-a720-42aa-be33-4a676dd4d0e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "a6571012-7707-47bc-a057-905eef9d762a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "a6571012-7707-47bc-a057-905eef9d762a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "996b4364-9920-4b91-8a06-0b6f2c138aab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "fa020b7e-c088-4c40-878d-27e43dca4ad0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "97c600c5-63b4-43da-9d80-7ceb3489d338" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "a6571012-7707-47bc-a057-905eef9d762a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:42:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:06 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:43:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:43:06 user nova-compute[75210]: INFO nova.compute.claims [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Claim successful on node user
Nov 29 01:43:06 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:43:06 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:43:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:06 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:43:06 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:43:06 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:43:06 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:43:06 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG nova.policy [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd39b87d15084d84983873b59f36a211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f1a3d6f5994f6eb15e0ab2294efd53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:43:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Creating image(s)
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "/opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "/opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.192s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk 1073741824" returned: 0 in 0.053s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.246s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Cannot resize image /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Ensure instance console log exists: /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Successfully created port: 7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:43:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Successfully updated port: 7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:43:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "refresh_cache-c3eec4ab-96b5-4197-9633-6ffad4f3954e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:43:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquired lock "refresh_cache-c3eec4ab-96b5-4197-9633-6ffad4f3954e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:43:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:43:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-27c41846-eba4-427f-88b2-5fddf90284c9 req-fef97b2d-4104-4e67-92da-8b596737d07e service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Received event network-changed-7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-27c41846-eba4-427f-88b2-5fddf90284c9 req-fef97b2d-4104-4e67-92da-8b596737d07e service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Refreshing instance network info cache due to event network-changed-7bb61315-6ffe-4248-b5bc-0a4816f95e35. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:43:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-27c41846-eba4-427f-88b2-5fddf90284c9 req-fef97b2d-4104-4e67-92da-8b596737d07e service nova] Acquiring lock "refresh_cache-c3eec4ab-96b5-4197-9633-6ffad4f3954e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:43:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Updating instance_info_cache with network_info: [{"id": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "address": "fa:16:3e:45:d9:df", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb61315-6f", "ovs_interfaceid": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Releasing lock "refresh_cache-c3eec4ab-96b5-4197-9633-6ffad4f3954e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Instance network_info: |[{"id": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "address": "fa:16:3e:45:d9:df", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb61315-6f", "ovs_interfaceid": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-27c41846-eba4-427f-88b2-5fddf90284c9 req-fef97b2d-4104-4e67-92da-8b596737d07e service nova] Acquired lock "refresh_cache-c3eec4ab-96b5-4197-9633-6ffad4f3954e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.network.neutron [req-27c41846-eba4-427f-88b2-5fddf90284c9 req-fef97b2d-4104-4e67-92da-8b596737d07e service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Refreshing network info cache for port 7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Start _get_guest_xml network_info=[{"id": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "address": "fa:16:3e:45:d9:df", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb61315-6f", "ovs_interfaceid": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:43:09 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:43:09 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1693452363',display_name='tempest-AttachVolumeNegativeTest-server-1693452363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1693452363',id=22,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOIDqdbpxOnXafw+emnKKHglGc9YqumNs2Mh+KBNgOD1wHCiA67w8FP03jUW7M2Zf7FT5MADNWn6G/wRgW1zBhZ874E837TzppedqWhuLHt0JV1q6mjHQhPHumLy4VYAg==',key_name='tempest-keypair-1797049600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18f1a3d6f5994f6eb15e0ab2294efd53',ramdisk_id='',reservation_id='r-fkz6royw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-648523364',owner_user_name='tempest-AttachVolumeNegativeTest-648523364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd39b87d15084d84983873b59f36a211',uuid=c3eec4ab-96b5-4197-9633-6ffad4f3954e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "address": "fa:16:3e:45:d9:df", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb61315-6f", "ovs_interfaceid": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converting VIF {"id": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "address": "fa:16:3e:45:d9:df", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb61315-6f", "ovs_interfaceid": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:d9:df,bridge_name='br-int',has_traffic_filtering=True,id=7bb61315-6ffe-4248-b5bc-0a4816f95e35,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb61315-6f') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'pci_devices' on Instance uuid c3eec4ab-96b5-4197-9633-6ffad4f3954e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:43:09 user nova-compute[75210]:   <uuid>c3eec4ab-96b5-4197-9633-6ffad4f3954e</uuid>
Nov 29 01:43:09 user nova-compute[75210]:   <name>instance-00000016</name>
Nov 29 01:43:09 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:43:09 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:43:09 user nova-compute[75210]:   <metadata>
Nov 29 01:43:09 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:43:09 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:43:09 user nova-compute[75210]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1693452363</nova:name>
Nov 29 01:43:09 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:43:09</nova:creationTime>
Nov 29 01:43:09 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:43:09 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:43:09 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:43:09 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:43:09 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:43:09 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:43:09 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:43:09 user nova-compute[75210]:       <nova:owner>
Nov 29 01:43:09 user nova-compute[75210]:         <nova:user uuid="bd39b87d15084d84983873b59f36a211">tempest-AttachVolumeNegativeTest-648523364-project-member</nova:user>
Nov 29 01:43:09 user nova-compute[75210]:         <nova:project uuid="18f1a3d6f5994f6eb15e0ab2294efd53">tempest-AttachVolumeNegativeTest-648523364</nova:project>
Nov 29 01:43:09 user nova-compute[75210]:       </nova:owner>
Nov 29 01:43:09 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:43:09 user nova-compute[75210]:       <nova:ports>
Nov 29 01:43:09 user nova-compute[75210]:         <nova:port uuid="7bb61315-6ffe-4248-b5bc-0a4816f95e35">
Nov 29 01:43:09 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:43:09 user nova-compute[75210]:         </nova:port>
Nov 29 01:43:09 user nova-compute[75210]:       </nova:ports>
Nov 29 01:43:09 user nova-compute[75210]:     </nova:instance>
Nov 29 01:43:09 user nova-compute[75210]:   </metadata>
Nov 29 01:43:09 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:43:09 user nova-compute[75210]:     <system>
Nov 29 01:43:09 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:43:09 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:43:09 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:43:09 user nova-compute[75210]:       <entry name="serial">c3eec4ab-96b5-4197-9633-6ffad4f3954e</entry>
Nov 29 01:43:09 user nova-compute[75210]:       <entry name="uuid">c3eec4ab-96b5-4197-9633-6ffad4f3954e</entry>
Nov 29 01:43:09 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:43:09 user nova-compute[75210]:     </system>
Nov 29 01:43:09 user nova-compute[75210]:   </sysinfo>
Nov 29 01:43:09 user nova-compute[75210]:   <os>
Nov 29 01:43:09 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:43:09 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:43:09 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:43:09 user nova-compute[75210]:   </os>
Nov 29 01:43:09 user nova-compute[75210]:   <features>
Nov 29 01:43:09 user nova-compute[75210]:     <acpi/>
Nov 29 01:43:09 user nova-compute[75210]:     <apic/>
Nov 29 01:43:09 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:43:09 user nova-compute[75210]:   </features>
Nov 29 01:43:09 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:43:09 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:43:09 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:43:09 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:43:09 user nova-compute[75210]:   </clock>
Nov 29 01:43:09 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:43:09 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:43:09 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:43:09 user nova-compute[75210]:   </cpu>
Nov 29 01:43:09 user nova-compute[75210]:   <devices>
Nov 29 01:43:09 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:43:09 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:43:09 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk"/>
Nov 29 01:43:09 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:43:09 user nova-compute[75210]:     </disk>
Nov 29 01:43:09 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:43:09 user nova-compute[75210]:       <mac address="fa:16:3e:45:d9:df"/>
Nov 29 01:43:09 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:43:09 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:43:09 user nova-compute[75210]:       <target dev="tap7bb61315-6f"/>
Nov 29 01:43:09 user nova-compute[75210]:     </interface>
Nov 29 01:43:09 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:43:09 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/console.log" append="off"/>
Nov 29 01:43:09 user nova-compute[75210]:     </serial>
Nov 29 01:43:09 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:43:09 user nova-compute[75210]:     <video>
Nov 29 01:43:09 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:43:09 user nova-compute[75210]:     </video>
Nov 29 01:43:09 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:43:09 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:43:09 user nova-compute[75210]:     </rng>
Nov 29 01:43:09 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:43:09 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:43:09 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:43:09 user nova-compute[75210]:     </memballoon>
Nov 29 01:43:09 user nova-compute[75210]:   </devices>
Nov 29 01:43:09 user nova-compute[75210]: </domain>
Nov 29 01:43:09 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1693452363',display_name='tempest-AttachVolumeNegativeTest-server-1693452363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1693452363',id=22,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOIDqdbpxOnXafw+emnKKHglGc9YqumNs2Mh+KBNgOD1wHCiA67w8FP03jUW7M2Zf7FT5MADNWn6G/wRgW1zBhZ874E837TzppedqWhuLHt0JV1q6mjHQhPHumLy4VYAg==',key_name='tempest-keypair-1797049600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18f1a3d6f5994f6eb15e0ab2294efd53',ramdisk_id='',reservation_id='r-fkz6royw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-648523364',owner_user_name='tempest-AttachVolumeNegativeTest-648523364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd39b87d15084d84983873b59f36a211',uuid=c3eec4ab-96b5-4197-9633-6ffad4f3954e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "address": "fa:16:3e:45:d9:df", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb61315-6f", "ovs_interfaceid": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converting VIF {"id": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "address": "fa:16:3e:45:d9:df", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb61315-6f", "ovs_interfaceid": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:d9:df,bridge_name='br-int',has_traffic_filtering=True,id=7bb61315-6ffe-4248-b5bc-0a4816f95e35,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb61315-6f') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG os_vif [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:d9:df,bridge_name='br-int',has_traffic_filtering=True,id=7bb61315-6ffe-4248-b5bc-0a4816f95e35,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb61315-6f') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '891ef94a-90cb-5b7f-919c-8be1c6252605', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bb61315-6f, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bb61315-6f, col_values=(('qos', UUID('e7dfc015-2f56-401d-b614-196e16dab999')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bb61315-6f, col_values=(('external_ids', {'iface-id': '7bb61315-6ffe-4248-b5bc-0a4816f95e35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:d9:df', 'vm-uuid': 'c3eec4ab-96b5-4197-9633-6ffad4f3954e'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:09 user nova-compute[75210]: INFO os_vif [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:d9:df,bridge_name='br-int',has_traffic_filtering=True,id=7bb61315-6ffe-4248-b5bc-0a4816f95e35,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb61315-6f')
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No VIF found with MAC fa:16:3e:45:d9:df, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.network.neutron [req-27c41846-eba4-427f-88b2-5fddf90284c9 req-fef97b2d-4104-4e67-92da-8b596737d07e service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Updated VIF entry in instance network info cache for port 7bb61315-6ffe-4248-b5bc-0a4816f95e35. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG nova.network.neutron [req-27c41846-eba4-427f-88b2-5fddf90284c9 req-fef97b2d-4104-4e67-92da-8b596737d07e service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Updating instance_info_cache with network_info: [{"id": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "address": "fa:16:3e:45:d9:df", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb61315-6f", "ovs_interfaceid": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-27c41846-eba4-427f-88b2-5fddf90284c9 req-fef97b2d-4104-4e67-92da-8b596737d07e service nova] Releasing lock "refresh_cache-c3eec4ab-96b5-4197-9633-6ffad4f3954e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:43:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-d9362aee-031f-4811-a93c-c03df6ddc627 req-c0ea8d70-ec9e-4d56-b91b-7f98e93f7f3a service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Received event network-vif-plugged-7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d9362aee-031f-4811-a93c-c03df6ddc627 req-c0ea8d70-ec9e-4d56-b91b-7f98e93f7f3a service nova] Acquiring lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d9362aee-031f-4811-a93c-c03df6ddc627 req-c0ea8d70-ec9e-4d56-b91b-7f98e93f7f3a service nova] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d9362aee-031f-4811-a93c-c03df6ddc627 req-c0ea8d70-ec9e-4d56-b91b-7f98e93f7f3a service nova] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-d9362aee-031f-4811-a93c-c03df6ddc627 req-c0ea8d70-ec9e-4d56-b91b-7f98e93f7f3a service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] No waiting events found dispatching network-vif-plugged-7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:10 user nova-compute[75210]: WARNING nova.compute.manager [req-d9362aee-031f-4811-a93c-c03df6ddc627 req-c0ea8d70-ec9e-4d56-b91b-7f98e93f7f3a service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Received unexpected event network-vif-plugged-7bb61315-6ffe-4248-b5bc-0a4816f95e35 for instance with vm_state building and task_state spawning.
Nov 29 01:43:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:43:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:43:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Instance spawned successfully.
Nov 29 01:43:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:43:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-79ed3365-8adb-4bd0-be74-58afb3b051d9 req-873416de-9ca6-41ee-8fbb-60332fd04bc0 service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Received event network-vif-plugged-7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-79ed3365-8adb-4bd0-be74-58afb3b051d9 req-873416de-9ca6-41ee-8fbb-60332fd04bc0 service nova] Acquiring lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-79ed3365-8adb-4bd0-be74-58afb3b051d9 req-873416de-9ca6-41ee-8fbb-60332fd04bc0 service nova] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-79ed3365-8adb-4bd0-be74-58afb3b051d9 req-873416de-9ca6-41ee-8fbb-60332fd04bc0 service nova] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-79ed3365-8adb-4bd0-be74-58afb3b051d9 req-873416de-9ca6-41ee-8fbb-60332fd04bc0 service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] No waiting events found dispatching network-vif-plugged-7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:12 user nova-compute[75210]: WARNING nova.compute.manager [req-79ed3365-8adb-4bd0-be74-58afb3b051d9 req-873416de-9ca6-41ee-8fbb-60332fd04bc0 service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Received unexpected event network-vif-plugged-7bb61315-6ffe-4248-b5bc-0a4816f95e35 for instance with vm_state building and task_state spawning.
Nov 29 01:43:12 user nova-compute[75210]: INFO nova.compute.manager [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 29 01:43:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:43:13 user nova-compute[75210]: INFO nova.compute.manager [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Took 6.66 seconds to build instance.
Nov 29 01:43:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c21c20ec-7dbb-4429-afff-2489d91b4161 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.846s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:43:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:16 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:43:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:19 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:43:21 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:43:21 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:43:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:43:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:43:21 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: a6571012-7707-47bc-a057-905eef9d762a] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:43:21 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: a6571012-7707-47bc-a057-905eef9d762a] Updating instance_info_cache with network_info: [{"id": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "address": "fa:16:3e:ab:a3:78", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cc60f-9d", "ovs_interfaceid": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:43:22 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: a6571012-7707-47bc-a057-905eef9d762a] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:43:22 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:43:22 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:43:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:43:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:26 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:43:26 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7265MB free_disk=25.28301239013672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 18aa0259-a720-42aa-be33-4a676dd4d0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance a6571012-7707-47bc-a057-905eef9d762a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance d58c8996-9d2f-4dee-93ea-494d976d21a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 97c600c5-63b4-43da-9d80-7ceb3489d338 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c3eec4ab-96b5-4197-9633-6ffad4f3954e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:43:26 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:43:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:43:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:28 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:43:28 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:43:28 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:43:28 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:43:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-5d22d8a6-e9fb-4718-86d3-edf6c5417d62 req-b6dd7710-9985-4176-9aa6-326cb944cffb service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Received event network-changed-baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-5d22d8a6-e9fb-4718-86d3-edf6c5417d62 req-b6dd7710-9985-4176-9aa6-326cb944cffb service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Refreshing instance network info cache due to event network-changed-baede4c5-9db8-44da-89d3-aaa96db265ff. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:43:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d22d8a6-e9fb-4718-86d3-edf6c5417d62 req-b6dd7710-9985-4176-9aa6-326cb944cffb service nova] Acquiring lock "refresh_cache-71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:43:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d22d8a6-e9fb-4718-86d3-edf6c5417d62 req-b6dd7710-9985-4176-9aa6-326cb944cffb service nova] Acquired lock "refresh_cache-71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:43:30 user nova-compute[75210]: DEBUG nova.network.neutron [req-5d22d8a6-e9fb-4718-86d3-edf6c5417d62 req-b6dd7710-9985-4176-9aa6-326cb944cffb service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Refreshing network info cache for port baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG nova.network.neutron [req-5d22d8a6-e9fb-4718-86d3-edf6c5417d62 req-b6dd7710-9985-4176-9aa6-326cb944cffb service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Updated VIF entry in instance network info cache for port baede4c5-9db8-44da-89d3-aaa96db265ff. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG nova.network.neutron [req-5d22d8a6-e9fb-4718-86d3-edf6c5417d62 req-b6dd7710-9985-4176-9aa6-326cb944cffb service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Updating instance_info_cache with network_info: [{"id": "baede4c5-9db8-44da-89d3-aaa96db265ff", "address": "fa:16:3e:87:f6:47", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaede4c5-9d", "ovs_interfaceid": "baede4c5-9db8-44da-89d3-aaa96db265ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d22d8a6-e9fb-4718-86d3-edf6c5417d62 req-b6dd7710-9985-4176-9aa6-326cb944cffb service nova] Releasing lock "refresh_cache-71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG nova.objects.instance [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lazy-loading 'flavor' on Instance uuid 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:31 user nova-compute[75210]: INFO nova.compute.manager [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Attaching volume e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 to /dev/vdb
Nov 29 01:43:31 user nova-compute[75210]: DEBUG os_brick.utils [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[32531a63-874f-43e6-8bfc-b4bb90683dd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e16f973-e2fa-4fc5-a7b5-26961dec2c5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b301d51c-66d5-4601-b8ce-b5f4c62364d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03caed0-b106-46f2-9f2f-15ccba8d0c4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:43:31 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:43:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b767c82a-a992-4b2b-b719-2707398c74c8]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG os_brick.utils [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:43:31 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Updating existing volume attachment record: f63d3861-bf01-4052-a39b-93a4a66d4911 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:43:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAonmZfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:43:39 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:43:39 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:43:39 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f755e6c-9b72-43dd-9a95-ab684379244e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:43:39 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fa6ffd-e45c-49ee-9730-837030a85bad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8] added
Nov 29 01:43:39 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8cbf44-25b4-4276-a1de-ac44370cb2c5]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f8eef7-e7a3-4e4f-85eb-fd78fc46f661]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAonmZfh {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kAonmZfh" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df2797-bab0-4370-b0ac-28bdc53bfb94]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kAonmZfh'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[777fc646-7143-4ab4-874a-8883cdef0ae9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b53df0-82f2-4d64-8bca-f059963ca2bf]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:43:39 user nova-compute[75210]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)
Nov 29 01:43:39 user nova-compute[75210]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)
Nov 29 01:43:39 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:43:39 user nova-compute[75210]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)
Nov 29 01:43:39 user nova-compute[75210]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)
Nov 29 01:43:39 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[51503573-2c72-4f30-b50f-1f68b596fb3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8, portal: 172.16.0.220,3260]
Nov 29 01:43:39 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8, portal: 172.16.0.220,3260] successful.
Nov 29 01:43:39 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f3d335-f91f-45c7-8edd-dcfa2eb8255b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[501809ff-9acd-431a-990a-ccafc52385fb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:43:39 user nova-compute[75210]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)
Nov 29 01:43:39 user nova-compute[75210]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)
Nov 29 01:43:39 user nova-compute[75210]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:43:39 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:43:39 user nova-compute[75210]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)
Nov 29 01:43:39 user nova-compute[75210]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)
Nov 29 01:43:39 user nova-compute[75210]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:43:39 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:43:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[08616ea2-26c4-4886-b7b7-e00a44285ce7]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:40 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:43:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:41 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:43:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAonmZfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:43:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:43:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26630643838346663', 'path': '/dev/sde'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:43:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630643838346663', 'path': '/dev/sde'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:43:41 user nova-compute[75210]: DEBUG nova.objects.instance [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lazy-loading 'flavor' on Instance uuid 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:43:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:43:41 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:43:41 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 01:43:41 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:43:41 user nova-compute[75210]:   <serial>e24f7771-9f48-4e6d-84fc-e1116a8a4cc8</serial>
Nov 29 01:43:41 user nova-compute[75210]: </disk>
Nov 29 01:43:41 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:43:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:43:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:43:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] No VIF found with MAC fa:16:3e:87:f6:47, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:43:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dbf71c3a-989c-434e-8139-a98e9fd6df2b tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.170s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:43 user nova-compute[75210]: INFO nova.compute.manager [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Detaching volume e24f7771-9f48-4e6d-84fc-e1116a8a4cc8
Nov 29 01:43:43 user nova-compute[75210]: INFO nova.virt.block_device [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Attempting to driver detach volume e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 from mountpoint /dev/vdb
Nov 29 01:43:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Attempting to detach device vdb from instance 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:43:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:43:43 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:43:43 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 01:43:43 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:43:43 user nova-compute[75210]:   <serial>e24f7771-9f48-4e6d-84fc-e1116a8a4cc8</serial>
Nov 29 01:43:43 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:43:43 user nova-compute[75210]: </disk>
Nov 29 01:43:43 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:43:43 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Successfully detached device vdb from instance 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef from the persistent domain config.
Nov 29 01:43:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:43:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:43:43 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:43:43 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 01:43:43 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:43:43 user nova-compute[75210]:   <serial>e24f7771-9f48-4e6d-84fc-e1116a8a4cc8</serial>
Nov 29 01:43:43 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:43:43 user nova-compute[75210]: </disk>
Nov 29 01:43:43 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:43:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:43:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:45 user nova-compute[75210]: DEBUG nova.compute.manager [req-a07ca50a-38fa-48f2-8cae-8e8ad386744e req-91ebd042-8d76-4c6c-87f2-2aca17795969 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-changed-4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:45 user nova-compute[75210]: DEBUG nova.compute.manager [req-a07ca50a-38fa-48f2-8cae-8e8ad386744e req-91ebd042-8d76-4c6c-87f2-2aca17795969 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing instance network info cache due to event network-changed-4c0c5ded-879a-4468-947e-6350e7e6fcfb. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:43:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a07ca50a-38fa-48f2-8cae-8e8ad386744e req-91ebd042-8d76-4c6c-87f2-2aca17795969 service nova] Acquiring lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:43:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a07ca50a-38fa-48f2-8cae-8e8ad386744e req-91ebd042-8d76-4c6c-87f2-2aca17795969 service nova] Acquired lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:43:45 user nova-compute[75210]: DEBUG nova.network.neutron [req-a07ca50a-38fa-48f2-8cae-8e8ad386744e req-91ebd042-8d76-4c6c-87f2-2aca17795969 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Refreshing network info cache for port 4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:43:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG nova.network.neutron [req-a07ca50a-38fa-48f2-8cae-8e8ad386744e req-91ebd042-8d76-4c6c-87f2-2aca17795969 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updated VIF entry in instance network info cache for port 4c0c5ded-879a-4468-947e-6350e7e6fcfb. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG nova.network.neutron [req-a07ca50a-38fa-48f2-8cae-8e8ad386744e req-91ebd042-8d76-4c6c-87f2-2aca17795969 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [{"id": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "address": "fa:16:3e:82:71:41", "network": {"id": "092bfddb-7c3c-4089-9dce-e1b268de7b95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-57509714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0c5ded-87", "ovs_interfaceid": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fc03e817-29d6-4294-996b-a9f19842a31f", "address": "fa:16:3e:73:a6:3e", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03e817-29", "ovs_interfaceid": "fc03e817-29d6-4294-996b-a9f19842a31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4972db17-fd95-4e98-a344-c1f398acb7e1", "address": "fa:16:3e:a5:cb:6f", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972db17-fd", "ovs_interfaceid": "4972db17-fd95-4e98-a344-c1f398acb7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a07ca50a-38fa-48f2-8cae-8e8ad386744e req-91ebd042-8d76-4c6c-87f2-2aca17795969 service nova] Releasing lock "refresh_cache-d58c8996-9d2f-4dee-93ea-494d976d21a3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG nova.compute.manager [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:43:46 user nova-compute[75210]: INFO nova.compute.claims [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Claim successful on node user
Nov 29 01:43:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG nova.compute.manager [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.194s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:46 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:43:46 user nova-compute[75210]: INFO nova.compute.claims [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Claim successful on node user
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.network.neutron [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:43:47 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.policy [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ead7b0e78f3404fa0d0a1140bfb87d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b3548901d314e8594d539c6f41563e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:43:47 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Creating image(s)
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "/opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "/opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk 1073741824" returned: 0 in 0.059s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:47 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.policy [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28fd6f01158e4dd7a7df3e04e815a9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34af8bfc0e1b4cbbb803c3bf6a8f7715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:43:47 user nova-compute[75210]: INFO nova.virt.block_device [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Booting with blank volume at /dev/vda
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:43:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Successfully created port: beb5773e-cc94-4ca8-b059-edccdafe0ee2 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:48 user nova-compute[75210]: INFO nova.compute.manager [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Terminating instance
Nov 29 01:43:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Cannot resize image /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Ensure instance console log exists: /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Successfully created port: 7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-ded7965a-33b9-4e0b-a6c0-dfe2d8356186 req-bb7d83f9-daa3-47c3-8acc-fcfd28667551 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-unplugged-4972db17-fd95-4e98-a344-c1f398acb7e1 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ded7965a-33b9-4e0b-a6c0-dfe2d8356186 req-bb7d83f9-daa3-47c3-8acc-fcfd28667551 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ded7965a-33b9-4e0b-a6c0-dfe2d8356186 req-bb7d83f9-daa3-47c3-8acc-fcfd28667551 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ded7965a-33b9-4e0b-a6c0-dfe2d8356186 req-bb7d83f9-daa3-47c3-8acc-fcfd28667551 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-ded7965a-33b9-4e0b-a6c0-dfe2d8356186 req-bb7d83f9-daa3-47c3-8acc-fcfd28667551 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-unplugged-4972db17-fd95-4e98-a344-c1f398acb7e1 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-ded7965a-33b9-4e0b-a6c0-dfe2d8356186 req-bb7d83f9-daa3-47c3-8acc-fcfd28667551 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-unplugged-4972db17-fd95-4e98-a344-c1f398acb7e1 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Successfully updated port: beb5773e-cc94-4ca8-b059-edccdafe0ee2 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "refresh_cache-9e68205c-08b3-40c4-aa6e-7a4730506dd7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquired lock "refresh_cache-9e68205c-08b3-40c4-aa6e-7a4730506dd7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Successfully updated port: 7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquired lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-e57a9384-53ec-4ea7-b140-b126b6542b00 req-dc58cae9-3c8e-4654-ab42-fe3f3536b1e9 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-changed-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-e57a9384-53ec-4ea7-b140-b126b6542b00 req-dc58cae9-3c8e-4654-ab42-fe3f3536b1e9 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Refreshing instance network info cache due to event network-changed-7a2f4623-853c-43d9-9964-d00e16199a0c. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e57a9384-53ec-4ea7-b140-b126b6542b00 req-dc58cae9-3c8e-4654-ab42-fe3f3536b1e9 service nova] Acquiring lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Updating instance_info_cache with network_info: [{"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Releasing lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Instance network_info: |[{"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e57a9384-53ec-4ea7-b140-b126b6542b00 req-dc58cae9-3c8e-4654-ab42-fe3f3536b1e9 service nova] Acquired lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG nova.network.neutron [req-e57a9384-53ec-4ea7-b140-b126b6542b00 req-dc58cae9-3c8e-4654-ab42-fe3f3536b1e9 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Refreshing network info cache for port 7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Instance destroyed successfully.
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lazy-loading 'resources' on Instance uuid d58c8996-9d2f-4dee-93ea-494d976d21a3 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "address": "fa:16:3e:82:71:41", "network": {"id": "092bfddb-7c3c-4089-9dce-e1b268de7b95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-57509714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0c5ded-87", "ovs_interfaceid": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "address": "fa:16:3e:82:71:41", "network": {"id": "092bfddb-7c3c-4089-9dce-e1b268de7b95", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-57509714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c0c5ded-87", "ovs_interfaceid": "4c0c5ded-879a-4468-947e-6350e7e6fcfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:71:41,bridge_name='br-int',has_traffic_filtering=True,id=4c0c5ded-879a-4468-947e-6350e7e6fcfb,network=Network(092bfddb-7c3c-4089-9dce-e1b268de7b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0c5ded-87') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:71:41,bridge_name='br-int',has_traffic_filtering=True,id=4c0c5ded-879a-4468-947e-6350e7e6fcfb,network=Network(092bfddb-7c3c-4089-9dce-e1b268de7b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0c5ded-87') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c0c5ded-87, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.neutron [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Updating instance_info_cache with network_info: [{"id": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "address": "fa:16:3e:2c:d5:60", "network": {"id": "f7f2fdcd-98d0-400f-ab35-1b17eb41c393", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-857788537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b3548901d314e8594d539c6f41563e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb5773e-cc", "ovs_interfaceid": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Releasing lock "refresh_cache-9e68205c-08b3-40c4-aa6e-7a4730506dd7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Instance network_info: |[{"id": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "address": "fa:16:3e:2c:d5:60", "network": {"id": "f7f2fdcd-98d0-400f-ab35-1b17eb41c393", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-857788537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b3548901d314e8594d539c6f41563e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb5773e-cc", "ovs_interfaceid": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Start _get_guest_xml network_info=[{"id": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "address": "fa:16:3e:2c:d5:60", "network": {"id": "f7f2fdcd-98d0-400f-ab35-1b17eb41c393", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-857788537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b3548901d314e8594d539c6f41563e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb5773e-cc", "ovs_interfaceid": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7af90a87-1b82-4055-8096-a255b01fb49c) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:43:50 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:43:50 user nova-compute[75210]: INFO nova.compute.claims [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Claim successful on node user
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2065532084',display_name='tempest-DeleteServersTestJSON-server-2065532084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2065532084',id=23,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b3548901d314e8594d539c6f41563e5',ramdisk_id='',reservation_id='r-72tny6p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1271149131',owner_user_name='tempest-DeleteServersTestJSON-1271149131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:43:47Z,user_data=None,user_id='4ead7b0e78f3404fa0d0a1140bfb87d7',uuid=9e68205c-08b3-40c4-aa6e-7a4730506dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "address": "fa:16:3e:2c:d5:60", "network": {"id": "f7f2fdcd-98d0-400f-ab35-1b17eb41c393", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-857788537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b3548901d314e8594d539c6f41563e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb5773e-cc", "ovs_interfaceid": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Converting VIF {"id": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "address": "fa:16:3e:2c:d5:60", "network": {"id": "f7f2fdcd-98d0-400f-ab35-1b17eb41c393", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-857788537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b3548901d314e8594d539c6f41563e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb5773e-cc", "ovs_interfaceid": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=beb5773e-cc94-4ca8-b059-edccdafe0ee2,network=Network(f7f2fdcd-98d0-400f-ab35-1b17eb41c393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb5773e-cc') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e68205c-08b3-40c4-aa6e-7a4730506dd7 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-0d344570-1319-46a3-beef-7f9a4257d818 req-520dd3d9-9352-4946-88ea-91fcb02ebe5c service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-unplugged-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0d344570-1319-46a3-beef-7f9a4257d818 req-520dd3d9-9352-4946-88ea-91fcb02ebe5c service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0d344570-1319-46a3-beef-7f9a4257d818 req-520dd3d9-9352-4946-88ea-91fcb02ebe5c service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0d344570-1319-46a3-beef-7f9a4257d818 req-520dd3d9-9352-4946-88ea-91fcb02ebe5c service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-0d344570-1319-46a3-beef-7f9a4257d818 req-520dd3d9-9352-4946-88ea-91fcb02ebe5c service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-unplugged-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-0d344570-1319-46a3-beef-7f9a4257d818 req-520dd3d9-9352-4946-88ea-91fcb02ebe5c service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-unplugged-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:43:50 user nova-compute[75210]: INFO os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:71:41,bridge_name='br-int',has_traffic_filtering=True,id=4c0c5ded-879a-4468-947e-6350e7e6fcfb,network=Network(092bfddb-7c3c-4089-9dce-e1b268de7b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c0c5ded-87')
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:97:72,bridge_name='br-int',has_traffic_filtering=True,id=b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb45ea8d7-0f') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:97:72,bridge_name='br-int',has_traffic_filtering=True,id=b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb45ea8d7-0f') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:43:50 user nova-compute[75210]:   <uuid>9e68205c-08b3-40c4-aa6e-7a4730506dd7</uuid>
Nov 29 01:43:50 user nova-compute[75210]:   <name>instance-00000017</name>
Nov 29 01:43:50 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:43:50 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:43:50 user nova-compute[75210]:   <metadata>
Nov 29 01:43:50 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:43:50 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:43:50 user nova-compute[75210]:       <nova:name>tempest-DeleteServersTestJSON-server-2065532084</nova:name>
Nov 29 01:43:50 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:43:50</nova:creationTime>
Nov 29 01:43:50 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:43:50 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:43:50 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:43:50 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:43:50 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:43:50 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:43:50 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:43:50 user nova-compute[75210]:       <nova:owner>
Nov 29 01:43:50 user nova-compute[75210]:         <nova:user uuid="4ead7b0e78f3404fa0d0a1140bfb87d7">tempest-DeleteServersTestJSON-1271149131-project-member</nova:user>
Nov 29 01:43:50 user nova-compute[75210]:         <nova:project uuid="4b3548901d314e8594d539c6f41563e5">tempest-DeleteServersTestJSON-1271149131</nova:project>
Nov 29 01:43:50 user nova-compute[75210]:       </nova:owner>
Nov 29 01:43:50 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:43:50 user nova-compute[75210]:       <nova:ports>
Nov 29 01:43:50 user nova-compute[75210]:         <nova:port uuid="beb5773e-cc94-4ca8-b059-edccdafe0ee2">
Nov 29 01:43:50 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 01:43:50 user nova-compute[75210]:         </nova:port>
Nov 29 01:43:50 user nova-compute[75210]:       </nova:ports>
Nov 29 01:43:50 user nova-compute[75210]:     </nova:instance>
Nov 29 01:43:50 user nova-compute[75210]:   </metadata>
Nov 29 01:43:50 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:43:50 user nova-compute[75210]:     <system>
Nov 29 01:43:50 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:43:50 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:43:50 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:43:50 user nova-compute[75210]:       <entry name="serial">9e68205c-08b3-40c4-aa6e-7a4730506dd7</entry>
Nov 29 01:43:50 user nova-compute[75210]:       <entry name="uuid">9e68205c-08b3-40c4-aa6e-7a4730506dd7</entry>
Nov 29 01:43:50 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:43:50 user nova-compute[75210]:     </system>
Nov 29 01:43:50 user nova-compute[75210]:   </sysinfo>
Nov 29 01:43:50 user nova-compute[75210]:   <os>
Nov 29 01:43:50 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:43:50 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:43:50 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:43:50 user nova-compute[75210]:   </os>
Nov 29 01:43:50 user nova-compute[75210]:   <features>
Nov 29 01:43:50 user nova-compute[75210]:     <acpi/>
Nov 29 01:43:50 user nova-compute[75210]:     <apic/>
Nov 29 01:43:50 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:43:50 user nova-compute[75210]:   </features>
Nov 29 01:43:50 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:43:50 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:43:50 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:43:50 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:43:50 user nova-compute[75210]:   </clock>
Nov 29 01:43:50 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:43:50 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:43:50 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:43:50 user nova-compute[75210]:   </cpu>
Nov 29 01:43:50 user nova-compute[75210]:   <devices>
Nov 29 01:43:50 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:43:50 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:43:50 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk"/>
Nov 29 01:43:50 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:43:50 user nova-compute[75210]:     </disk>
Nov 29 01:43:50 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:43:50 user nova-compute[75210]:       <mac address="fa:16:3e:2c:d5:60"/>
Nov 29 01:43:50 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:43:50 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:43:50 user nova-compute[75210]:       <target dev="tapbeb5773e-cc"/>
Nov 29 01:43:50 user nova-compute[75210]:     </interface>
Nov 29 01:43:50 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:43:50 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/console.log" append="off"/>
Nov 29 01:43:50 user nova-compute[75210]:     </serial>
Nov 29 01:43:50 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:43:50 user nova-compute[75210]:     <video>
Nov 29 01:43:50 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:43:50 user nova-compute[75210]:     </video>
Nov 29 01:43:50 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:43:50 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:43:50 user nova-compute[75210]:     </rng>
Nov 29 01:43:50 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:43:50 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:43:50 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:43:50 user nova-compute[75210]:     </memballoon>
Nov 29 01:43:50 user nova-compute[75210]:   </devices>
Nov 29 01:43:50 user nova-compute[75210]: </domain>
Nov 29 01:43:50 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2065532084',display_name='tempest-DeleteServersTestJSON-server-2065532084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2065532084',id=23,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b3548901d314e8594d539c6f41563e5',ramdisk_id='',reservation_id='r-72tny6p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1271149131',owner_user_name='tempest-DeleteServersTestJSON-1271149131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:43:47Z,user_data=None,user_id='4ead7b0e78f3404fa0d0a1140bfb87d7',uuid=9e68205c-08b3-40c4-aa6e-7a4730506dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "address": "fa:16:3e:2c:d5:60", "network": {"id": "f7f2fdcd-98d0-400f-ab35-1b17eb41c393", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-857788537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b3548901d314e8594d539c6f41563e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb5773e-cc", "ovs_interfaceid": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Converting VIF {"id": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "address": "fa:16:3e:2c:d5:60", "network": {"id": "f7f2fdcd-98d0-400f-ab35-1b17eb41c393", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-857788537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b3548901d314e8594d539c6f41563e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb5773e-cc", "ovs_interfaceid": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=beb5773e-cc94-4ca8-b059-edccdafe0ee2,network=Network(f7f2fdcd-98d0-400f-ab35-1b17eb41c393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb5773e-cc') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_vif [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=beb5773e-cc94-4ca8-b059-edccdafe0ee2,network=Network(f7f2fdcd-98d0-400f-ab35-1b17eb41c393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb5773e-cc') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb45ea8d7-0f, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9573e12-c7ad-4d93-b548-bad213098b14) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed1caa8a-8e8e-561c-a9a8-da299172c2ae', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: INFO os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:97:72,bridge_name='br-int',has_traffic_filtering=True,id=b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb45ea8d7-0f')
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:39:15,bridge_name='br-int',has_traffic_filtering=True,id=364b4f4d-0e28-46e2-abb2-6e4742a8caf2,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap364b4f4d-0e') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:39:15,bridge_name='br-int',has_traffic_filtering=True,id=364b4f4d-0e28-46e2-abb2-6e4742a8caf2,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap364b4f4d-0e') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap364b4f4d-0e, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.neutron [req-e57a9384-53ec-4ea7-b140-b126b6542b00 req-dc58cae9-3c8e-4654-ab42-fe3f3536b1e9 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Updated VIF entry in instance network info cache for port 7a2f4623-853c-43d9-9964-d00e16199a0c. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.neutron [req-e57a9384-53ec-4ea7-b140-b126b6542b00 req-dc58cae9-3c8e-4654-ab42-fe3f3536b1e9 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Updating instance_info_cache with network_info: [{"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e57a9384-53ec-4ea7-b140-b126b6542b00 req-dc58cae9-3c8e-4654-ab42-fe3f3536b1e9 service nova] Releasing lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbeb5773e-cc, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbeb5773e-cc, col_values=(('qos', UUID('6a98a90b-25a0-483f-a200-a6c14119fbdf')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbeb5773e-cc, col_values=(('external_ids', {'iface-id': 'beb5773e-cc94-4ca8-b059-edccdafe0ee2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:d5:60', 'vm-uuid': '9e68205c-08b3-40c4-aa6e-7a4730506dd7'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: INFO os_vif [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=beb5773e-cc94-4ca8-b059-edccdafe0ee2,network=Network(f7f2fdcd-98d0-400f-ab35-1b17eb41c393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb5773e-cc')
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1454608-b560-40b5-a4b6-7264d5e2fa77) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: INFO os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:39:15,bridge_name='br-int',has_traffic_filtering=True,id=364b4f4d-0e28-46e2-abb2-6e4742a8caf2,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap364b4f4d-0e')
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc03e817-29d6-4294-996b-a9f19842a31f", "address": "fa:16:3e:73:a6:3e", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03e817-29", "ovs_interfaceid": "fc03e817-29d6-4294-996b-a9f19842a31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "fc03e817-29d6-4294-996b-a9f19842a31f", "address": "fa:16:3e:73:a6:3e", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03e817-29", "ovs_interfaceid": "fc03e817-29d6-4294-996b-a9f19842a31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fc03e817-29d6-4294-996b-a9f19842a31f,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03e817-29') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fc03e817-29d6-4294-996b-a9f19842a31f,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03e817-29') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc03e817-29, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] No VIF found with MAC fa:16:3e:2c:d5:60, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cc72d56-fe47-4cea-be27-8adbd353d8ce) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: INFO os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:a6:3e,bridge_name='br-int',has_traffic_filtering=True,id=fc03e817-29d6-4294-996b-a9f19842a31f,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc03e817-29')
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3f3c7-0f') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3f3c7-0f') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5f3f3c7-0f, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=453a28a8-7826-448b-8961-32c6423f7651) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: INFO os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea,network=Network(301df129-01c9-4167-9e65-e5d5337e378a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3f3c7-0f')
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ef:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd63e4ca-60d0-4187-aea7-05ac89a7ded0,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd63e4ca-60') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ef:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd63e4ca-60d0-4187-aea7-05ac89a7ded0,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd63e4ca-60') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd63e4ca-60, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16ba824c-e7ab-4a08-b2ca-821f23af2d7b) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: INFO os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ef:6c,bridge_name='br-int',has_traffic_filtering=True,id=fd63e4ca-60d0-4187-aea7-05ac89a7ded0,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd63e4ca-60')
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-29T01:41:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1072582985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1072582985',id=17,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMznAgiczdXX2uKxXlCN6Hhoigujc8VOrMvtjUa96rpUfCtS6m8n9gxb2Q+JA9TQLiJ16/+VSsNPaiq9nGKERq+mp9AdFsWACN3D26WVfM+c+gmQNxj4Ryx5548sEfxNA==',key_name='tempest-keypair-429210116',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bfe843dfdc4752a350bcacc36a31cd',ramdisk_id='',reservation_id='r-8ug63ujt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-596152178',owner_user_name='tempest-TaggedBootDevicesTest-596152178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3274c54e33ca46cb83f6c899090be306',uuid=d58c8996-9d2f-4dee-93ea-494d976d21a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4972db17-fd95-4e98-a344-c1f398acb7e1", "address": "fa:16:3e:a5:cb:6f", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972db17-fd", "ovs_interfaceid": "4972db17-fd95-4e98-a344-c1f398acb7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converting VIF {"id": "4972db17-fd95-4e98-a344-c1f398acb7e1", "address": "fa:16:3e:a5:cb:6f", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972db17-fd", "ovs_interfaceid": "4972db17-fd95-4e98-a344-c1f398acb7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cb:6f,bridge_name='br-int',has_traffic_filtering=True,id=4972db17-fd95-4e98-a344-c1f398acb7e1,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972db17-fd') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cb:6f,bridge_name='br-int',has_traffic_filtering=True,id=4972db17-fd95-4e98-a344-c1f398acb7e1,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972db17-fd') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4972db17-fd, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cf1eec4-ad4f-4a5b-91c7-5280ce0da417) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:43:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:50 user nova-compute[75210]: INFO os_vif [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cb:6f,bridge_name='br-int',has_traffic_filtering=True,id=4972db17-fd95-4e98-a344-c1f398acb7e1,network=Network(ee308ccb-0084-4374-98eb-aaeb73ae6536),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972db17-fd')
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RsCAWjvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:43:50 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad46c2cc-1476-4c69-ab77-efc2c41d6a05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:43:50 user nova-compute[75210]: No targets found.
Nov 29 01:43:50 user nova-compute[75210]: iSNS:
Nov 29 01:43:50 user nova-compute[75210]: No targets found.
Nov 29 01:43:50 user nova-compute[75210]: STATIC:
Nov 29 01:43:50 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390
Nov 29 01:43:50 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:43:50 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:43:50 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee
Nov 29 01:43:50 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:43:50 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:43:50 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e
Nov 29 01:43:50 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:43:50 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:43:50 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8
Nov 29 01:43:50 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:43:50 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:43:50 user nova-compute[75210]: FIRMWARE:
Nov 29 01:43:50 user nova-compute[75210]: No targets found.
Nov 29 01:43:50 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:43:50 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:43:50 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e05219a-8178-43b0-b6aa-1fd4c6582525]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.policy [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89b06e3329c840ee909d50b211f975d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f125ec37cd94d9eb54cd9ecc2343331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff20847b-5857-4be6-bd45-4e3efcbd7952]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:43:50 user nova-compute[75210]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)
Nov 29 01:43:50 user nova-compute[75210]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)
Nov 29 01:43:50 user nova-compute[75210]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:43:50 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:43:50 user nova-compute[75210]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee (non-flash)
Nov 29 01:43:50 user nova-compute[75210]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)
Nov 29 01:43:50 user nova-compute[75210]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:43:50 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f240811a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7facffe1-24d4-4fa3-acb5-53cfb9dccf8e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:43:51 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Creating image(s)
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "/opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "/opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff824f13-7c0c-4d26-8d74-8e512d74f6b4]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8208b7a0-3bef-4755-8c08-49e037ba6c84]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[500e3bff-37de-48cb-a449-6a7ab88223dd]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[843cdd7a-9c06-4f1b-9402-68d4be20149f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfc963e-9fd7-4d42-9ae0-c9ec5120bb08]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee, portal: 172.16.0.220,3260]
Nov 29 01:43:51 user nova-compute[75210]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee, portal: 172.16.0.220,3260] successful.
Nov 29 01:43:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.190s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cb50d8a-f810-4511-ae25-b0bfd424bbee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e6cc94-fc4f-456c-92a8-d452581183ab]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] <== disconnect_volume: return (425ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKPaLJjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:43:51 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ba570e-3df1-4e9b-b082-45144c7267c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:43:51 user nova-compute[75210]: No targets found.
Nov 29 01:43:51 user nova-compute[75210]: iSNS:
Nov 29 01:43:51 user nova-compute[75210]: No targets found.
Nov 29 01:43:51 user nova-compute[75210]: STATIC:
Nov 29 01:43:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390
Nov 29 01:43:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:43:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:43:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e
Nov 29 01:43:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:43:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:43:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8
Nov 29 01:43:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:43:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:43:51 user nova-compute[75210]: FIRMWARE:
Nov 29 01:43:51 user nova-compute[75210]: No targets found.
Nov 29 01:43:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:43:51 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:43:51 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Received event network-changed-beb5773e-cc94-4ca8-b059-edccdafe0ee2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Refreshing instance network info cache due to event network-changed-beb5773e-cc94-4ca8-b059-edccdafe0ee2. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] Acquiring lock "refresh_cache-9e68205c-08b3-40c4-aa6e-7a4730506dd7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] Acquired lock "refresh_cache-9e68205c-08b3-40c4-aa6e-7a4730506dd7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.network.neutron [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Refreshing network info cache for port beb5773e-cc94-4ca8-b059-edccdafe0ee2 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9167ffc-f4df-49d2-9260-3bef96037571]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[368389d3-d277-4149-91b8-54e8c8eebef8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:43:51 user nova-compute[75210]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)
Nov 29 01:43:51 user nova-compute[75210]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:43:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e (non-flash)
Nov 29 01:43:51 user nova-compute[75210]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)
Nov 29 01:43:51 user nova-compute[75210]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:43:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f2c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cc38b9-22eb-41d2-a0de-da94a6b5e8b6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.185s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ff607c-15b1-45d9-9f89-de12764786f3]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk 1073741824" returned: 0 in 0.070s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eae45ea-85dc-425c-95d3-17cf3aebfb02]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c474bfb-74d5-4060-86af-348f34758cf8]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[affa4e16-e406-4af3-8f34-b35b81d20cd5]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Successfully created port: 8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.196s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fde8ac-fff0-4021-91dd-635182863a55]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e, portal: 172.16.0.220,3260]
Nov 29 01:43:51 user nova-compute[75210]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e, portal: 172.16.0.220,3260] successful.
Nov 29 01:43:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:234e3ad8-a6dd-4d36-8bc7-2df46e6c6f5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bd194c-ac77-43af-bd0a-9bbb5b6fd8a5]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.482s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] <== disconnect_volume: return (484ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTgIRGtm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:43:51 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d2262d-93cc-41b4-a1ed-4b3a374f9cba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:43:51 user nova-compute[75210]: No targets found.
Nov 29 01:43:51 user nova-compute[75210]: iSNS:
Nov 29 01:43:51 user nova-compute[75210]: No targets found.
Nov 29 01:43:51 user nova-compute[75210]: STATIC:
Nov 29 01:43:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390
Nov 29 01:43:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:43:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:43:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8
Nov 29 01:43:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:43:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:43:51 user nova-compute[75210]: FIRMWARE:
Nov 29 01:43:51 user nova-compute[75210]: No targets found.
Nov 29 01:43:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:43:51 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:43:51 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10607bf-8164-4211-957c-8a11cc78301b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d59b220-453d-496a-8642-626d3481e10f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)
Nov 29 01:43:51 user nova-compute[75210]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:43:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 (non-flash)
Nov 29 01:43:51 user nova-compute[75210]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:43:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e8525900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390'): ({'sdd'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Removing single pathed devices sdd {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Cannot resize image /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Ensure instance console log exists: /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40e7f9c-b7f5-4e55-b098-670f9aba5941]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.network.neutron [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Updated VIF entry in instance network info cache for port beb5773e-cc94-4ca8-b059-edccdafe0ee2. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.network.neutron [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Updating instance_info_cache with network_info: [{"id": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "address": "fa:16:3e:2c:d5:60", "network": {"id": "f7f2fdcd-98d0-400f-ab35-1b17eb41c393", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-857788537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b3548901d314e8594d539c6f41563e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb5773e-cc", "ovs_interfaceid": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d903308b-eb48-4262-acec-5527c6945909]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Flushing IO for device /dev/sdd {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] Releasing lock "refresh_cache-9e68205c-08b3-40c4-aa6e-7a4730506dd7" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-4972db17-fd95-4e98-a344-c1f398acb7e1 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-4972db17-fd95-4e98-a344-c1f398acb7e1 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:51 user nova-compute[75210]: WARNING nova.compute.manager [req-f8500e58-bff4-498c-b355-fe81fd1b0076 req-276d9c1c-6d06-429f-9818-6c0d034aa5b2 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-4972db17-fd95-4e98-a344-c1f398acb7e1 for instance with vm_state active and task_state deleting.
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[632dbc1b-288c-4422-9341-4b5cd0d7eba4]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bba0e5-68d8-44ea-b3ce-61b34393a8d9]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b2e749-4214-4fd8-beb0-42627214beca]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --logout" returned: 0 in 0.197s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a35ef46-0391-412e-aff9-8f86d29b162c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390, portal: 172.16.0.220,3260]
Nov 29 01:43:52 user nova-compute[75210]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390, portal: 172.16.0.220,3260] successful.
Nov 29 01:43:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a5a91e3-7f1e-4424-a0b9-2dc0c9b0c390 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bbfde6-e3cc-440f-861f-2d63e922aff0]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.475s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] <== disconnect_volume: return (476ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:43:52 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Deleting instance files /opt/stack/data/nova/instances/d58c8996-9d2f-4dee-93ea-494d976d21a3_del
Nov 29 01:43:52 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Deletion of /opt/stack/data/nova/instances/d58c8996-9d2f-4dee-93ea-494d976d21a3_del complete
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Successfully updated port: 8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "refresh_cache-e6c9606c-5a27-417d-9042-259ce728e175" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquired lock "refresh_cache-e6c9606c-5a27-417d-9042-259ce728e175" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-422ea352-6de1-43d8-8ebf-d60536900be8 req-efb02d69-18a5-4987-8d18-cfefa31b7e33 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Received event network-changed-8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-422ea352-6de1-43d8-8ebf-d60536900be8 req-efb02d69-18a5-4987-8d18-cfefa31b7e33 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Refreshing instance network info cache due to event network-changed-8e683807-4401-4160-a0b1-ae1ca4cc8090. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-422ea352-6de1-43d8-8ebf-d60536900be8 req-efb02d69-18a5-4987-8d18-cfefa31b7e33 service nova] Acquiring lock "refresh_cache-e6c9606c-5a27-417d-9042-259ce728e175" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:52 user nova-compute[75210]: WARNING nova.compute.manager [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a for instance with vm_state active and task_state deleting.
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-unplugged-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-unplugged-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-unplugged-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:52 user nova-compute[75210]: WARNING nova.compute.manager [req-833b4b72-0e7e-4b9b-9240-9aa925987d2c req-cd85d3aa-788f-4ee4-a99e-3e065c059cd4 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea for instance with vm_state active and task_state deleting.
Nov 29 01:43:52 user nova-compute[75210]: INFO nova.compute.manager [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Took 4.30 seconds to destroy the instance on the hypervisor.
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Updating instance_info_cache with network_info: [{"id": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "address": "fa:16:3e:e2:b3:10", "network": {"id": "0cf68b22-09b9-450b-9c93-c653686008ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1379362399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f125ec37cd94d9eb54cd9ecc2343331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e683807-44", "ovs_interfaceid": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Releasing lock "refresh_cache-e6c9606c-5a27-417d-9042-259ce728e175" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Instance network_info: |[{"id": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "address": "fa:16:3e:e2:b3:10", "network": {"id": "0cf68b22-09b9-450b-9c93-c653686008ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1379362399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f125ec37cd94d9eb54cd9ecc2343331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e683807-44", "ovs_interfaceid": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-422ea352-6de1-43d8-8ebf-d60536900be8 req-efb02d69-18a5-4987-8d18-cfefa31b7e33 service nova] Acquired lock "refresh_cache-e6c9606c-5a27-417d-9042-259ce728e175" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.network.neutron [req-422ea352-6de1-43d8-8ebf-d60536900be8 req-efb02d69-18a5-4987-8d18-cfefa31b7e33 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Refreshing network info cache for port 8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Start _get_guest_xml network_info=[{"id": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "address": "fa:16:3e:e2:b3:10", "network": {"id": "0cf68b22-09b9-450b-9c93-c653686008ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1379362399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f125ec37cd94d9eb54cd9ecc2343331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e683807-44", "ovs_interfaceid": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:43:52 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:43:52 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-914681952',display_name='tempest-SnapshotDataIntegrityTests-server-914681952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-914681952',id=25,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ6wB3gArsZkZF2e8kKsKi8a9Er8TCCCw6nlqeyt8tHH5hnAoAalRHJjcn8/zPVTHhudbv0KYwal2GvI1cPgFCUrJlm8uJngy+awxHg5/ksZL3DZ1sDEvdhR+W0sEd+5A==',key_name='tempest-keypair-1960420796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f125ec37cd94d9eb54cd9ecc2343331',ramdisk_id='',reservation_id='r-0neusz4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2070297232',owner_user_name='tempest-SnapshotDataIntegrityTests-2070297232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b06e3329c840ee909d50b211f975d1',uuid=e6c9606c-5a27-417d-9042-259ce728e175,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "address": "fa:16:3e:e2:b3:10", "network": {"id": "0cf68b22-09b9-450b-9c93-c653686008ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1379362399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f125ec37cd94d9eb54cd9ecc2343331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e683807-44", "ovs_interfaceid": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Converting VIF {"id": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "address": "fa:16:3e:e2:b3:10", "network": {"id": "0cf68b22-09b9-450b-9c93-c653686008ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1379362399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f125ec37cd94d9eb54cd9ecc2343331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e683807-44", "ovs_interfaceid": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:b3:10,bridge_name='br-int',has_traffic_filtering=True,id=8e683807-4401-4160-a0b1-ae1ca4cc8090,network=Network(0cf68b22-09b9-450b-9c93-c653686008ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e683807-44') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'pci_devices' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:43:52 user nova-compute[75210]:   <uuid>e6c9606c-5a27-417d-9042-259ce728e175</uuid>
Nov 29 01:43:52 user nova-compute[75210]:   <name>instance-00000019</name>
Nov 29 01:43:52 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:43:52 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:43:52 user nova-compute[75210]:   <metadata>
Nov 29 01:43:52 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:43:52 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:43:52 user nova-compute[75210]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-914681952</nova:name>
Nov 29 01:43:52 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:43:52</nova:creationTime>
Nov 29 01:43:52 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:43:52 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:43:52 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:43:52 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:43:52 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:43:52 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:43:52 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:43:52 user nova-compute[75210]:       <nova:owner>
Nov 29 01:43:52 user nova-compute[75210]:         <nova:user uuid="89b06e3329c840ee909d50b211f975d1">tempest-SnapshotDataIntegrityTests-2070297232-project-member</nova:user>
Nov 29 01:43:52 user nova-compute[75210]:         <nova:project uuid="6f125ec37cd94d9eb54cd9ecc2343331">tempest-SnapshotDataIntegrityTests-2070297232</nova:project>
Nov 29 01:43:52 user nova-compute[75210]:       </nova:owner>
Nov 29 01:43:52 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:43:52 user nova-compute[75210]:       <nova:ports>
Nov 29 01:43:52 user nova-compute[75210]:         <nova:port uuid="8e683807-4401-4160-a0b1-ae1ca4cc8090">
Nov 29 01:43:52 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 01:43:52 user nova-compute[75210]:         </nova:port>
Nov 29 01:43:52 user nova-compute[75210]:       </nova:ports>
Nov 29 01:43:52 user nova-compute[75210]:     </nova:instance>
Nov 29 01:43:52 user nova-compute[75210]:   </metadata>
Nov 29 01:43:52 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:43:52 user nova-compute[75210]:     <system>
Nov 29 01:43:52 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:43:52 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:43:52 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:43:52 user nova-compute[75210]:       <entry name="serial">e6c9606c-5a27-417d-9042-259ce728e175</entry>
Nov 29 01:43:52 user nova-compute[75210]:       <entry name="uuid">e6c9606c-5a27-417d-9042-259ce728e175</entry>
Nov 29 01:43:52 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:43:52 user nova-compute[75210]:     </system>
Nov 29 01:43:52 user nova-compute[75210]:   </sysinfo>
Nov 29 01:43:52 user nova-compute[75210]:   <os>
Nov 29 01:43:52 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:43:52 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:43:52 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:43:52 user nova-compute[75210]:   </os>
Nov 29 01:43:52 user nova-compute[75210]:   <features>
Nov 29 01:43:52 user nova-compute[75210]:     <acpi/>
Nov 29 01:43:52 user nova-compute[75210]:     <apic/>
Nov 29 01:43:52 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:43:52 user nova-compute[75210]:   </features>
Nov 29 01:43:52 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:43:52 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:43:52 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:43:52 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:43:52 user nova-compute[75210]:   </clock>
Nov 29 01:43:52 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:43:52 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:43:52 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:43:52 user nova-compute[75210]:   </cpu>
Nov 29 01:43:52 user nova-compute[75210]:   <devices>
Nov 29 01:43:52 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:43:52 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:43:52 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk"/>
Nov 29 01:43:52 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:43:52 user nova-compute[75210]:     </disk>
Nov 29 01:43:52 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:43:52 user nova-compute[75210]:       <mac address="fa:16:3e:e2:b3:10"/>
Nov 29 01:43:52 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:43:52 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:43:52 user nova-compute[75210]:       <target dev="tap8e683807-44"/>
Nov 29 01:43:52 user nova-compute[75210]:     </interface>
Nov 29 01:43:52 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:43:52 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/console.log" append="off"/>
Nov 29 01:43:52 user nova-compute[75210]:     </serial>
Nov 29 01:43:52 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:43:52 user nova-compute[75210]:     <video>
Nov 29 01:43:52 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:43:52 user nova-compute[75210]:     </video>
Nov 29 01:43:52 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:43:52 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:43:52 user nova-compute[75210]:     </rng>
Nov 29 01:43:52 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:43:52 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:43:52 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:43:52 user nova-compute[75210]:     </memballoon>
Nov 29 01:43:52 user nova-compute[75210]:   </devices>
Nov 29 01:43:52 user nova-compute[75210]: </domain>
Nov 29 01:43:52 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-914681952',display_name='tempest-SnapshotDataIntegrityTests-server-914681952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-914681952',id=25,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ6wB3gArsZkZF2e8kKsKi8a9Er8TCCCw6nlqeyt8tHH5hnAoAalRHJjcn8/zPVTHhudbv0KYwal2GvI1cPgFCUrJlm8uJngy+awxHg5/ksZL3DZ1sDEvdhR+W0sEd+5A==',key_name='tempest-keypair-1960420796',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f125ec37cd94d9eb54cd9ecc2343331',ramdisk_id='',reservation_id='r-0neusz4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2070297232',owner_user_name='tempest-SnapshotDataIntegrityTests-2070297232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b06e3329c840ee909d50b211f975d1',uuid=e6c9606c-5a27-417d-9042-259ce728e175,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "address": "fa:16:3e:e2:b3:10", "network": {"id": "0cf68b22-09b9-450b-9c93-c653686008ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1379362399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f125ec37cd94d9eb54cd9ecc2343331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e683807-44", "ovs_interfaceid": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Converting VIF {"id": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "address": "fa:16:3e:e2:b3:10", "network": {"id": "0cf68b22-09b9-450b-9c93-c653686008ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1379362399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f125ec37cd94d9eb54cd9ecc2343331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e683807-44", "ovs_interfaceid": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:b3:10,bridge_name='br-int',has_traffic_filtering=True,id=8e683807-4401-4160-a0b1-ae1ca4cc8090,network=Network(0cf68b22-09b9-450b-9c93-c653686008ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e683807-44') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG os_vif [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:b3:10,bridge_name='br-int',has_traffic_filtering=True,id=8e683807-4401-4160-a0b1-ae1ca4cc8090,network=Network(0cf68b22-09b9-450b-9c93-c653686008ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e683807-44') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7f9a14e-c9a1-59ee-97ad-e20103424ef3', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e683807-44, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e683807-44, col_values=(('qos', UUID('10485f25-3fef-43d4-a680-965aa2c748c4')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e683807-44, col_values=(('external_ids', {'iface-id': '8e683807-4401-4160-a0b1-ae1ca4cc8090', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:b3:10', 'vm-uuid': 'e6c9606c-5a27-417d-9042-259ce728e175'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:43:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:52 user nova-compute[75210]: INFO os_vif [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:b3:10,bridge_name='br-int',has_traffic_filtering=True,id=8e683807-4401-4160-a0b1-ae1ca4cc8090,network=Network(0cf68b22-09b9-450b-9c93-c653686008ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e683807-44')
Nov 29 01:43:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No VIF found with MAC fa:16:3e:e2:b3:10, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG nova.network.neutron [req-422ea352-6de1-43d8-8ebf-d60536900be8 req-efb02d69-18a5-4987-8d18-cfefa31b7e33 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Updated VIF entry in instance network info cache for port 8e683807-4401-4160-a0b1-ae1ca4cc8090. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG nova.network.neutron [req-422ea352-6de1-43d8-8ebf-d60536900be8 req-efb02d69-18a5-4987-8d18-cfefa31b7e33 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Updating instance_info_cache with network_info: [{"id": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "address": "fa:16:3e:e2:b3:10", "network": {"id": "0cf68b22-09b9-450b-9c93-c653686008ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1379362399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f125ec37cd94d9eb54cd9ecc2343331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e683807-44", "ovs_interfaceid": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-422ea352-6de1-43d8-8ebf-d60536900be8 req-efb02d69-18a5-4987-8d18-cfefa31b7e33 service nova] Releasing lock "refresh_cache-e6c9606c-5a27-417d-9042-259ce728e175" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG os_brick.utils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ee55a4-8bcd-4331-a7d3-1c2ca6a99092]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38db376-7ddd-427a-a115-f71deb8a5fee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93d4b47-4964-4434-83e2-4f464f483bf5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f993364f-ae48-409f-a6cb-8fe715a3b937]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:43:53 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:43:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4dd1ee-e86a-4660-afda-e31b9e45bba6]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG os_brick.utils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:43:53 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Updating existing volume attachment record: 691730bf-78d2-413b-9e7b-78fc119bcfb9 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:43:54 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Instance spawned successfully.
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-unplugged-4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-unplugged-4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-unplugged-4c0c5ded-879a-4468-947e-6350e7e6fcfb for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:54 user nova-compute[75210]: WARNING nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-4c0c5ded-879a-4468-947e-6350e7e6fcfb for instance with vm_state active and task_state deleting.
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-unplugged-fc03e817-29d6-4294-996b-a9f19842a31f {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-unplugged-fc03e817-29d6-4294-996b-a9f19842a31f {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-unplugged-fc03e817-29d6-4294-996b-a9f19842a31f for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-fc03e817-29d6-4294-996b-a9f19842a31f {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-fc03e817-29d6-4294-996b-a9f19842a31f {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:54 user nova-compute[75210]: WARNING nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-fc03e817-29d6-4294-996b-a9f19842a31f for instance with vm_state active and task_state deleting.
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-unplugged-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-unplugged-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a802bad9-65e2-4b57-8516-8b80687c23e8 req-ef3c18e7-0220-4ac5-9514-f0566b7a8bf7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-unplugged-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-66f16397-c24e-4b5b-a835-a469f77dfc2e req-a85e6250-36c3-42e0-81ed-15cff805e78b service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Received event network-changed-91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-66f16397-c24e-4b5b-a835-a469f77dfc2e req-a85e6250-36c3-42e0-81ed-15cff805e78b service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Refreshing instance network info cache due to event network-changed-91762155-8cec-4ac5-aeea-fe198c706136. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-66f16397-c24e-4b5b-a835-a469f77dfc2e req-a85e6250-36c3-42e0-81ed-15cff805e78b service nova] Acquiring lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-66f16397-c24e-4b5b-a835-a469f77dfc2e req-a85e6250-36c3-42e0-81ed-15cff805e78b service nova] Acquired lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.network.neutron [req-66f16397-c24e-4b5b-a835-a469f77dfc2e req-a85e6250-36c3-42e0-81ed-15cff805e78b service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Refreshing network info cache for port 91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:43:54 user nova-compute[75210]: INFO nova.compute.manager [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Took 7.22 seconds to spawn the instance on the hypervisor.
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-b0a6e5f9-3ac0-463e-bcbf-c3fd084dfdd6 req-3ab40b8a-ea40-445e-8ba7-5fda1a683390 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-deleted-4c0c5ded-879a-4468-947e-6350e7e6fcfb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:54 user nova-compute[75210]: INFO nova.compute.manager [req-b0a6e5f9-3ac0-463e-bcbf-c3fd084dfdd6 req-3ab40b8a-ea40-445e-8ba7-5fda1a683390 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Neutron deleted interface 4c0c5ded-879a-4468-947e-6350e7e6fcfb; detaching it from the instance and deleting it from the info cache
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.network.neutron [req-b0a6e5f9-3ac0-463e-bcbf-c3fd084dfdd6 req-3ab40b8a-ea40-445e-8ba7-5fda1a683390 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [{"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fc03e817-29d6-4294-996b-a9f19842a31f", "address": "fa:16:3e:73:a6:3e", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.108", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc03e817-29", "ovs_interfaceid": "fc03e817-29d6-4294-996b-a9f19842a31f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4972db17-fd95-4e98-a344-c1f398acb7e1", "address": "fa:16:3e:a5:cb:6f", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972db17-fd", "ovs_interfaceid": "4972db17-fd95-4e98-a344-c1f398acb7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-b0a6e5f9-3ac0-463e-bcbf-c3fd084dfdd6 req-3ab40b8a-ea40-445e-8ba7-5fda1a683390 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Detach interface failed, port_id=4c0c5ded-879a-4468-947e-6350e7e6fcfb, reason: Instance d58c8996-9d2f-4dee-93ea-494d976d21a3 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:43:54 user nova-compute[75210]: INFO nova.compute.manager [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Took 8.17 seconds to build instance.
Nov 29 01:43:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fe9c03d1-d944-4e88-91cd-0f2b0f10662b tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.310s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:55 user nova-compute[75210]: INFO nova.compute.manager [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Rescuing
Nov 29 01:43:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:43:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquired lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:43:55 user nova-compute[75210]: DEBUG nova.network.neutron [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:43:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:55 user nova-compute[75210]: DEBUG nova.network.neutron [req-66f16397-c24e-4b5b-a835-a469f77dfc2e req-a85e6250-36c3-42e0-81ed-15cff805e78b service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updated VIF entry in instance network info cache for port 91762155-8cec-4ac5-aeea-fe198c706136. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:43:55 user nova-compute[75210]: DEBUG nova.network.neutron [req-66f16397-c24e-4b5b-a835-a469f77dfc2e req-a85e6250-36c3-42e0-81ed-15cff805e78b service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updating instance_info_cache with network_info: [{"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-66f16397-c24e-4b5b-a835-a469f77dfc2e req-a85e6250-36c3-42e0-81ed-15cff805e78b service nova] Releasing lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:43:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:55 user nova-compute[75210]: DEBUG nova.network.neutron [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Updating instance_info_cache with network_info: [{"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Releasing lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:43:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-plugged-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Acquiring lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] No waiting events found dispatching network-vif-plugged-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:56 user nova-compute[75210]: WARNING nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received unexpected event network-vif-plugged-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 for instance with vm_state active and task_state deleting.
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Received event network-vif-plugged-beb5773e-cc94-4ca8-b059-edccdafe0ee2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Acquiring lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] No waiting events found dispatching network-vif-plugged-beb5773e-cc94-4ca8-b059-edccdafe0ee2 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:56 user nova-compute[75210]: WARNING nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Received unexpected event network-vif-plugged-beb5773e-cc94-4ca8-b059-edccdafe0ee2 for instance with vm_state active and task_state None.
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Received event network-vif-plugged-beb5773e-cc94-4ca8-b059-edccdafe0ee2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Acquiring lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] No waiting events found dispatching network-vif-plugged-beb5773e-cc94-4ca8-b059-edccdafe0ee2 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:56 user nova-compute[75210]: WARNING nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Received unexpected event network-vif-plugged-beb5773e-cc94-4ca8-b059-edccdafe0ee2 for instance with vm_state active and task_state None.
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Received event network-vif-plugged-8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Lock "e6c9606c-5a27-417d-9042-259ce728e175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Lock "e6c9606c-5a27-417d-9042-259ce728e175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] No waiting events found dispatching network-vif-plugged-8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:56 user nova-compute[75210]: WARNING nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Received unexpected event network-vif-plugged-8e683807-4401-4160-a0b1-ae1ca4cc8090 for instance with vm_state building and task_state spawning.
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Received event network-vif-plugged-8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Lock "e6c9606c-5a27-417d-9042-259ce728e175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] Lock "e6c9606c-5a27-417d-9042-259ce728e175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] No waiting events found dispatching network-vif-plugged-8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:56 user nova-compute[75210]: WARNING nova.compute.manager [req-ac391228-4db2-4278-8580-8aba5317600a req-042ecf81-6372-45b2-84c8-36a736705ebc service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Received unexpected event network-vif-plugged-8e683807-4401-4160-a0b1-ae1ca4cc8090 for instance with vm_state building and task_state spawning.
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-deleted-fc03e817-29d6-4294-996b-a9f19842a31f {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:56 user nova-compute[75210]: INFO nova.compute.manager [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Neutron deleted interface fc03e817-29d6-4294-996b-a9f19842a31f; detaching it from the instance and deleting it from the info cache
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.network.neutron [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [{"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4972db17-fd95-4e98-a344-c1f398acb7e1", "address": "fa:16:3e:a5:cb:6f", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972db17-fd", "ovs_interfaceid": "4972db17-fd95-4e98-a344-c1f398acb7e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Detach interface failed, port_id=fc03e817-29d6-4294-996b-a9f19842a31f, reason: Instance d58c8996-9d2f-4dee-93ea-494d976d21a3 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-deleted-4972db17-fd95-4e98-a344-c1f398acb7e1 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:56 user nova-compute[75210]: INFO nova.compute.manager [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Neutron deleted interface 4972db17-fd95-4e98-a344-c1f398acb7e1; detaching it from the instance and deleting it from the info cache
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.network.neutron [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [{"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "address": "fa:16:3e:e9:60:a3", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3f3c7-0f", "ovs_interfaceid": "e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:56 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Instance destroyed successfully.
Nov 29 01:43:56 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Took 4.31 seconds to deallocate network for instance.
Nov 29 01:43:56 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Attempting rescue
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75210) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Detach interface failed, port_id=4972db17-fd95-4e98-a344-c1f398acb7e1, reason: Instance d58c8996-9d2f-4dee-93ea-494d976d21a3 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-deleted-e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:56 user nova-compute[75210]: INFO nova.compute.manager [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Neutron deleted interface e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea; detaching it from the instance and deleting it from the info cache
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.network.neutron [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [{"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "address": "fa:16:3e:e0:ef:6c", "network": {"id": "ee308ccb-0084-4374-98eb-aaeb73ae6536", "bridge": "br-int", "label": "tempest-device-tagging-net2-1806584217", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd63e4ca-60", "ovs_interfaceid": "fd63e4ca-60d0-4187-aea7-05ac89a7ded0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Instance directory exists: not creating {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 01:43:56 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Creating image(s)
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "/opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "/opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.objects.instance [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa020b7e-c088-4c40-878d-27e43dca4ad0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Detach interface failed, port_id=e5f3f3c7-0fad-4deb-aa10-1fe5ab4b02ea, reason: Instance d58c8996-9d2f-4dee-93ea-494d976d21a3 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received event network-vif-unplugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] Acquiring lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] No waiting events found dispatching network-vif-unplugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:56 user nova-compute[75210]: WARNING nova.compute.manager [req-2d9708a7-0e8b-45ef-8af7-8757413aef7f req-b8e03f56-c1ad-4c24-8224-3a8c763960e7 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received unexpected event network-vif-unplugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 for instance with vm_state active and task_state rescuing.
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:43:56 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Instance spawned successfully.
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:43:56 user nova-compute[75210]: INFO nova.compute.manager [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Took 5.95 seconds to spawn the instance on the hypervisor.
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue" returned: 0 in 0.054s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.objects.instance [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'migration_context' on Instance uuid fa020b7e-c088-4c40-878d-27e43dca4ad0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.objects.base [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<fa020b7e-c088-4c40-878d-27e43dca4ad0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Start _get_guest_xml network_info=[{"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "vif_mac": "fa:16:3e:50:38:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:43:56 user nova-compute[75210]: DEBUG nova.objects.instance [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'resources' on Instance uuid fa020b7e-c088-4c40-878d-27e43dca4ad0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.objects.base [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<fa020b7e-c088-4c40-878d-27e43dca4ad0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.objects.instance [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'numa_topology' on Instance uuid fa020b7e-c088-4c40-878d-27e43dca4ad0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.objects.base [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<fa020b7e-c088-4c40-878d-27e43dca4ad0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:43:57 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:43:57 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.objects.instance [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa020b7e-c088-4c40-878d-27e43dca4ad0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.objects.base [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<fa020b7e-c088-4c40-878d-27e43dca4ad0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-767989198',display_name='tempest-ServerRescueNegativeTestJSON-server-767989198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-767989198',id=20,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ea74c32e3354c9bb76465b39f437026',ramdisk_id='',reservation_id='r-zpy2v0bg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-948038897',owner_user_name='tempest-ServerRescueNegativeTestJSON-948038897-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:42:16Z,user_data=None,user_id='339a0127c78144a989498320081f2c15',uuid=fa020b7e-c088-4c40-878d-27e43dca4ad0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "vif_mac": "fa:16:3e:50:38:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converting VIF {"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "vif_mac": "fa:16:3e:50:38:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:38:41,bridge_name='br-int',has_traffic_filtering=True,id=430b36ae-28e1-4a6b-860f-86b336fb10b3,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430b36ae-28') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.objects.instance [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'pci_devices' on Instance uuid fa020b7e-c088-4c40-878d-27e43dca4ad0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:43:57 user nova-compute[75210]: INFO nova.compute.manager [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Took 7.05 seconds to build instance.
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.objects.base [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<fa020b7e-c088-4c40-878d-27e43dca4ad0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:43:57 user nova-compute[75210]:   <uuid>fa020b7e-c088-4c40-878d-27e43dca4ad0</uuid>
Nov 29 01:43:57 user nova-compute[75210]:   <name>instance-00000014</name>
Nov 29 01:43:57 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:43:57 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:43:57 user nova-compute[75210]:   <metadata>
Nov 29 01:43:57 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:43:57 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:43:57 user nova-compute[75210]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-767989198</nova:name>
Nov 29 01:43:57 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:43:57</nova:creationTime>
Nov 29 01:43:57 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:43:57 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:43:57 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:43:57 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:43:57 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:43:57 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:43:57 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:43:57 user nova-compute[75210]:       <nova:owner>
Nov 29 01:43:57 user nova-compute[75210]:         <nova:user uuid="339a0127c78144a989498320081f2c15">tempest-ServerRescueNegativeTestJSON-948038897-project-member</nova:user>
Nov 29 01:43:57 user nova-compute[75210]:         <nova:project uuid="9ea74c32e3354c9bb76465b39f437026">tempest-ServerRescueNegativeTestJSON-948038897</nova:project>
Nov 29 01:43:57 user nova-compute[75210]:       </nova:owner>
Nov 29 01:43:57 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:43:57 user nova-compute[75210]:       <nova:ports>
Nov 29 01:43:57 user nova-compute[75210]:         <nova:port uuid="430b36ae-28e1-4a6b-860f-86b336fb10b3">
Nov 29 01:43:57 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 01:43:57 user nova-compute[75210]:         </nova:port>
Nov 29 01:43:57 user nova-compute[75210]:       </nova:ports>
Nov 29 01:43:57 user nova-compute[75210]:     </nova:instance>
Nov 29 01:43:57 user nova-compute[75210]:   </metadata>
Nov 29 01:43:57 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:43:57 user nova-compute[75210]:     <system>
Nov 29 01:43:57 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:43:57 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:43:57 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:43:57 user nova-compute[75210]:       <entry name="serial">fa020b7e-c088-4c40-878d-27e43dca4ad0</entry>
Nov 29 01:43:57 user nova-compute[75210]:       <entry name="uuid">fa020b7e-c088-4c40-878d-27e43dca4ad0</entry>
Nov 29 01:43:57 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:43:57 user nova-compute[75210]:     </system>
Nov 29 01:43:57 user nova-compute[75210]:   </sysinfo>
Nov 29 01:43:57 user nova-compute[75210]:   <os>
Nov 29 01:43:57 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:43:57 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:43:57 user nova-compute[75210]:   </os>
Nov 29 01:43:57 user nova-compute[75210]:   <features>
Nov 29 01:43:57 user nova-compute[75210]:     <acpi/>
Nov 29 01:43:57 user nova-compute[75210]:     <apic/>
Nov 29 01:43:57 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:43:57 user nova-compute[75210]:   </features>
Nov 29 01:43:57 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:43:57 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:43:57 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:43:57 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:43:57 user nova-compute[75210]:   </clock>
Nov 29 01:43:57 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:43:57 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:43:57 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:43:57 user nova-compute[75210]:   </cpu>
Nov 29 01:43:57 user nova-compute[75210]:   <devices>
Nov 29 01:43:57 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:43:57 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:43:57 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue"/>
Nov 29 01:43:57 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:43:57 user nova-compute[75210]:     </disk>
Nov 29 01:43:57 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:43:57 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:43:57 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk"/>
Nov 29 01:43:57 user nova-compute[75210]:       <target dev="vdb" bus="virtio"/>
Nov 29 01:43:57 user nova-compute[75210]:     </disk>
Nov 29 01:43:57 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:43:57 user nova-compute[75210]:       <mac address="fa:16:3e:50:38:41"/>
Nov 29 01:43:57 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:43:57 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:43:57 user nova-compute[75210]:       <target dev="tap430b36ae-28"/>
Nov 29 01:43:57 user nova-compute[75210]:     </interface>
Nov 29 01:43:57 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:43:57 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/console.log" append="off"/>
Nov 29 01:43:57 user nova-compute[75210]:     </serial>
Nov 29 01:43:57 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:43:57 user nova-compute[75210]:     <video>
Nov 29 01:43:57 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:43:57 user nova-compute[75210]:     </video>
Nov 29 01:43:57 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:43:57 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:43:57 user nova-compute[75210]:     </rng>
Nov 29 01:43:57 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:43:57 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:43:57 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:43:57 user nova-compute[75210]:     </memballoon>
Nov 29 01:43:57 user nova-compute[75210]:   </devices>
Nov 29 01:43:57 user nova-compute[75210]: </domain>
Nov 29 01:43:57 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c3eba7de-e4c8-4cdb-bdfc-2a7caedc72de tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.204s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:57 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Instance destroyed successfully.
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No VIF found with MAC fa:16:3e:50:38:41, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:43:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-de7c7ae7-8330-41c3-9222-44d876f1b046 req-99e52e08-3eec-492d-8eb8-053639d9ca3f service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Received event network-vif-deleted-fd63e4ca-60d0-4187-aea7-05ac89a7ded0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:58 user nova-compute[75210]: INFO nova.compute.manager [req-de7c7ae7-8330-41c3-9222-44d876f1b046 req-99e52e08-3eec-492d-8eb8-053639d9ca3f service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Neutron deleted interface fd63e4ca-60d0-4187-aea7-05ac89a7ded0; detaching it from the instance and deleting it from the info cache
Nov 29 01:43:58 user nova-compute[75210]: DEBUG nova.network.neutron [req-de7c7ae7-8330-41c3-9222-44d876f1b046 req-99e52e08-3eec-492d-8eb8-053639d9ca3f service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Updating instance_info_cache with network_info: [{"id": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "address": "fa:16:3e:39:97:72", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.227", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb45ea8d7-0f", "ovs_interfaceid": "b45ea8d7-0fb0-4c92-b0c1-b1ddc66b0f3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "address": "fa:16:3e:fc:39:15", "network": {"id": "301df129-01c9-4167-9e65-e5d5337e378a", "bridge": "br-int", "label": "tempest-device-tagging-net1-877680725", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bfe843dfdc4752a350bcacc36a31cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364b4f4d-0e", "ovs_interfaceid": "364b4f4d-0e28-46e2-abb2-6e4742a8caf2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:43:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-de7c7ae7-8330-41c3-9222-44d876f1b046 req-99e52e08-3eec-492d-8eb8-053639d9ca3f service nova] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Detach interface failed, port_id=fd63e4ca-60d0-4187-aea7-05ac89a7ded0, reason: Instance d58c8996-9d2f-4dee-93ea-494d976d21a3 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:43:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-de7c7ae7-8330-41c3-9222-44d876f1b046 req-99e52e08-3eec-492d-8eb8-053639d9ca3f service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received event network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:43:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-de7c7ae7-8330-41c3-9222-44d876f1b046 req-99e52e08-3eec-492d-8eb8-053639d9ca3f service nova] Acquiring lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-de7c7ae7-8330-41c3-9222-44d876f1b046 req-99e52e08-3eec-492d-8eb8-053639d9ca3f service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-de7c7ae7-8330-41c3-9222-44d876f1b046 req-99e52e08-3eec-492d-8eb8-053639d9ca3f service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:43:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-de7c7ae7-8330-41c3-9222-44d876f1b046 req-99e52e08-3eec-492d-8eb8-053639d9ca3f service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] No waiting events found dispatching network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:43:58 user nova-compute[75210]: WARNING nova.compute.manager [req-de7c7ae7-8330-41c3-9222-44d876f1b046 req-99e52e08-3eec-492d-8eb8-053639d9ca3f service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received unexpected event network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 for instance with vm_state active and task_state rescuing.
Nov 29 01:43:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:43:59 user nova-compute[75210]: INFO nova.compute.manager [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] [instance: d58c8996-9d2f-4dee-93ea-494d976d21a3] Took 2.67 seconds to detach 3 volumes for instance.
Nov 29 01:43:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:43:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:43:59 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:43:59 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:43:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:00 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Deleted allocations for instance d58c8996-9d2f-4dee-93ea-494d976d21a3
Nov 29 01:44:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94c1ca4e-345c-413e-9126-6f93a9145426 tempest-TaggedBootDevicesTest-596152178 tempest-TaggedBootDevicesTest-596152178-project-member] Lock "d58c8996-9d2f-4dee-93ea-494d976d21a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.105s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-42f1958d-7b21-41ce-956b-eacb0d45db08 req-5b948b46-6b2c-44e4-b7b9-061974c812ac service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received event network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:44:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-42f1958d-7b21-41ce-956b-eacb0d45db08 req-5b948b46-6b2c-44e4-b7b9-061974c812ac service nova] Acquiring lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-42f1958d-7b21-41ce-956b-eacb0d45db08 req-5b948b46-6b2c-44e4-b7b9-061974c812ac service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-42f1958d-7b21-41ce-956b-eacb0d45db08 req-5b948b46-6b2c-44e4-b7b9-061974c812ac service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-42f1958d-7b21-41ce-956b-eacb0d45db08 req-5b948b46-6b2c-44e4-b7b9-061974c812ac service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] No waiting events found dispatching network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:44:00 user nova-compute[75210]: WARNING nova.compute.manager [req-42f1958d-7b21-41ce-956b-eacb0d45db08 req-5b948b46-6b2c-44e4-b7b9-061974c812ac service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received unexpected event network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 for instance with vm_state active and task_state rescuing.
Nov 29 01:44:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-42f1958d-7b21-41ce-956b-eacb0d45db08 req-5b948b46-6b2c-44e4-b7b9-061974c812ac service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received event network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:44:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-42f1958d-7b21-41ce-956b-eacb0d45db08 req-5b948b46-6b2c-44e4-b7b9-061974c812ac service nova] Acquiring lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-42f1958d-7b21-41ce-956b-eacb0d45db08 req-5b948b46-6b2c-44e4-b7b9-061974c812ac service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-42f1958d-7b21-41ce-956b-eacb0d45db08 req-5b948b46-6b2c-44e4-b7b9-061974c812ac service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-42f1958d-7b21-41ce-956b-eacb0d45db08 req-5b948b46-6b2c-44e4-b7b9-061974c812ac service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] No waiting events found dispatching network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:44:00 user nova-compute[75210]: WARNING nova.compute.manager [req-42f1958d-7b21-41ce-956b-eacb0d45db08 req-5b948b46-6b2c-44e4-b7b9-061974c812ac service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received unexpected event network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 for instance with vm_state active and task_state rescuing.
Nov 29 01:44:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-62417a79-b34f-4c79-be75-d0bdc3129b45 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:44:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Creating image(s)
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Ensure instance console log exists: /opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Start _get_guest_xml network_info=[{"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '691730bf-78d2-413b-9e7b-78fc119bcfb9', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIiTrKbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13274e43-2984-4aa6-ad9b-23e3bbe7c959', 'attached_at': '', 'detached_at': '', 'volume_id': '6ecc5284-b9f3-4bc1-a19f-a2ca55318e29', 'serial': '6ecc5284-b9f3-4bc1-a19f-a2ca55318e29'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:44:02 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:44:02 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIiTrKbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:44:02 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:44:02 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:44:02 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddee499-fde1-4e75-9c53-2cb630d965ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:44:02 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c255f3-b4d7-4381-86fe-cad449e1e485]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29] added
Nov 29 01:44:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad5f35c-b904-49b5-8add-6cc1e85b2012]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bb32fa-e927-462f-b7e9-8824f31d75f9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIiTrKbs {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIiTrKbs" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[54418f15-2d98-430a-832a-a1d00968e173]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIiTrKbs'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f198300d-9875-42aa-8655-895c2285d958]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92864a1-e7ef-404a-b24c-34e253d76b00]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:44:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:44:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3761aca-52ae-4842-a186-c547e780ca2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29, portal: 172.16.0.220,3260]
Nov 29 01:44:02 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29, portal: 172.16.0.220,3260] successful.
Nov 29 01:44:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb7233b-eda3-476a-9909-c6e0c798dd2a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df0e6ff-85e8-44bd-9012-aab7d3e09678]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:44:02 user nova-compute[75210]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:44:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:44:02 user nova-compute[75210]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:44:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b65ac6a-31de-4b67-af70-ce7abcac7b01]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIiTrKbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:44:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23636353230333335', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636353230333335', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-355946989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-355946989',id=24,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-3t40l2p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:43:48Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=13274e43-2984-4aa6-ad9b-23e3bbe7c959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a2:c4,bridge_name='br-int',has_traffic_filtering=True,id=7a2f4623-853c-43d9-9964-d00e16199a0c,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2f4623-85') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG nova.objects.instance [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'pci_devices' on Instance uuid 13274e43-2984-4aa6-ad9b-23e3bbe7c959 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:44:03 user nova-compute[75210]:   <uuid>13274e43-2984-4aa6-ad9b-23e3bbe7c959</uuid>
Nov 29 01:44:03 user nova-compute[75210]:   <name>instance-00000018</name>
Nov 29 01:44:03 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:44:03 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:44:03 user nova-compute[75210]:   <metadata>
Nov 29 01:44:03 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:44:03 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:44:03 user nova-compute[75210]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-355946989</nova:name>
Nov 29 01:44:03 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:44:02</nova:creationTime>
Nov 29 01:44:03 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:44:03 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:44:03 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:44:03 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:44:03 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:44:03 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:44:03 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:44:03 user nova-compute[75210]:       <nova:owner>
Nov 29 01:44:03 user nova-compute[75210]:         <nova:user uuid="28fd6f01158e4dd7a7df3e04e815a9d0">tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member</nova:user>
Nov 29 01:44:03 user nova-compute[75210]:         <nova:project uuid="34af8bfc0e1b4cbbb803c3bf6a8f7715">tempest-ServerBootFromVolumeStableRescueTest-440893694</nova:project>
Nov 29 01:44:03 user nova-compute[75210]:       </nova:owner>
Nov 29 01:44:03 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:44:03 user nova-compute[75210]:       <nova:ports>
Nov 29 01:44:03 user nova-compute[75210]:         <nova:port uuid="7a2f4623-853c-43d9-9964-d00e16199a0c">
Nov 29 01:44:03 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 01:44:03 user nova-compute[75210]:         </nova:port>
Nov 29 01:44:03 user nova-compute[75210]:       </nova:ports>
Nov 29 01:44:03 user nova-compute[75210]:     </nova:instance>
Nov 29 01:44:03 user nova-compute[75210]:   </metadata>
Nov 29 01:44:03 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:44:03 user nova-compute[75210]:     <system>
Nov 29 01:44:03 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:44:03 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:44:03 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:44:03 user nova-compute[75210]:       <entry name="serial">13274e43-2984-4aa6-ad9b-23e3bbe7c959</entry>
Nov 29 01:44:03 user nova-compute[75210]:       <entry name="uuid">13274e43-2984-4aa6-ad9b-23e3bbe7c959</entry>
Nov 29 01:44:03 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:44:03 user nova-compute[75210]:     </system>
Nov 29 01:44:03 user nova-compute[75210]:   </sysinfo>
Nov 29 01:44:03 user nova-compute[75210]:   <os>
Nov 29 01:44:03 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:44:03 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:44:03 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:44:03 user nova-compute[75210]:   </os>
Nov 29 01:44:03 user nova-compute[75210]:   <features>
Nov 29 01:44:03 user nova-compute[75210]:     <acpi/>
Nov 29 01:44:03 user nova-compute[75210]:     <apic/>
Nov 29 01:44:03 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:44:03 user nova-compute[75210]:   </features>
Nov 29 01:44:03 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:44:03 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:44:03 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:44:03 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:44:03 user nova-compute[75210]:   </clock>
Nov 29 01:44:03 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:44:03 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:44:03 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:44:03 user nova-compute[75210]:   </cpu>
Nov 29 01:44:03 user nova-compute[75210]:   <devices>
Nov 29 01:44:03 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:44:03 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:44:03 user nova-compute[75210]:       <source dev="/dev/sdb"/>
Nov 29 01:44:03 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:44:03 user nova-compute[75210]:       <serial>6ecc5284-b9f3-4bc1-a19f-a2ca55318e29</serial>
Nov 29 01:44:03 user nova-compute[75210]:     </disk>
Nov 29 01:44:03 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:44:03 user nova-compute[75210]:       <mac address="fa:16:3e:3d:a2:c4"/>
Nov 29 01:44:03 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:44:03 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:44:03 user nova-compute[75210]:       <target dev="tap7a2f4623-85"/>
Nov 29 01:44:03 user nova-compute[75210]:     </interface>
Nov 29 01:44:03 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:44:03 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/console.log" append="off"/>
Nov 29 01:44:03 user nova-compute[75210]:     </serial>
Nov 29 01:44:03 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:44:03 user nova-compute[75210]:     <video>
Nov 29 01:44:03 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:44:03 user nova-compute[75210]:     </video>
Nov 29 01:44:03 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:44:03 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:44:03 user nova-compute[75210]:     </rng>
Nov 29 01:44:03 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:44:03 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:44:03 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:44:03 user nova-compute[75210]:     </memballoon>
Nov 29 01:44:03 user nova-compute[75210]:   </devices>
Nov 29 01:44:03 user nova-compute[75210]: </domain>
Nov 29 01:44:03 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-355946989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-355946989',id=24,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-3t40l2p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:43:48Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=13274e43-2984-4aa6-ad9b-23e3bbe7c959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a2:c4,bridge_name='br-int',has_traffic_filtering=True,id=7a2f4623-853c-43d9-9964-d00e16199a0c,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2f4623-85') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG os_vif [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a2:c4,bridge_name='br-int',has_traffic_filtering=True,id=7a2f4623-853c-43d9-9964-d00e16199a0c,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2f4623-85') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2bffb67-32cf-52ca-a34d-af8cd565b7cb', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a2f4623-85, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a2f4623-85, col_values=(('qos', UUID('29d4dc11-8600-4af8-a103-720314ff2416')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a2f4623-85, col_values=(('external_ids', {'iface-id': '7a2f4623-853c-43d9-9964-d00e16199a0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:a2:c4', 'vm-uuid': '13274e43-2984-4aa6-ad9b-23e3bbe7c959'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:03 user nova-compute[75210]: INFO os_vif [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a2:c4,bridge_name='br-int',has_traffic_filtering=True,id=7a2f4623-853c-43d9-9964-d00e16199a0c,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2f4623-85')
Nov 29 01:44:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:44:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No VIF found with MAC fa:16:3e:3d:a2:c4, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:44:04 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef is timed out.
Nov 29 01:44:04 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Successfully detached device vdb from instance 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef from the live domain config.
Nov 29 01:44:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kAonmZfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:44:04 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5ec908-b79e-4026-a78f-69f1acc20592]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:44:04 user nova-compute[75210]: No targets found.
Nov 29 01:44:04 user nova-compute[75210]: iSNS:
Nov 29 01:44:04 user nova-compute[75210]: No targets found.
Nov 29 01:44:04 user nova-compute[75210]: STATIC:
Nov 29 01:44:04 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:44:04 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:44:04 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:44:04 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8
Nov 29 01:44:04 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:44:04 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:44:04 user nova-compute[75210]: FIRMWARE:
Nov 29 01:44:04 user nova-compute[75210]: No targets found.
Nov 29 01:44:04 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:44:04 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:44:04 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39cf2c1-fc08-4d42-8243-64d066420e62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3f18fe-2929-405a-a2eb-beae29d2b6c6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:44:04 user nova-compute[75210]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:44:04 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 (non-flash)
Nov 29 01:44:04 user nova-compute[75210]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:44:04 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e84a8550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8'): ({'sde'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Removing single pathed devices sde {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d23610f-30b7-40c7-836e-7135de349796]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[764c4565-21d0-4d80-af62-1fa2331be8c6]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Flushing IO for device /dev/sde {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[327ea471-4fa1-4531-b19f-aa04640f1883]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda65703-9503-417a-82f2-a32fb4ed8199]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de59a30-44c8-44ea-9db5-1354d52656f2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e4e3f9-2bec-41f3-9bd6-638f656937fc]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8, portal: 172.16.0.220,3260]
Nov 29 01:44:04 user nova-compute[75210]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8, portal: 172.16.0.220,3260] successful.
Nov 29 01:44:04 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e24f7771-9f48-4e6d-84fc-e1116a8a4cc8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[48926162-6729-49f5-9087-dab22cff6df8]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] <== disconnect_volume: return (317ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:44:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-cd91a4ef-44cd-4443-9eba-9754fb4e1bc3 req-97cfbae8-799b-4fda-acbf-73f152a37495 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:44:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cd91a4ef-44cd-4443-9eba-9754fb4e1bc3 req-97cfbae8-799b-4fda-acbf-73f152a37495 service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cd91a4ef-44cd-4443-9eba-9754fb4e1bc3 req-97cfbae8-799b-4fda-acbf-73f152a37495 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cd91a4ef-44cd-4443-9eba-9754fb4e1bc3 req-97cfbae8-799b-4fda-acbf-73f152a37495 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-cd91a4ef-44cd-4443-9eba-9754fb4e1bc3 req-97cfbae8-799b-4fda-acbf-73f152a37495 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:44:05 user nova-compute[75210]: WARNING nova.compute.manager [req-cd91a4ef-44cd-4443-9eba-9754fb4e1bc3 req-97cfbae8-799b-4fda-acbf-73f152a37495 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state building and task_state spawning.
Nov 29 01:44:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:05 user nova-compute[75210]: DEBUG nova.objects.instance [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lazy-loading 'flavor' on Instance uuid 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:44:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-581f1fd1-026f-4ae3-973d-aa4b560ab8c5 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.897s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:44:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:44:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Instance spawned successfully.
Nov 29 01:44:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:44:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:44:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:44:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:44:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:44:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:44:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:44:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-d15ac4c2-81fe-4dd3-88b0-47fc1c892c56 req-c35c2388-5899-4100-9e16-465deb41473f service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:44:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d15ac4c2-81fe-4dd3-88b0-47fc1c892c56 req-c35c2388-5899-4100-9e16-465deb41473f service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d15ac4c2-81fe-4dd3-88b0-47fc1c892c56 req-c35c2388-5899-4100-9e16-465deb41473f service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d15ac4c2-81fe-4dd3-88b0-47fc1c892c56 req-c35c2388-5899-4100-9e16-465deb41473f service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-d15ac4c2-81fe-4dd3-88b0-47fc1c892c56 req-c35c2388-5899-4100-9e16-465deb41473f service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:44:07 user nova-compute[75210]: WARNING nova.compute.manager [req-d15ac4c2-81fe-4dd3-88b0-47fc1c892c56 req-c35c2388-5899-4100-9e16-465deb41473f service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state building and task_state spawning.
Nov 29 01:44:07 user nova-compute[75210]: INFO nova.compute.manager [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 29 01:44:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:44:07 user nova-compute[75210]: INFO nova.compute.manager [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Took 20.74 seconds to build instance.
Nov 29 01:44:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ce42fa07-35b4-4dd7-ade2-237c1dbebb5b tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.857s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "97c600c5-63b4-43da-9d80-7ceb3489d338" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:11 user nova-compute[75210]: INFO nova.compute.manager [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Terminating instance
Nov 29 01:44:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:44:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-85180e94-ae27-4b95-9884-0e5a1cebd77a req-84024343-fa38-4ec4-b544-3fd3a6a09d63 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Received event network-vif-unplugged-74e012be-53a7-46e7-910f-d59991008302 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-85180e94-ae27-4b95-9884-0e5a1cebd77a req-84024343-fa38-4ec4-b544-3fd3a6a09d63 service nova] Acquiring lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-85180e94-ae27-4b95-9884-0e5a1cebd77a req-84024343-fa38-4ec4-b544-3fd3a6a09d63 service nova] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-85180e94-ae27-4b95-9884-0e5a1cebd77a req-84024343-fa38-4ec4-b544-3fd3a6a09d63 service nova] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-85180e94-ae27-4b95-9884-0e5a1cebd77a req-84024343-fa38-4ec4-b544-3fd3a6a09d63 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] No waiting events found dispatching network-vif-unplugged-74e012be-53a7-46e7-910f-d59991008302 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-85180e94-ae27-4b95-9884-0e5a1cebd77a req-84024343-fa38-4ec4-b544-3fd3a6a09d63 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Received event network-vif-unplugged-74e012be-53a7-46e7-910f-d59991008302 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:44:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Instance destroyed successfully.
Nov 29 01:44:12 user nova-compute[75210]: DEBUG nova.objects.instance [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lazy-loading 'resources' on Instance uuid 97c600c5-63b4-43da-9d80-7ceb3489d338 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1276104920',display_name='tempest-VolumesActionsTest-instance-1276104920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1276104920',id=21,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:42:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ab6f8371c2b41d6b8a56647698c9639',ramdisk_id='',reservation_id='r-l9ka8msf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1214713951',owner_user_name='tempest-VolumesActionsTest-1214713951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:42:30Z,user_data=None,user_id='56716f093b9044078cb70385c84d53bf',uuid=97c600c5-63b4-43da-9d80-7ceb3489d338,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74e012be-53a7-46e7-910f-d59991008302", "address": "fa:16:3e:d8:51:24", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e012be-53", "ovs_interfaceid": "74e012be-53a7-46e7-910f-d59991008302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Converting VIF {"id": "74e012be-53a7-46e7-910f-d59991008302", "address": "fa:16:3e:d8:51:24", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e012be-53", "ovs_interfaceid": "74e012be-53a7-46e7-910f-d59991008302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:51:24,bridge_name='br-int',has_traffic_filtering=True,id=74e012be-53a7-46e7-910f-d59991008302,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e012be-53') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG os_vif [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:51:24,bridge_name='br-int',has_traffic_filtering=True,id=74e012be-53a7-46e7-910f-d59991008302,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e012be-53') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74e012be-53, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3494fa2b-fd5d-4b30-b846-5e84847864ac) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:44:12 user nova-compute[75210]: INFO os_vif [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:51:24,bridge_name='br-int',has_traffic_filtering=True,id=74e012be-53a7-46e7-910f-d59991008302,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e012be-53')
Nov 29 01:44:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Deleting instance files /opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338_del
Nov 29 01:44:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Deletion of /opt/stack/data/nova/instances/97c600c5-63b4-43da-9d80-7ceb3489d338_del complete
Nov 29 01:44:12 user nova-compute[75210]: INFO nova.compute.manager [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 29 01:44:12 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:44:12 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:44:13 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:44:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-7d03314d-bec9-42be-97cc-4fb371c0c8ac req-31cdd03c-ccbb-46fb-addd-4dc0a39463d5 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Received event network-vif-deleted-74e012be-53a7-46e7-910f-d59991008302 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:44:13 user nova-compute[75210]: INFO nova.compute.manager [req-7d03314d-bec9-42be-97cc-4fb371c0c8ac req-31cdd03c-ccbb-46fb-addd-4dc0a39463d5 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Neutron deleted interface 74e012be-53a7-46e7-910f-d59991008302; detaching it from the instance and deleting it from the info cache
Nov 29 01:44:13 user nova-compute[75210]: DEBUG nova.network.neutron [req-7d03314d-bec9-42be-97cc-4fb371c0c8ac req-31cdd03c-ccbb-46fb-addd-4dc0a39463d5 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:44:13 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Took 0.46 seconds to deallocate network for instance.
Nov 29 01:44:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-7d03314d-bec9-42be-97cc-4fb371c0c8ac req-31cdd03c-ccbb-46fb-addd-4dc0a39463d5 service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Detach interface failed, port_id=74e012be-53a7-46e7-910f-d59991008302, reason: Instance 97c600c5-63b4-43da-9d80-7ceb3489d338 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:44:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:13 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:44:13 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:44:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:13 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Deleted allocations for instance 97c600c5-63b4-43da-9d80-7ceb3489d338
Nov 29 01:44:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fa0c8e05-3428-4569-aa77-874116ac6b8d tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.735s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-cead552d-e14e-4750-ab88-e5e949c6f1dd req-18a03e35-2545-4647-b979-4f89b34e2fba service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Received event network-vif-plugged-74e012be-53a7-46e7-910f-d59991008302 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:44:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cead552d-e14e-4750-ab88-e5e949c6f1dd req-18a03e35-2545-4647-b979-4f89b34e2fba service nova] Acquiring lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cead552d-e14e-4750-ab88-e5e949c6f1dd req-18a03e35-2545-4647-b979-4f89b34e2fba service nova] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cead552d-e14e-4750-ab88-e5e949c6f1dd req-18a03e35-2545-4647-b979-4f89b34e2fba service nova] Lock "97c600c5-63b4-43da-9d80-7ceb3489d338-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-cead552d-e14e-4750-ab88-e5e949c6f1dd req-18a03e35-2545-4647-b979-4f89b34e2fba service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] No waiting events found dispatching network-vif-plugged-74e012be-53a7-46e7-910f-d59991008302 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:44:14 user nova-compute[75210]: WARNING nova.compute.manager [req-cead552d-e14e-4750-ab88-e5e949c6f1dd req-18a03e35-2545-4647-b979-4f89b34e2fba service nova] [instance: 97c600c5-63b4-43da-9d80-7ceb3489d338] Received unexpected event network-vif-plugged-74e012be-53a7-46e7-910f-d59991008302 for instance with vm_state deleted and task_state None.
Nov 29 01:44:14 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:44:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:18 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:44:19 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:44:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:21 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Updating instance_info_cache with network_info: [{"id": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "address": "fa:16:3e:e0:7c:09", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dba9f4e-29", "ovs_interfaceid": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:22 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:44:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:27 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:44:27 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7275MB free_disk=25.211620330810547GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 18aa0259-a720-42aa-be33-4a676dd4d0e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance a6571012-7707-47bc-a057-905eef9d762a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c3eec4ab-96b5-4197-9633-6ffad4f3954e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 9e68205c-08b3-40c4-aa6e-7a4730506dd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance e6c9606c-5a27-417d-9042-259ce728e175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:44:27 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:44:28 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:44:28 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:44:28 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:44:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:29 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:44:29 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:44:29 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:44:29 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:44:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:44:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-3885cf9d-d2e3-4091-b05a-ac376cfab54d req-b23418f2-6a89-465c-b2e3-ee06bd3f012a service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Received event network-changed-baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-3885cf9d-d2e3-4091-b05a-ac376cfab54d req-b23418f2-6a89-465c-b2e3-ee06bd3f012a service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Refreshing instance network info cache due to event network-changed-baede4c5-9db8-44da-89d3-aaa96db265ff. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3885cf9d-d2e3-4091-b05a-ac376cfab54d req-b23418f2-6a89-465c-b2e3-ee06bd3f012a service nova] Acquiring lock "refresh_cache-71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3885cf9d-d2e3-4091-b05a-ac376cfab54d req-b23418f2-6a89-465c-b2e3-ee06bd3f012a service nova] Acquired lock "refresh_cache-71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG nova.network.neutron [req-3885cf9d-d2e3-4091-b05a-ac376cfab54d req-b23418f2-6a89-465c-b2e3-ee06bd3f012a service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Refreshing network info cache for port baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:34 user nova-compute[75210]: INFO nova.compute.manager [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Terminating instance
Nov 29 01:44:34 user nova-compute[75210]: DEBUG nova.compute.manager [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-96e68610-64cb-413f-891c-10c54d82ca7e req-d9fe49f0-03d1-464b-b24d-e4952caefcb3 service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Received event network-vif-unplugged-baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-96e68610-64cb-413f-891c-10c54d82ca7e req-d9fe49f0-03d1-464b-b24d-e4952caefcb3 service nova] Acquiring lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-96e68610-64cb-413f-891c-10c54d82ca7e req-d9fe49f0-03d1-464b-b24d-e4952caefcb3 service nova] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-96e68610-64cb-413f-891c-10c54d82ca7e req-d9fe49f0-03d1-464b-b24d-e4952caefcb3 service nova] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-96e68610-64cb-413f-891c-10c54d82ca7e req-d9fe49f0-03d1-464b-b24d-e4952caefcb3 service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] No waiting events found dispatching network-vif-unplugged-baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-96e68610-64cb-413f-891c-10c54d82ca7e req-d9fe49f0-03d1-464b-b24d-e4952caefcb3 service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Received event network-vif-unplugged-baede4c5-9db8-44da-89d3-aaa96db265ff for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG nova.network.neutron [req-3885cf9d-d2e3-4091-b05a-ac376cfab54d req-b23418f2-6a89-465c-b2e3-ee06bd3f012a service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Updated VIF entry in instance network info cache for port baede4c5-9db8-44da-89d3-aaa96db265ff. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG nova.network.neutron [req-3885cf9d-d2e3-4091-b05a-ac376cfab54d req-b23418f2-6a89-465c-b2e3-ee06bd3f012a service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Updating instance_info_cache with network_info: [{"id": "baede4c5-9db8-44da-89d3-aaa96db265ff", "address": "fa:16:3e:87:f6:47", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaede4c5-9d", "ovs_interfaceid": "baede4c5-9db8-44da-89d3-aaa96db265ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:44:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3885cf9d-d2e3-4091-b05a-ac376cfab54d req-b23418f2-6a89-465c-b2e3-ee06bd3f012a service nova] Releasing lock "refresh_cache-71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:44:35 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Instance destroyed successfully.
Nov 29 01:44:35 user nova-compute[75210]: DEBUG nova.objects.instance [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lazy-loading 'resources' on Instance uuid 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:41:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2144443046',display_name='tempest-TestStampPattern-server-2144443046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2144443046',id=16,image_ref='b063c5c8-5ea7-414c-93c1-fc7f5de30114',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxZJUo/Epb5CYlFBfChMG1V1BPL8V9TPJTvnIOTNFLljvoxCnu1eTJ8d58HUXoSa4EQGvcboO4Biiz1zA+SH1SEBmtS+A0p9yWGjhjTSTNMhoJMfxAVBrvRKESIp2RgtQ==',key_name='tempest-TestStampPattern-770112348',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:41:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b78c3f7409946e18c85ab8bc938d53d',ramdisk_id='',reservation_id='r-bl5aaepq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a6571012-7707-47bc-a057-905eef9d762a',image_min_disk='1',image_min_ram='0',image_owner_id='2b78c3f7409946e18c85ab8bc938d53d',image_owner_project_name='tempest-TestStampPattern-1188739187',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1188739187-project-member',image_user_id='ff068faa6b454eada6a4e1c37a3b0887',owner_project_name='tempest-TestStampPattern-1188739187',owner_user_name='tempest-TestStampPattern-1188739187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:41:50Z,user_data=None,user_id='ff068faa6b454eada6a4e1c37a3b0887',uuid=71a14c13-ff4b-4ab4-bea7-6f3b51be4fef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "baede4c5-9db8-44da-89d3-aaa96db265ff", "address": "fa:16:3e:87:f6:47", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaede4c5-9d", "ovs_interfaceid": "baede4c5-9db8-44da-89d3-aaa96db265ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Converting VIF {"id": "baede4c5-9db8-44da-89d3-aaa96db265ff", "address": "fa:16:3e:87:f6:47", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaede4c5-9d", "ovs_interfaceid": "baede4c5-9db8-44da-89d3-aaa96db265ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:f6:47,bridge_name='br-int',has_traffic_filtering=True,id=baede4c5-9db8-44da-89d3-aaa96db265ff,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaede4c5-9d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG os_vif [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:f6:47,bridge_name='br-int',has_traffic_filtering=True,id=baede4c5-9db8-44da-89d3-aaa96db265ff,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaede4c5-9d') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbaede4c5-9d, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=477ff9e1-879a-447a-a52c-41471cce88a0) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:35 user nova-compute[75210]: INFO os_vif [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:f6:47,bridge_name='br-int',has_traffic_filtering=True,id=baede4c5-9db8-44da-89d3-aaa96db265ff,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaede4c5-9d')
Nov 29 01:44:35 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Deleting instance files /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef_del
Nov 29 01:44:35 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Deletion of /opt/stack/data/nova/instances/71a14c13-ff4b-4ab4-bea7-6f3b51be4fef_del complete
Nov 29 01:44:35 user nova-compute[75210]: INFO nova.compute.manager [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 29 01:44:35 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:44:35 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Took 0.42 seconds to deallocate network for instance.
Nov 29 01:44:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-40061549-4568-4da5-9837-195de7f3995d req-dfcaf41a-963b-414c-884a-a4b43279177b service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Received event network-vif-deleted-baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:44:35 user nova-compute[75210]: INFO nova.compute.manager [req-40061549-4568-4da5-9837-195de7f3995d req-dfcaf41a-963b-414c-884a-a4b43279177b service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Neutron deleted interface baede4c5-9db8-44da-89d3-aaa96db265ff; detaching it from the instance and deleting it from the info cache
Nov 29 01:44:35 user nova-compute[75210]: DEBUG nova.network.neutron [req-40061549-4568-4da5-9837-195de7f3995d req-dfcaf41a-963b-414c-884a-a4b43279177b service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-40061549-4568-4da5-9837-195de7f3995d req-dfcaf41a-963b-414c-884a-a4b43279177b service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Detach interface failed, port_id=baede4c5-9db8-44da-89d3-aaa96db265ff, reason: Instance 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:35 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:44:36 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:44:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:36 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Deleted allocations for instance 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef
Nov 29 01:44:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-70199781-adbc-4c6f-b667-69f07ad64df0 tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.780s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-1a1d856e-2002-4112-94eb-ad81cc5da16b req-668fe8ed-5ca6-4810-be3e-3339f76c03b9 service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Received event network-vif-plugged-baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:44:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a1d856e-2002-4112-94eb-ad81cc5da16b req-668fe8ed-5ca6-4810-be3e-3339f76c03b9 service nova] Acquiring lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:44:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a1d856e-2002-4112-94eb-ad81cc5da16b req-668fe8ed-5ca6-4810-be3e-3339f76c03b9 service nova] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:44:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a1d856e-2002-4112-94eb-ad81cc5da16b req-668fe8ed-5ca6-4810-be3e-3339f76c03b9 service nova] Lock "71a14c13-ff4b-4ab4-bea7-6f3b51be4fef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:44:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-1a1d856e-2002-4112-94eb-ad81cc5da16b req-668fe8ed-5ca6-4810-be3e-3339f76c03b9 service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] No waiting events found dispatching network-vif-plugged-baede4c5-9db8-44da-89d3-aaa96db265ff {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:44:36 user nova-compute[75210]: WARNING nova.compute.manager [req-1a1d856e-2002-4112-94eb-ad81cc5da16b req-668fe8ed-5ca6-4810-be3e-3339f76c03b9 service nova] [instance: 71a14c13-ff4b-4ab4-bea7-6f3b51be4fef] Received unexpected event network-vif-plugged-baede4c5-9db8-44da-89d3-aaa96db265ff for instance with vm_state deleted and task_state None.
Nov 29 01:44:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:44:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 01:44:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:44:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:44:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:44:57 user nova-compute[75210]: DEBUG nova.compute.manager [req-1596462e-cf4a-4519-95fe-e29a185e57e7 req-b0242370-cfb2-4d47-8ab0-03c23ede317e service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Received event network-changed-7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:44:57 user nova-compute[75210]: DEBUG nova.compute.manager [req-1596462e-cf4a-4519-95fe-e29a185e57e7 req-b0242370-cfb2-4d47-8ab0-03c23ede317e service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Refreshing instance network info cache due to event network-changed-7bb61315-6ffe-4248-b5bc-0a4816f95e35. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:44:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1596462e-cf4a-4519-95fe-e29a185e57e7 req-b0242370-cfb2-4d47-8ab0-03c23ede317e service nova] Acquiring lock "refresh_cache-c3eec4ab-96b5-4197-9633-6ffad4f3954e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:44:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1596462e-cf4a-4519-95fe-e29a185e57e7 req-b0242370-cfb2-4d47-8ab0-03c23ede317e service nova] Acquired lock "refresh_cache-c3eec4ab-96b5-4197-9633-6ffad4f3954e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:44:57 user nova-compute[75210]: DEBUG nova.network.neutron [req-1596462e-cf4a-4519-95fe-e29a185e57e7 req-b0242370-cfb2-4d47-8ab0-03c23ede317e service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Refreshing network info cache for port 7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:44:57 user nova-compute[75210]: DEBUG nova.network.neutron [req-1596462e-cf4a-4519-95fe-e29a185e57e7 req-b0242370-cfb2-4d47-8ab0-03c23ede317e service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Updated VIF entry in instance network info cache for port 7bb61315-6ffe-4248-b5bc-0a4816f95e35. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:44:57 user nova-compute[75210]: DEBUG nova.network.neutron [req-1596462e-cf4a-4519-95fe-e29a185e57e7 req-b0242370-cfb2-4d47-8ab0-03c23ede317e service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Updating instance_info_cache with network_info: [{"id": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "address": "fa:16:3e:45:d9:df", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb61315-6f", "ovs_interfaceid": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:44:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1596462e-cf4a-4519-95fe-e29a185e57e7 req-b0242370-cfb2-4d47-8ab0-03c23ede317e service nova] Releasing lock "refresh_cache-c3eec4ab-96b5-4197-9633-6ffad4f3954e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:44:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:00 user nova-compute[75210]: DEBUG nova.objects.instance [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'flavor' on Instance uuid c3eec4ab-96b5-4197-9633-6ffad4f3954e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:01 user nova-compute[75210]: INFO nova.compute.manager [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Attaching volume 566e63fe-8c59-42a5-9d94-eaf3abd67a85 to /dev/vdb
Nov 29 01:45:01 user nova-compute[75210]: DEBUG os_brick.utils [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[788eae21-e6e5-4283-9e73-6eec3c10bdfb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31a40d1-f3aa-416d-a3cf-576f7911eae7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98158a2-28d0-4b4f-88aa-ace47678849e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b677c22-74a6-46e5-a3b3-4a386b92d6d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:45:01 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:45:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ea61f7-c28d-4c10-81ed-a77bc391601c]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG os_brick.utils [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:45:01 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Updating existing volume attachment record: db93240c-8467-4d7e-866b-6eaf3e36449f {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:45:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:45:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:03 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:45:03 user nova-compute[75210]: INFO nova.compute.claims [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Claim successful on node user
Nov 29 01:45:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG nova.compute.manager [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG nova.compute.manager [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG nova.network.neutron [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:45:04 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:45:04 user nova-compute[75210]: DEBUG nova.compute.manager [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG nova.compute.manager [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:45:04 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Creating image(s)
Nov 29 01:45:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "/opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "/opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "/opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG nova.policy [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56716f093b9044078cb70385c84d53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab6f8371c2b41d6b8a56647698c9639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.287s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk 1073741824" returned: 0 in 0.065s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.211s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Cannot resize image /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Ensure instance console log exists: /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:06 user nova-compute[75210]: DEBUG nova.network.neutron [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Successfully created port: af98fbff-3a16-4423-9c11-733538ad4326 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:45:07 user nova-compute[75210]: DEBUG nova.network.neutron [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Successfully updated port: af98fbff-3a16-4423-9c11-733538ad4326 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:45:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "refresh_cache-aaf1b90e-3ea7-4d65-8298-de2ca684573e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:45:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquired lock "refresh_cache-aaf1b90e-3ea7-4d65-8298-de2ca684573e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:45:07 user nova-compute[75210]: DEBUG nova.network.neutron [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:45:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-18e00951-43fd-46a5-9692-a718c740f125 req-a2ae2cb9-9dc6-449b-bf66-e87ddd3d1482 service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Received event network-changed-af98fbff-3a16-4423-9c11-733538ad4326 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-18e00951-43fd-46a5-9692-a718c740f125 req-a2ae2cb9-9dc6-449b-bf66-e87ddd3d1482 service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Refreshing instance network info cache due to event network-changed-af98fbff-3a16-4423-9c11-733538ad4326. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:45:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-18e00951-43fd-46a5-9692-a718c740f125 req-a2ae2cb9-9dc6-449b-bf66-e87ddd3d1482 service nova] Acquiring lock "refresh_cache-aaf1b90e-3ea7-4d65-8298-de2ca684573e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:45:07 user nova-compute[75210]: DEBUG nova.network.neutron [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Updating instance_info_cache with network_info: [{"id": "af98fbff-3a16-4423-9c11-733538ad4326", "address": "fa:16:3e:ad:cf:da", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98fbff-3a", "ovs_interfaceid": "af98fbff-3a16-4423-9c11-733538ad4326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Releasing lock "refresh_cache-aaf1b90e-3ea7-4d65-8298-de2ca684573e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.compute.manager [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Instance network_info: |[{"id": "af98fbff-3a16-4423-9c11-733538ad4326", "address": "fa:16:3e:ad:cf:da", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98fbff-3a", "ovs_interfaceid": "af98fbff-3a16-4423-9c11-733538ad4326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-18e00951-43fd-46a5-9692-a718c740f125 req-a2ae2cb9-9dc6-449b-bf66-e87ddd3d1482 service nova] Acquired lock "refresh_cache-aaf1b90e-3ea7-4d65-8298-de2ca684573e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.network.neutron [req-18e00951-43fd-46a5-9692-a718c740f125 req-a2ae2cb9-9dc6-449b-bf66-e87ddd3d1482 service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Refreshing network info cache for port af98fbff-3a16-4423-9c11-733538ad4326 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Start _get_guest_xml network_info=[{"id": "af98fbff-3a16-4423-9c11-733538ad4326", "address": "fa:16:3e:ad:cf:da", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98fbff-3a", "ovs_interfaceid": "af98fbff-3a16-4423-9c11-733538ad4326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:45:08 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:45:08 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1520174672',display_name='tempest-VolumesActionsTest-instance-1520174672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1520174672',id=26,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab6f8371c2b41d6b8a56647698c9639',ramdisk_id='',reservation_id='r-1l8o3q10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1214713951',owner_user_name='tempest-VolumesActionsTest-1214713951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:45:05Z,user_data=None,user_id='56716f093b9044078cb70385c84d53bf',uuid=aaf1b90e-3ea7-4d65-8298-de2ca684573e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af98fbff-3a16-4423-9c11-733538ad4326", "address": "fa:16:3e:ad:cf:da", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98fbff-3a", "ovs_interfaceid": "af98fbff-3a16-4423-9c11-733538ad4326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Converting VIF {"id": "af98fbff-3a16-4423-9c11-733538ad4326", "address": "fa:16:3e:ad:cf:da", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98fbff-3a", "ovs_interfaceid": "af98fbff-3a16-4423-9c11-733538ad4326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:cf:da,bridge_name='br-int',has_traffic_filtering=True,id=af98fbff-3a16-4423-9c11-733538ad4326,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98fbff-3a') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.objects.instance [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lazy-loading 'pci_devices' on Instance uuid aaf1b90e-3ea7-4d65-8298-de2ca684573e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:45:08 user nova-compute[75210]:   <uuid>aaf1b90e-3ea7-4d65-8298-de2ca684573e</uuid>
Nov 29 01:45:08 user nova-compute[75210]:   <name>instance-0000001a</name>
Nov 29 01:45:08 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:45:08 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:45:08 user nova-compute[75210]:   <metadata>
Nov 29 01:45:08 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:45:08 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:45:08 user nova-compute[75210]:       <nova:name>tempest-VolumesActionsTest-instance-1520174672</nova:name>
Nov 29 01:45:08 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:45:08</nova:creationTime>
Nov 29 01:45:08 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:45:08 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:45:08 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:45:08 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:45:08 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:45:08 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:45:08 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:45:08 user nova-compute[75210]:       <nova:owner>
Nov 29 01:45:08 user nova-compute[75210]:         <nova:user uuid="56716f093b9044078cb70385c84d53bf">tempest-VolumesActionsTest-1214713951-project-member</nova:user>
Nov 29 01:45:08 user nova-compute[75210]:         <nova:project uuid="2ab6f8371c2b41d6b8a56647698c9639">tempest-VolumesActionsTest-1214713951</nova:project>
Nov 29 01:45:08 user nova-compute[75210]:       </nova:owner>
Nov 29 01:45:08 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:45:08 user nova-compute[75210]:       <nova:ports>
Nov 29 01:45:08 user nova-compute[75210]:         <nova:port uuid="af98fbff-3a16-4423-9c11-733538ad4326">
Nov 29 01:45:08 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 01:45:08 user nova-compute[75210]:         </nova:port>
Nov 29 01:45:08 user nova-compute[75210]:       </nova:ports>
Nov 29 01:45:08 user nova-compute[75210]:     </nova:instance>
Nov 29 01:45:08 user nova-compute[75210]:   </metadata>
Nov 29 01:45:08 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:45:08 user nova-compute[75210]:     <system>
Nov 29 01:45:08 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:45:08 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:45:08 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:45:08 user nova-compute[75210]:       <entry name="serial">aaf1b90e-3ea7-4d65-8298-de2ca684573e</entry>
Nov 29 01:45:08 user nova-compute[75210]:       <entry name="uuid">aaf1b90e-3ea7-4d65-8298-de2ca684573e</entry>
Nov 29 01:45:08 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:45:08 user nova-compute[75210]:     </system>
Nov 29 01:45:08 user nova-compute[75210]:   </sysinfo>
Nov 29 01:45:08 user nova-compute[75210]:   <os>
Nov 29 01:45:08 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:45:08 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:45:08 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:45:08 user nova-compute[75210]:   </os>
Nov 29 01:45:08 user nova-compute[75210]:   <features>
Nov 29 01:45:08 user nova-compute[75210]:     <acpi/>
Nov 29 01:45:08 user nova-compute[75210]:     <apic/>
Nov 29 01:45:08 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:45:08 user nova-compute[75210]:   </features>
Nov 29 01:45:08 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:45:08 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:45:08 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:45:08 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:45:08 user nova-compute[75210]:   </clock>
Nov 29 01:45:08 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:45:08 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:45:08 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:45:08 user nova-compute[75210]:   </cpu>
Nov 29 01:45:08 user nova-compute[75210]:   <devices>
Nov 29 01:45:08 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:45:08 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:45:08 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk"/>
Nov 29 01:45:08 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:45:08 user nova-compute[75210]:     </disk>
Nov 29 01:45:08 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:45:08 user nova-compute[75210]:       <mac address="fa:16:3e:ad:cf:da"/>
Nov 29 01:45:08 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:45:08 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:45:08 user nova-compute[75210]:       <target dev="tapaf98fbff-3a"/>
Nov 29 01:45:08 user nova-compute[75210]:     </interface>
Nov 29 01:45:08 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:45:08 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/console.log" append="off"/>
Nov 29 01:45:08 user nova-compute[75210]:     </serial>
Nov 29 01:45:08 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:45:08 user nova-compute[75210]:     <video>
Nov 29 01:45:08 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:45:08 user nova-compute[75210]:     </video>
Nov 29 01:45:08 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:45:08 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:45:08 user nova-compute[75210]:     </rng>
Nov 29 01:45:08 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:45:08 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:45:08 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:45:08 user nova-compute[75210]:     </memballoon>
Nov 29 01:45:08 user nova-compute[75210]:   </devices>
Nov 29 01:45:08 user nova-compute[75210]: </domain>
Nov 29 01:45:08 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1520174672',display_name='tempest-VolumesActionsTest-instance-1520174672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1520174672',id=26,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ab6f8371c2b41d6b8a56647698c9639',ramdisk_id='',reservation_id='r-1l8o3q10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1214713951',owner_user_name='tempest-VolumesActionsTest-1214713951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:45:05Z,user_data=None,user_id='56716f093b9044078cb70385c84d53bf',uuid=aaf1b90e-3ea7-4d65-8298-de2ca684573e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af98fbff-3a16-4423-9c11-733538ad4326", "address": "fa:16:3e:ad:cf:da", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98fbff-3a", "ovs_interfaceid": "af98fbff-3a16-4423-9c11-733538ad4326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Converting VIF {"id": "af98fbff-3a16-4423-9c11-733538ad4326", "address": "fa:16:3e:ad:cf:da", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98fbff-3a", "ovs_interfaceid": "af98fbff-3a16-4423-9c11-733538ad4326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:cf:da,bridge_name='br-int',has_traffic_filtering=True,id=af98fbff-3a16-4423-9c11-733538ad4326,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98fbff-3a') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_vif [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:cf:da,bridge_name='br-int',has_traffic_filtering=True,id=af98fbff-3a16-4423-9c11-733538ad4326,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98fbff-3a') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6742035b-e1f1-5fde-8bc2-fd3babaf6799', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf98fbff-3a, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf98fbff-3a, col_values=(('qos', UUID('729af81a-7d49-457d-aa8e-999f405ce9bd')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf98fbff-3a, col_values=(('external_ids', {'iface-id': 'af98fbff-3a16-4423-9c11-733538ad4326', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:cf:da', 'vm-uuid': 'aaf1b90e-3ea7-4d65-8298-de2ca684573e'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:08 user nova-compute[75210]: INFO os_vif [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:cf:da,bridge_name='br-int',has_traffic_filtering=True,id=af98fbff-3a16-4423-9c11-733538ad4326,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98fbff-3a')
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] No VIF found with MAC fa:16:3e:ad:cf:da, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HltrmKVc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:45:08 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:45:08 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:45:08 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da56bf4-7cfa-4de7-9414-7d8018a4e018]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:45:08 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[718da21e-f780-4158-94d5-340a91a166e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85] added
Nov 29 01:45:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5963ff0a-c2bc-46ee-874e-f1b4f1486610]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ec5ec2-c27a-449d-81cb-620c2149a1a4]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.network.neutron [req-18e00951-43fd-46a5-9692-a718c740f125 req-a2ae2cb9-9dc6-449b-bf66-e87ddd3d1482 service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Updated VIF entry in instance network info cache for port af98fbff-3a16-4423-9c11-733538ad4326. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG nova.network.neutron [req-18e00951-43fd-46a5-9692-a718c740f125 req-a2ae2cb9-9dc6-449b-bf66-e87ddd3d1482 service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Updating instance_info_cache with network_info: [{"id": "af98fbff-3a16-4423-9c11-733538ad4326", "address": "fa:16:3e:ad:cf:da", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98fbff-3a", "ovs_interfaceid": "af98fbff-3a16-4423-9c11-733538ad4326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HltrmKVc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-18e00951-43fd-46a5-9692-a718c740f125 req-a2ae2cb9-9dc6-449b-bf66-e87ddd3d1482 service nova] Releasing lock "refresh_cache-aaf1b90e-3ea7-4d65-8298-de2ca684573e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HltrmKVc" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[951cb296-2b8c-40b9-a4dc-fcf5f032e7be]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HltrmKVc'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c2df4f-10de-4011-aa0f-a3115a7624e8]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d4f0cd-6981-4bf5-83c0-a11fec5eb51e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b662a91b-0153-45ba-969d-414ea4af5422]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85, portal: 172.16.0.220,3260]
Nov 29 01:45:08 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85, portal: 172.16.0.220,3260] successful.
Nov 29 01:45:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef9303c-45e4-4a74-a97e-4611209be574]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[59716dae-7624-46e7-af64-c895618c4c27]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:08 user nova-compute[75210]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 (non-flash)
Nov 29 01:45:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:08 user nova-compute[75210]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 (non-flash)
Nov 29 01:45:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:45:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36097f9-c965-4b93-8c2c-8bef6db33887]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:09 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:45:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HltrmKVc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:45:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26366396231383562', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366396231383562', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG nova.objects.instance [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'flavor' on Instance uuid c3eec4ab-96b5-4197-9633-6ffad4f3954e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:45:10 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:45:10 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:45:10 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:45:10 user nova-compute[75210]:   <serial>566e63fe-8c59-42a5-9d94-eaf3abd67a85</serial>
Nov 29 01:45:10 user nova-compute[75210]: </disk>
Nov 29 01:45:10 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-63f452b0-0a22-4eae-874b-83b269dac2dd req-d63c32de-3821-4ac9-8ee9-3439f35314af service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Received event network-vif-plugged-af98fbff-3a16-4423-9c11-733538ad4326 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-63f452b0-0a22-4eae-874b-83b269dac2dd req-d63c32de-3821-4ac9-8ee9-3439f35314af service nova] Acquiring lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-63f452b0-0a22-4eae-874b-83b269dac2dd req-d63c32de-3821-4ac9-8ee9-3439f35314af service nova] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-63f452b0-0a22-4eae-874b-83b269dac2dd req-d63c32de-3821-4ac9-8ee9-3439f35314af service nova] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-63f452b0-0a22-4eae-874b-83b269dac2dd req-d63c32de-3821-4ac9-8ee9-3439f35314af service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] No waiting events found dispatching network-vif-plugged-af98fbff-3a16-4423-9c11-733538ad4326 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:10 user nova-compute[75210]: WARNING nova.compute.manager [req-63f452b0-0a22-4eae-874b-83b269dac2dd req-d63c32de-3821-4ac9-8ee9-3439f35314af service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Received unexpected event network-vif-plugged-af98fbff-3a16-4423-9c11-733538ad4326 for instance with vm_state building and task_state spawning.
Nov 29 01:45:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No VIF found with MAC fa:16:3e:45:d9:df, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-716c5162-33d5-4b39-bfb7-62f98083c3cc tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.655s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:45:11 user nova-compute[75210]: INFO nova.compute.claims [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Claim successful on node user
Nov 29 01:45:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:11 user nova-compute[75210]: INFO nova.compute.manager [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Detaching volume 566e63fe-8c59-42a5-9d94-eaf3abd67a85
Nov 29 01:45:11 user nova-compute[75210]: INFO nova.virt.block_device [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Attempting to driver detach volume 566e63fe-8c59-42a5-9d94-eaf3abd67a85 from mountpoint /dev/vdb
Nov 29 01:45:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Attempting to detach device vdb from instance c3eec4ab-96b5-4197-9633-6ffad4f3954e from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:45:11 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:45:11 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:45:11 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:45:11 user nova-compute[75210]:   <serial>566e63fe-8c59-42a5-9d94-eaf3abd67a85</serial>
Nov 29 01:45:11 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:45:11 user nova-compute[75210]: </disk>
Nov 29 01:45:11 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:45:11 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully detached device vdb from instance c3eec4ab-96b5-4197-9633-6ffad4f3954e from the persistent domain config.
Nov 29 01:45:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3eec4ab-96b5-4197-9633-6ffad4f3954e from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:45:11 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:45:11 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:45:11 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:45:11 user nova-compute[75210]:   <serial>566e63fe-8c59-42a5-9d94-eaf3abd67a85</serial>
Nov 29 01:45:11 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:45:11 user nova-compute[75210]: </disk>
Nov 29 01:45:11 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "18aa0259-a720-42aa-be33-4a676dd4d0e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:11 user nova-compute[75210]: INFO nova.compute.manager [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Terminating instance
Nov 29 01:45:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG nova.network.neutron [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:45:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:11 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:45:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.policy [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9b16390ddb64b9f8925f3e156bbe8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b24c627ca143e49731c22a555eacd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3eec4ab-96b5-4197-9633-6ffad4f3954e {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-5d3f6e44-419f-43db-8d13-8424ffa6c0a5 req-3d0314cd-58b1-4595-af2f-f62d57c1282d service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Received event network-vif-plugged-af98fbff-3a16-4423-9c11-733538ad4326 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d3f6e44-419f-43db-8d13-8424ffa6c0a5 req-3d0314cd-58b1-4595-af2f-f62d57c1282d service nova] Acquiring lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d3f6e44-419f-43db-8d13-8424ffa6c0a5 req-3d0314cd-58b1-4595-af2f-f62d57c1282d service nova] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5d3f6e44-419f-43db-8d13-8424ffa6c0a5 req-3d0314cd-58b1-4595-af2f-f62d57c1282d service nova] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-5d3f6e44-419f-43db-8d13-8424ffa6c0a5 req-3d0314cd-58b1-4595-af2f-f62d57c1282d service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] No waiting events found dispatching network-vif-plugged-af98fbff-3a16-4423-9c11-733538ad4326 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:12 user nova-compute[75210]: WARNING nova.compute.manager [req-5d3f6e44-419f-43db-8d13-8424ffa6c0a5 req-3d0314cd-58b1-4595-af2f-f62d57c1282d service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Received unexpected event network-vif-plugged-af98fbff-3a16-4423-9c11-733538ad4326 for instance with vm_state building and task_state spawning.
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:45:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Creating image(s)
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "/opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "/opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-068b6845-c31b-45ae-93ea-8fe35ba45c7e req-11b67bbf-06dc-4525-b24b-ca60c7848e2d service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Received event network-vif-unplugged-d660481b-c417-49b9-9efe-9a11b09edc5b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-068b6845-c31b-45ae-93ea-8fe35ba45c7e req-11b67bbf-06dc-4525-b24b-ca60c7848e2d service nova] Acquiring lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-068b6845-c31b-45ae-93ea-8fe35ba45c7e req-11b67bbf-06dc-4525-b24b-ca60c7848e2d service nova] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-068b6845-c31b-45ae-93ea-8fe35ba45c7e req-11b67bbf-06dc-4525-b24b-ca60c7848e2d service nova] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-068b6845-c31b-45ae-93ea-8fe35ba45c7e req-11b67bbf-06dc-4525-b24b-ca60c7848e2d service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] No waiting events found dispatching network-vif-unplugged-d660481b-c417-49b9-9efe-9a11b09edc5b {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-068b6845-c31b-45ae-93ea-8fe35ba45c7e req-11b67bbf-06dc-4525-b24b-ca60c7848e2d service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Received event network-vif-unplugged-d660481b-c417-49b9-9efe-9a11b09edc5b for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.199s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Instance spawned successfully.
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:45:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Instance destroyed successfully.
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.objects.instance [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lazy-loading 'resources' on Instance uuid 18aa0259-a720-42aa-be33-4a676dd4d0e7 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:36:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1373939452',display_name='tempest-ServersNegativeTestJSON-server-1373939452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1373939452',id=1,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faba7aca2be7400e98500e02035788de',ramdisk_id='',reservation_id='r-4qi6lksw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1979179804',owner_user_name='tempest-ServersNegativeTestJSON-1979179804-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:36:38Z,user_data=None,user_id='654b0e70c6334fa3906a6e1d9023320f',uuid=18aa0259-a720-42aa-be33-4a676dd4d0e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d660481b-c417-49b9-9efe-9a11b09edc5b", "address": "fa:16:3e:69:ed:7f", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd660481b-c4", "ovs_interfaceid": "d660481b-c417-49b9-9efe-9a11b09edc5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Converting VIF {"id": "d660481b-c417-49b9-9efe-9a11b09edc5b", "address": "fa:16:3e:69:ed:7f", "network": {"id": "38f9a963-b1b0-4139-9b3b-1015f295492f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-510996574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faba7aca2be7400e98500e02035788de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd660481b-c4", "ovs_interfaceid": "d660481b-c417-49b9-9efe-9a11b09edc5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:ed:7f,bridge_name='br-int',has_traffic_filtering=True,id=d660481b-c417-49b9-9efe-9a11b09edc5b,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd660481b-c4') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG os_vif [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:ed:7f,bridge_name='br-int',has_traffic_filtering=True,id=d660481b-c417-49b9-9efe-9a11b09edc5b,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd660481b-c4') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd660481b-c4, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a09a4d3f-4a8c-4a24-8947-97c4a9398e9d) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:45:12 user nova-compute[75210]: INFO os_vif [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:ed:7f,bridge_name='br-int',has_traffic_filtering=True,id=d660481b-c417-49b9-9efe-9a11b09edc5b,network=Network(38f9a963-b1b0-4139-9b3b-1015f295492f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd660481b-c4')
Nov 29 01:45:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Deleting instance files /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7_del
Nov 29 01:45:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Deletion of /opt/stack/data/nova/instances/18aa0259-a720-42aa-be33-4a676dd4d0e7_del complete
Nov 29 01:45:12 user nova-compute[75210]: INFO nova.compute.manager [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Took 8.15 seconds to spawn the instance on the hypervisor.
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk 1073741824" returned: 0 in 0.208s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.410s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:12 user nova-compute[75210]: INFO nova.compute.manager [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:45:12 user nova-compute[75210]: INFO nova.compute.manager [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Took 9.05 seconds to build instance.
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97e2e6c5-bce3-49ac-80d8-b50c8e4b4e3c tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.159s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:45:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:13 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Cannot resize image /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:45:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:45:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Ensure instance console log exists: /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:45:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:13 user nova-compute[75210]: DEBUG nova.network.neutron [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Successfully created port: 60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:45:13 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:45:13 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Took 0.75 seconds to deallocate network for instance.
Nov 29 01:45:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.network.neutron [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Successfully updated port: 60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquired lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.network.neutron [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:45:14 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Deleted allocations for instance 18aa0259-a720-42aa-be33-4a676dd4d0e7
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.network.neutron [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d202afdb-c893-43ff-a926-5c64d30e7757 tempest-ServersNegativeTestJSON-1979179804 tempest-ServersNegativeTestJSON-1979179804-project-member] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.443s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Received event network-vif-plugged-d660481b-c417-49b9-9efe-9a11b09edc5b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] Acquiring lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] Lock "18aa0259-a720-42aa-be33-4a676dd4d0e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] No waiting events found dispatching network-vif-plugged-d660481b-c417-49b9-9efe-9a11b09edc5b {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:14 user nova-compute[75210]: WARNING nova.compute.manager [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Received unexpected event network-vif-plugged-d660481b-c417-49b9-9efe-9a11b09edc5b for instance with vm_state deleted and task_state None.
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] [instance: 18aa0259-a720-42aa-be33-4a676dd4d0e7] Received event network-vif-deleted-d660481b-c417-49b9-9efe-9a11b09edc5b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-changed-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Refreshing instance network info cache due to event network-changed-60309b43-09f2-4bc7-81a2-9c764df78b5d. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] Acquiring lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.network.neutron [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating instance_info_cache with network_info: [{"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Releasing lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.compute.manager [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Instance network_info: |[{"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] Acquired lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.network.neutron [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Refreshing network info cache for port 60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Start _get_guest_xml network_info=[{"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:45:14 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:45:14 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1920078035',display_name='tempest-ServerActionsTestOtherB-server-1920078035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1920078035',id=27,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHTMCtMfKAyfL3sA07wByFhm2FHh83CKtTVWERl3aWtDAO+UO8rfcAbJD3gRH9oGCeL5Ksot/CKwepAmL20m57Zzo2MLfsvimSlewZEfHZ4/WEV9jR4p6/EvJ11L0KWcA==',key_name='tempest-keypair-53471645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7b24c627ca143e49731c22a555eacd1',ramdisk_id='',reservation_id='r-08i4j8ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-573973984',owner_user_name='tempest-ServerActionsTestOtherB-573973984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b16390ddb64b9f8925f3e156bbe8d0',uuid=4fab87e3-2f7c-4db4-9f14-ace1813fe046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converting VIF {"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.objects.instance [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fab87e3-2f7c-4db4-9f14-ace1813fe046 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:45:14 user nova-compute[75210]:   <uuid>4fab87e3-2f7c-4db4-9f14-ace1813fe046</uuid>
Nov 29 01:45:14 user nova-compute[75210]:   <name>instance-0000001b</name>
Nov 29 01:45:14 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:45:14 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:45:14 user nova-compute[75210]:   <metadata>
Nov 29 01:45:14 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:45:14 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:45:14 user nova-compute[75210]:       <nova:name>tempest-ServerActionsTestOtherB-server-1920078035</nova:name>
Nov 29 01:45:14 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:45:14</nova:creationTime>
Nov 29 01:45:14 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:45:14 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:45:14 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:45:14 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:45:14 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:45:14 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:45:14 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:45:14 user nova-compute[75210]:       <nova:owner>
Nov 29 01:45:14 user nova-compute[75210]:         <nova:user uuid="b9b16390ddb64b9f8925f3e156bbe8d0">tempest-ServerActionsTestOtherB-573973984-project-member</nova:user>
Nov 29 01:45:14 user nova-compute[75210]:         <nova:project uuid="e7b24c627ca143e49731c22a555eacd1">tempest-ServerActionsTestOtherB-573973984</nova:project>
Nov 29 01:45:14 user nova-compute[75210]:       </nova:owner>
Nov 29 01:45:14 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:45:14 user nova-compute[75210]:       <nova:ports>
Nov 29 01:45:14 user nova-compute[75210]:         <nova:port uuid="60309b43-09f2-4bc7-81a2-9c764df78b5d">
Nov 29 01:45:14 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:45:14 user nova-compute[75210]:         </nova:port>
Nov 29 01:45:14 user nova-compute[75210]:       </nova:ports>
Nov 29 01:45:14 user nova-compute[75210]:     </nova:instance>
Nov 29 01:45:14 user nova-compute[75210]:   </metadata>
Nov 29 01:45:14 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:45:14 user nova-compute[75210]:     <system>
Nov 29 01:45:14 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:45:14 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:45:14 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:45:14 user nova-compute[75210]:       <entry name="serial">4fab87e3-2f7c-4db4-9f14-ace1813fe046</entry>
Nov 29 01:45:14 user nova-compute[75210]:       <entry name="uuid">4fab87e3-2f7c-4db4-9f14-ace1813fe046</entry>
Nov 29 01:45:14 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:45:14 user nova-compute[75210]:     </system>
Nov 29 01:45:14 user nova-compute[75210]:   </sysinfo>
Nov 29 01:45:14 user nova-compute[75210]:   <os>
Nov 29 01:45:14 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:45:14 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:45:14 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:45:14 user nova-compute[75210]:   </os>
Nov 29 01:45:14 user nova-compute[75210]:   <features>
Nov 29 01:45:14 user nova-compute[75210]:     <acpi/>
Nov 29 01:45:14 user nova-compute[75210]:     <apic/>
Nov 29 01:45:14 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:45:14 user nova-compute[75210]:   </features>
Nov 29 01:45:14 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:45:14 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:45:14 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:45:14 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:45:14 user nova-compute[75210]:   </clock>
Nov 29 01:45:14 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:45:14 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:45:14 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:45:14 user nova-compute[75210]:   </cpu>
Nov 29 01:45:14 user nova-compute[75210]:   <devices>
Nov 29 01:45:14 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:45:14 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:45:14 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk"/>
Nov 29 01:45:14 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:45:14 user nova-compute[75210]:     </disk>
Nov 29 01:45:14 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:45:14 user nova-compute[75210]:       <mac address="fa:16:3e:95:cc:d2"/>
Nov 29 01:45:14 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:45:14 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:45:14 user nova-compute[75210]:       <target dev="tap60309b43-09"/>
Nov 29 01:45:14 user nova-compute[75210]:     </interface>
Nov 29 01:45:14 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:45:14 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/console.log" append="off"/>
Nov 29 01:45:14 user nova-compute[75210]:     </serial>
Nov 29 01:45:14 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:45:14 user nova-compute[75210]:     <video>
Nov 29 01:45:14 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:45:14 user nova-compute[75210]:     </video>
Nov 29 01:45:14 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:45:14 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:45:14 user nova-compute[75210]:     </rng>
Nov 29 01:45:14 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:45:14 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:45:14 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:45:14 user nova-compute[75210]:     </memballoon>
Nov 29 01:45:14 user nova-compute[75210]:   </devices>
Nov 29 01:45:14 user nova-compute[75210]: </domain>
Nov 29 01:45:14 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1920078035',display_name='tempest-ServerActionsTestOtherB-server-1920078035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1920078035',id=27,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHTMCtMfKAyfL3sA07wByFhm2FHh83CKtTVWERl3aWtDAO+UO8rfcAbJD3gRH9oGCeL5Ksot/CKwepAmL20m57Zzo2MLfsvimSlewZEfHZ4/WEV9jR4p6/EvJ11L0KWcA==',key_name='tempest-keypair-53471645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e7b24c627ca143e49731c22a555eacd1',ramdisk_id='',reservation_id='r-08i4j8ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-573973984',owner_user_name='tempest-ServerActionsTestOtherB-573973984-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:45:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b16390ddb64b9f8925f3e156bbe8d0',uuid=4fab87e3-2f7c-4db4-9f14-ace1813fe046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converting VIF {"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG os_vif [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8244a618-66e3-59f1-a9ad-ad44e1a57c8d', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60309b43-09, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60309b43-09, col_values=(('qos', UUID('d7dae55e-b9bf-4d54-824c-70e4baf30667')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60309b43-09, col_values=(('external_ids', {'iface-id': '60309b43-09f2-4bc7-81a2-9c764df78b5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:cc:d2', 'vm-uuid': '4fab87e3-2f7c-4db4-9f14-ace1813fe046'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:14 user nova-compute[75210]: INFO os_vif [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09')
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] No VIF found with MAC fa:16:3e:95:cc:d2, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.network.neutron [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updated VIF entry in instance network info cache for port 60309b43-09f2-4bc7-81a2-9c764df78b5d. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG nova.network.neutron [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating instance_info_cache with network_info: [{"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:45:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-73cf2e04-66c2-48f7-b936-15973aedf080 req-32b777c2-dd07-45cb-9f92-9ff2ed0e0427 service nova] Releasing lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:45:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-925ca83b-363a-478f-a5a7-cb4db1d72082 req-271ad7cc-bd7f-4d33-8897-715d18f45f3e service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-925ca83b-363a-478f-a5a7-cb4db1d72082 req-271ad7cc-bd7f-4d33-8897-715d18f45f3e service nova] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-925ca83b-363a-478f-a5a7-cb4db1d72082 req-271ad7cc-bd7f-4d33-8897-715d18f45f3e service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-925ca83b-363a-478f-a5a7-cb4db1d72082 req-271ad7cc-bd7f-4d33-8897-715d18f45f3e service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-925ca83b-363a-478f-a5a7-cb4db1d72082 req-271ad7cc-bd7f-4d33-8897-715d18f45f3e service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] No waiting events found dispatching network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:16 user nova-compute[75210]: WARNING nova.compute.manager [req-925ca83b-363a-478f-a5a7-cb4db1d72082 req-271ad7cc-bd7f-4d33-8897-715d18f45f3e service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received unexpected event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d for instance with vm_state building and task_state spawning.
Nov 29 01:45:16 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:45:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:18 user nova-compute[75210]: DEBUG nova.compute.manager [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:45:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:45:18 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Instance spawned successfully.
Nov 29 01:45:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:45:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:18 user nova-compute[75210]: INFO nova.compute.manager [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 29 01:45:18 user nova-compute[75210]: DEBUG nova.compute.manager [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:45:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-61061749-d779-4770-9983-5bb7df7359c4 req-af46c1b5-ec1d-4069-ac33-b53a0264b465 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61061749-d779-4770-9983-5bb7df7359c4 req-af46c1b5-ec1d-4069-ac33-b53a0264b465 service nova] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61061749-d779-4770-9983-5bb7df7359c4 req-af46c1b5-ec1d-4069-ac33-b53a0264b465 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61061749-d779-4770-9983-5bb7df7359c4 req-af46c1b5-ec1d-4069-ac33-b53a0264b465 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-61061749-d779-4770-9983-5bb7df7359c4 req-af46c1b5-ec1d-4069-ac33-b53a0264b465 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] No waiting events found dispatching network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:18 user nova-compute[75210]: WARNING nova.compute.manager [req-61061749-d779-4770-9983-5bb7df7359c4 req-af46c1b5-ec1d-4069-ac33-b53a0264b465 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received unexpected event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d for instance with vm_state building and task_state spawning.
Nov 29 01:45:18 user nova-compute[75210]: INFO nova.compute.manager [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Took 7.00 seconds to build instance.
Nov 29 01:45:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-eb55a0a6-7ff5-485e-8377-830418536c8c tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.108s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:19 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:45:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:20 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:45:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:23 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:45:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:45:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:45:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:45:23 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updating instance_info_cache with network_info: [{"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:45:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:29 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:45:29 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7302MB free_disk=25.2275390625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance a6571012-7707-47bc-a057-905eef9d762a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c3eec4ab-96b5-4197-9633-6ffad4f3954e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 9e68205c-08b3-40c4-aa6e-7a4730506dd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance e6c9606c-5a27-417d-9042-259ce728e175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance aaf1b90e-3ea7-4d65-8298-de2ca684573e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 4fab87e3-2f7c-4db4-9f14-ace1813fe046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:45:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:45:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:45:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:45:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:45:32 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c3eec4ab-96b5-4197-9633-6ffad4f3954e is timed out.
Nov 29 01:45:32 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully detached device vdb from instance c3eec4ab-96b5-4197-9633-6ffad4f3954e from the live domain config.
Nov 29 01:45:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HltrmKVc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:45:32 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc214dc3-7c99-4c69-acc6-74db102b56ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:45:32 user nova-compute[75210]: No targets found.
Nov 29 01:45:32 user nova-compute[75210]: iSNS:
Nov 29 01:45:32 user nova-compute[75210]: No targets found.
Nov 29 01:45:32 user nova-compute[75210]: STATIC:
Nov 29 01:45:32 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85
Nov 29 01:45:32 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:45:32 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:45:32 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:45:32 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:45:32 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:45:32 user nova-compute[75210]: FIRMWARE:
Nov 29 01:45:32 user nova-compute[75210]: No targets found.
Nov 29 01:45:32 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:45:32 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:45:32 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0969ab9f-8b50-4b58-a921-51b3eb6bec21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c7137b-a1a7-4748-919c-68e12bae1a18]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:32 user nova-compute[75210]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 (non-flash)
Nov 29 01:45:32 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:32 user nova-compute[75210]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 (non-flash)
Nov 29 01:45:32 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f517e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[09296818-0b22-4541-9d76-4a2b7cb7ab63]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56d5766-7cbb-4ad9-a997-0100745e6e38]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[47479d85-bfab-44ef-8040-62066ed480cf]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc7703d-510c-44dc-bffa-f4fa3cab2217]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f583af-f0c8-4c5a-81b1-7ecff9cdf980]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fb4208-e076-4a51-8eab-d95ccb040ee5]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85, portal: 172.16.0.220,3260]
Nov 29 01:45:32 user nova-compute[75210]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85, portal: 172.16.0.220,3260] successful.
Nov 29 01:45:32 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:566e63fe-8c59-42a5-9d94-eaf3abd67a85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b0f92a-1b36-4145-ad28-6f3b07aa37d6]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] <== disconnect_volume: return (293ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:45:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG nova.objects.instance [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'flavor' on Instance uuid c3eec4ab-96b5-4197-9633-6ffad4f3954e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f3968bbe-790e-46f2-844d-4e1cd6f05e98 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.815s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG nova.compute.manager [req-3b078dc6-d5d1-4b29-8699-3d52cef0e81f req-91924442-ac96-4f83-bbd1-b595469efe21 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Received event network-changed-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG nova.compute.manager [req-3b078dc6-d5d1-4b29-8699-3d52cef0e81f req-91924442-ac96-4f83-bbd1-b595469efe21 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Refreshing instance network info cache due to event network-changed-1e0cc60f-9d89-48d2-8bf0-5de1573ee031. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3b078dc6-d5d1-4b29-8699-3d52cef0e81f req-91924442-ac96-4f83-bbd1-b595469efe21 service nova] Acquiring lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3b078dc6-d5d1-4b29-8699-3d52cef0e81f req-91924442-ac96-4f83-bbd1-b595469efe21 service nova] Acquired lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG nova.network.neutron [req-3b078dc6-d5d1-4b29-8699-3d52cef0e81f req-91924442-ac96-4f83-bbd1-b595469efe21 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Refreshing network info cache for port 1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "a6571012-7707-47bc-a057-905eef9d762a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "a6571012-7707-47bc-a057-905eef9d762a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "a6571012-7707-47bc-a057-905eef9d762a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "a6571012-7707-47bc-a057-905eef9d762a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "a6571012-7707-47bc-a057-905eef9d762a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:33 user nova-compute[75210]: INFO nova.compute.manager [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Terminating instance
Nov 29 01:45:33 user nova-compute[75210]: DEBUG nova.compute.manager [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG nova.network.neutron [req-3b078dc6-d5d1-4b29-8699-3d52cef0e81f req-91924442-ac96-4f83-bbd1-b595469efe21 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Updated VIF entry in instance network info cache for port 1e0cc60f-9d89-48d2-8bf0-5de1573ee031. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG nova.network.neutron [req-3b078dc6-d5d1-4b29-8699-3d52cef0e81f req-91924442-ac96-4f83-bbd1-b595469efe21 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Updating instance_info_cache with network_info: [{"id": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "address": "fa:16:3e:ab:a3:78", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cc60f-9d", "ovs_interfaceid": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3b078dc6-d5d1-4b29-8699-3d52cef0e81f req-91924442-ac96-4f83-bbd1-b595469efe21 service nova] Releasing lock "refresh_cache-a6571012-7707-47bc-a057-905eef9d762a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:45:34 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: a6571012-7707-47bc-a057-905eef9d762a] Instance destroyed successfully.
Nov 29 01:45:34 user nova-compute[75210]: DEBUG nova.objects.instance [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lazy-loading 'resources' on Instance uuid a6571012-7707-47bc-a057-905eef9d762a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1442968796',display_name='tempest-TestStampPattern-server-1442968796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1442968796',id=12,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxZJUo/Epb5CYlFBfChMG1V1BPL8V9TPJTvnIOTNFLljvoxCnu1eTJ8d58HUXoSa4EQGvcboO4Biiz1zA+SH1SEBmtS+A0p9yWGjhjTSTNMhoJMfxAVBrvRKESIp2RgtQ==',key_name='tempest-TestStampPattern-770112348',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:38:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b78c3f7409946e18c85ab8bc938d53d',ramdisk_id='',reservation_id='r-5uqywtp5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1188739187',owner_user_name='tempest-TestStampPattern-1188739187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:41:37Z,user_data=None,user_id='ff068faa6b454eada6a4e1c37a3b0887',uuid=a6571012-7707-47bc-a057-905eef9d762a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "address": "fa:16:3e:ab:a3:78", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cc60f-9d", "ovs_interfaceid": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Converting VIF {"id": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "address": "fa:16:3e:ab:a3:78", "network": {"id": "32caf4ea-83a3-44b7-8c57-57fc46fe90dd", "bridge": "br-int", "label": "tempest-TestStampPattern-2027025045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b78c3f7409946e18c85ab8bc938d53d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e0cc60f-9d", "ovs_interfaceid": "1e0cc60f-9d89-48d2-8bf0-5de1573ee031", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:a3:78,bridge_name='br-int',has_traffic_filtering=True,id=1e0cc60f-9d89-48d2-8bf0-5de1573ee031,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cc60f-9d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG os_vif [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:a3:78,bridge_name='br-int',has_traffic_filtering=True,id=1e0cc60f-9d89-48d2-8bf0-5de1573ee031,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cc60f-9d') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e0cc60f-9d, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63a578e7-6a17-4bd5-9a95-30e453559c47) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:34 user nova-compute[75210]: INFO os_vif [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:a3:78,bridge_name='br-int',has_traffic_filtering=True,id=1e0cc60f-9d89-48d2-8bf0-5de1573ee031,network=Network(32caf4ea-83a3-44b7-8c57-57fc46fe90dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e0cc60f-9d')
Nov 29 01:45:34 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Deleting instance files /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a_del
Nov 29 01:45:34 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Deletion of /opt/stack/data/nova/instances/a6571012-7707-47bc-a057-905eef9d762a_del complete
Nov 29 01:45:34 user nova-compute[75210]: INFO nova.compute.manager [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] [instance: a6571012-7707-47bc-a057-905eef9d762a] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 01:45:34 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: a6571012-7707-47bc-a057-905eef9d762a] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:45:34 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: a6571012-7707-47bc-a057-905eef9d762a] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: a6571012-7707-47bc-a057-905eef9d762a] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:45:35 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: a6571012-7707-47bc-a057-905eef9d762a] Took 0.43 seconds to deallocate network for instance.
Nov 29 01:45:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-6e2800c4-d1c9-4c57-b71b-44e5b5bf5ed4 req-92555b41-cb21-460d-bc37-76ab59065b04 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Received event network-vif-deleted-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:35 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Deleted allocations for instance a6571012-7707-47bc-a057-905eef9d762a
Nov 29 01:45:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-79c31b80-68f4-40a2-bdd5-a85c36db5e7e tempest-TestStampPattern-1188739187 tempest-TestStampPattern-1188739187-project-member] Lock "a6571012-7707-47bc-a057-905eef9d762a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.887s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-bafdb121-4a36-44b5-9de1-4c54c9c32e27 req-ad5660d4-9454-4c0a-9a59-0a46127a7a76 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Received event network-vif-unplugged-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bafdb121-4a36-44b5-9de1-4c54c9c32e27 req-ad5660d4-9454-4c0a-9a59-0a46127a7a76 service nova] Acquiring lock "a6571012-7707-47bc-a057-905eef9d762a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bafdb121-4a36-44b5-9de1-4c54c9c32e27 req-ad5660d4-9454-4c0a-9a59-0a46127a7a76 service nova] Lock "a6571012-7707-47bc-a057-905eef9d762a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bafdb121-4a36-44b5-9de1-4c54c9c32e27 req-ad5660d4-9454-4c0a-9a59-0a46127a7a76 service nova] Lock "a6571012-7707-47bc-a057-905eef9d762a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-bafdb121-4a36-44b5-9de1-4c54c9c32e27 req-ad5660d4-9454-4c0a-9a59-0a46127a7a76 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] No waiting events found dispatching network-vif-unplugged-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:35 user nova-compute[75210]: WARNING nova.compute.manager [req-bafdb121-4a36-44b5-9de1-4c54c9c32e27 req-ad5660d4-9454-4c0a-9a59-0a46127a7a76 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Received unexpected event network-vif-unplugged-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 for instance with vm_state deleted and task_state None.
Nov 29 01:45:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-bafdb121-4a36-44b5-9de1-4c54c9c32e27 req-ad5660d4-9454-4c0a-9a59-0a46127a7a76 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Received event network-vif-plugged-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bafdb121-4a36-44b5-9de1-4c54c9c32e27 req-ad5660d4-9454-4c0a-9a59-0a46127a7a76 service nova] Acquiring lock "a6571012-7707-47bc-a057-905eef9d762a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bafdb121-4a36-44b5-9de1-4c54c9c32e27 req-ad5660d4-9454-4c0a-9a59-0a46127a7a76 service nova] Lock "a6571012-7707-47bc-a057-905eef9d762a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bafdb121-4a36-44b5-9de1-4c54c9c32e27 req-ad5660d4-9454-4c0a-9a59-0a46127a7a76 service nova] Lock "a6571012-7707-47bc-a057-905eef9d762a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-bafdb121-4a36-44b5-9de1-4c54c9c32e27 req-ad5660d4-9454-4c0a-9a59-0a46127a7a76 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] No waiting events found dispatching network-vif-plugged-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:35 user nova-compute[75210]: WARNING nova.compute.manager [req-bafdb121-4a36-44b5-9de1-4c54c9c32e27 req-ad5660d4-9454-4c0a-9a59-0a46127a7a76 service nova] [instance: a6571012-7707-47bc-a057-905eef9d762a] Received unexpected event network-vif-plugged-1e0cc60f-9d89-48d2-8bf0-5de1573ee031 for instance with vm_state deleted and task_state None.
Nov 29 01:45:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:37 user nova-compute[75210]: INFO nova.compute.manager [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Rescuing
Nov 29 01:45:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:45:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquired lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:45:37 user nova-compute[75210]: DEBUG nova.network.neutron [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG nova.network.neutron [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Updating instance_info_cache with network_info: [{"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Releasing lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-b35c283b-ed1d-4f2e-b419-b3caeccccf66 req-99b0c1ea-98ae-457b-bdf2-2c0b36297c06 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b35c283b-ed1d-4f2e-b419-b3caeccccf66 req-99b0c1ea-98ae-457b-bdf2-2c0b36297c06 service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b35c283b-ed1d-4f2e-b419-b3caeccccf66 req-99b0c1ea-98ae-457b-bdf2-2c0b36297c06 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b35c283b-ed1d-4f2e-b419-b3caeccccf66 req-99b0c1ea-98ae-457b-bdf2-2c0b36297c06 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-b35c283b-ed1d-4f2e-b419-b3caeccccf66 req-99b0c1ea-98ae-457b-bdf2-2c0b36297c06 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:38 user nova-compute[75210]: WARNING nova.compute.manager [req-b35c283b-ed1d-4f2e-b419-b3caeccccf66 req-99b0c1ea-98ae-457b-bdf2-2c0b36297c06 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state active and task_state rescuing.
Nov 29 01:45:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG nova.objects.instance [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lazy-loading 'flavor' on Instance uuid 9e68205c-08b3-40c4-aa6e-7a4730506dd7 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:39 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Instance destroyed successfully.
Nov 29 01:45:39 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Attempting a stable device rescue
Nov 29 01:45:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75210) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Instance directory exists: not creating {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 01:45:39 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Creating image(s)
Nov 29 01:45:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "/opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "/opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "/opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG nova.objects.instance [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'trusted_certs' on Instance uuid 13274e43-2984-4aa6-ad9b-23e3bbe7c959 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "6867d81137c063bdbdaa6ed095076fd1fb11d90f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "6867d81137c063bdbdaa6ed095076fd1fb11d90f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:39 user nova-compute[75210]: INFO nova.compute.manager [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Attaching volume e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 to /dev/vdb
Nov 29 01:45:39 user nova-compute[75210]: DEBUG os_brick.utils [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d132ce-ec21-423c-9422-9b05407dda76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f.part --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[934b11a6-ddbc-4b3b-b284-eb5633cc5cc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[61102586-e175-4281-a5f5-3ad51ef99fe6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5eb1ef0-58e6-4ecc-863a-e2f0dd5c9dd5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:45:40 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebda523-1bf6-4ada-bc5e-4bc0344b74dd]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG os_brick.utils [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] <== get_connector_properties: return (1353ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Updating existing volume attachment record: 0b21bb57-8298-4f60-9344-b0d3bc9a632b {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:40 user nova-compute[75210]: WARNING nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state active and task_state rescuing.
Nov 29 01:45:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:40 user nova-compute[75210]: WARNING nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state active and task_state rescuing.
Nov 29 01:45:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:40 user nova-compute[75210]: WARNING nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state active and task_state rescuing.
Nov 29 01:45:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:40 user nova-compute[75210]: WARNING nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state active and task_state rescuing.
Nov 29 01:45:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:40 user nova-compute[75210]: WARNING nova.compute.manager [req-5ca9c8f3-d57f-4665-86d0-95b7d165ff50 req-c6c523d0-d5cb-4d38-87c8-d32f1880b6ca service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state active and task_state rescuing.
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f.part --force-share --output=json" returned: 0 in 0.206s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG nova.virt.images [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] 8bb5992a-c22c-4657-b6eb-16d189c971d2 was qcow2, converting to raw {{(pid=75210) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f.part /opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f.converted {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f.part /opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f.converted" returned: 0 in 0.552s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f.converted --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "6867d81137c063bdbdaa6ed095076fd1fb11d90f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.290s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "6867d81137c063bdbdaa6ed095076fd1fb11d90f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "6867d81137c063bdbdaa6ed095076fd1fb11d90f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f,backing_fmt=raw /opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.rescue {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f,backing_fmt=raw /opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.rescue" returned: 0 in 0.051s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "6867d81137c063bdbdaa6ed095076fd1fb11d90f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.objects.instance [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'migration_context' on Instance uuid 13274e43-2984-4aa6-ad9b-23e3bbe7c959 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.objects.base [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Object Instance<13274e43-2984-4aa6-ad9b-23e3bbe7c959> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Start _get_guest_xml network_info=[{"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "vif_mac": "fa:16:3e:3d:a2:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8bb5992a-c22c-4657-b6eb-16d189c971d2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '691730bf-78d2-413b-9e7b-78fc119bcfb9', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIiTrKbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '13274e43-2984-4aa6-ad9b-23e3bbe7c959', 'attached_at': '', 'detached_at': '', 'volume_id': '6ecc5284-b9f3-4bc1-a19f-a2ca55318e29', 'serial': '6ecc5284-b9f3-4bc1-a19f-a2ca55318e29'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.objects.instance [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'resources' on Instance uuid 13274e43-2984-4aa6-ad9b-23e3bbe7c959 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.objects.base [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Object Instance<13274e43-2984-4aa6-ad9b-23e3bbe7c959> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.objects.instance [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'numa_topology' on Instance uuid 13274e43-2984-4aa6-ad9b-23e3bbe7c959 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.objects.base [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Object Instance<13274e43-2984-4aa6-ad9b-23e3bbe7c959> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:45:41 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:45:41 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.objects.instance [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'vcpu_model' on Instance uuid 13274e43-2984-4aa6-ad9b-23e3bbe7c959 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.objects.base [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Object Instance<13274e43-2984-4aa6-ad9b-23e3bbe7c959> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIiTrKbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:45:41 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:45:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:45:41 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:45:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:45:41 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7ea5be-f847-42ae-9af8-e1fbf460e405]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = zIiTrKbs\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 01:45:41 user nova-compute[75210]: node.name = iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:45:41 user nova-compute[75210]: node.tpgt = -1
Nov 29 01:45:41 user nova-compute[75210]: node.startup = automatic
Nov 29 01:45:41 user nova-compute[75210]: node.leading_login = No
Nov 29 01:45:41 user nova-compute[75210]: iface.iscsi_ifacename = default
Nov 29 01:45:41 user nova-compute[75210]: iface.net_ifacename = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.ipaddress = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.prefix_len = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.hwaddress = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.transport_name = tcp
Nov 29 01:45:41 user nova-compute[75210]: iface.initiatorname = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.state = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.vlan_id = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.vlan_priority = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.vlan_state = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.iface_num = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.mtu = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.port = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.bootproto = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.subnet_mask = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.gateway = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.dhcp_alt_client_id = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.dhcp_dns = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.dhcp_learn_iqn = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.dhcp_vendor_id_state = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.dhcp_vendor_id = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.dhcp_slp_da = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.fragmentation = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.gratuitous_arp = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.incoming_forwarding = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.tos_state = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.tos = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.ttl = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.delayed_ack = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.tcp_nagle = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.tcp_wsf_state = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.tcp_wsf = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.tcp_timer_scale = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.tcp_timestamp = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.redirect = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.def_task_mgmt_timeout = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.header_digest = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.data_digest = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.immediate_data = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.initial_r2t = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.data_seq_inorder = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.data_pdu_inorder = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.erl = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.max_receive_data_len = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.first_burst_len = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.max_outstanding_r2t = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.max_burst_len = 0
Nov 29 01:45:41 user nova-compute[75210]: iface.chap_auth = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.bidi_chap = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.strict_login_compliance = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.discovery_auth = <empty>
Nov 29 01:45:41 user nova-compute[75210]: iface.discovery_logout = <empty>
Nov 29 01:45:41 user nova-compute[75210]: node.discovery_address = <empty>
Nov 29 01:45:41 user nova-compute[75210]: node.discovery_port = 0
Nov 29 01:45:41 user nova-compute[75210]: node.discovery_type = static
Nov 29 01:45:41 user nova-compute[75210]: node.session.initial_cmdsn = 0
Nov 29 01:45:41 user nova-compute[75210]: node.session.initial_login_retry_max = 8
Nov 29 01:45:41 user nova-compute[75210]: node.session.xmit_thread_priority = -20
Nov 29 01:45:41 user nova-compute[75210]: node.session.cmds_max = 128
Nov 29 01:45:41 user nova-compute[75210]: node.session.queue_depth = 32
Nov 29 01:45:41 user nova-compute[75210]: node.session.nr_sessions = 1
Nov 29 01:45:41 user nova-compute[75210]: node.session.auth.authmethod = CHAP
Nov 29 01:45:41 user nova-compute[75210]: node.session.auth.username = zIiTrKbs
Nov 29 01:45:41 user nova-compute[75210]: node.session.auth.password = ***
Nov 29 01:45:41 user nova-compute[75210]: node.session.auth.username_in = <empty>
Nov 29 01:45:41 user nova-compute[75210]: node.session.auth.password_in = <empty>
Nov 29 01:45:41 user nova-compute[75210]: node.session.auth.chap_algs = MD5
Nov 29 01:45:41 user nova-compute[75210]: node.session.timeo.replacement_timeout = 120
Nov 29 01:45:41 user nova-compute[75210]: node.session.err_timeo.abort_timeout = 15
Nov 29 01:45:41 user nova-compute[75210]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 01:45:41 user nova-compute[75210]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 01:45:41 user nova-compute[75210]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 01:45:41 user nova-compute[75210]: node.session.iscsi.FastAbort = Yes
Nov 29 01:45:41 user nova-compute[75210]: node.session.iscsi.InitialR2T = No
Nov 29 01:45:41 user nova-compute[75210]: node.session.iscsi.ImmediateData = Yes
Nov 29 01:45:41 user nova-compute[75210]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 01:45:41 user nova-compute[75210]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 01:45:41 user nova-compute[75210]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 01:45:41 user nova-compute[75210]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 01:45:41 user nova-compute[75210]: node.session.iscsi.MaxConnections = 1
Nov 29 01:45:41 user nova-compute[75210]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 01:45:41 user nova-compute[75210]: node.session.iscsi.ERL = 0
Nov 29 01:45:41 user nova-compute[75210]: node.session.scan = manual
Nov 29 01:45:41 user nova-compute[75210]: node.session.reopen_max = 0
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].address = 172.16.0.220
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].port = 3260
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].startup = manual
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].tcp.window_size = 524288
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].tcp.type_of_service = 0
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].timeo.logout_timeout = 15
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].timeo.login_timeout = 15
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].timeo.auth_timeout = 45
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].iscsi.DataDigest = None
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].iscsi.IFMarker = No
Nov 29 01:45:41 user nova-compute[75210]: node.conn[0].iscsi.OFMarker = No
Nov 29 01:45:41 user nova-compute[75210]: # END RECORD
Nov 29 01:45:41 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6565192-9887-4eca-bfa7-637030189424]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07c5d4c-56ed-4b87-b730-0318e3165d5a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIiTrKbs {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIiTrKbs" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2deab2-748b-4936-b1bd-95d90bd4dde8]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIiTrKbs'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8806c3e7-543d-406a-b6af-6679658b685c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0311867e-62a7-40e8-93bb-6853d6a5473a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:42 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:42 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] HCTL ('33', '0', '0', 0) found on session 23 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9c82d1-a2ec-4f39-adf6-08e623639e6d]: (4, ('0 0 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching for a device in session 23 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIiTrKbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.179s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] <== connect_volume: return (181ms) {'type': 'block', 'scsi_wwn': '23636353230333335', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636353230333335', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-355946989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-355946989',id=24,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:44:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-3t40l2p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:44:07Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=13274e43-2984-4aa6-ad9b-23e3bbe7c959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "vif_mac": "fa:16:3e:3d:a2:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "vif_mac": "fa:16:3e:3d:a2:c4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a2:c4,bridge_name='br-int',has_traffic_filtering=True,id=7a2f4623-853c-43d9-9964-d00e16199a0c,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2f4623-85') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG nova.objects.instance [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'pci_devices' on Instance uuid 13274e43-2984-4aa6-ad9b-23e3bbe7c959 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG nova.objects.base [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Object Instance<13274e43-2984-4aa6-ad9b-23e3bbe7c959> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:45:42 user nova-compute[75210]:   <uuid>13274e43-2984-4aa6-ad9b-23e3bbe7c959</uuid>
Nov 29 01:45:42 user nova-compute[75210]:   <name>instance-00000018</name>
Nov 29 01:45:42 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:45:42 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:45:42 user nova-compute[75210]:   <metadata>
Nov 29 01:45:42 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:45:42 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:45:42 user nova-compute[75210]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-355946989</nova:name>
Nov 29 01:45:42 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:45:41</nova:creationTime>
Nov 29 01:45:42 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:45:42 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:45:42 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:45:42 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:45:42 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:45:42 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:45:42 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:45:42 user nova-compute[75210]:       <nova:owner>
Nov 29 01:45:42 user nova-compute[75210]:         <nova:user uuid="28fd6f01158e4dd7a7df3e04e815a9d0">tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member</nova:user>
Nov 29 01:45:42 user nova-compute[75210]:         <nova:project uuid="34af8bfc0e1b4cbbb803c3bf6a8f7715">tempest-ServerBootFromVolumeStableRescueTest-440893694</nova:project>
Nov 29 01:45:42 user nova-compute[75210]:       </nova:owner>
Nov 29 01:45:42 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:45:42 user nova-compute[75210]:       <nova:ports>
Nov 29 01:45:42 user nova-compute[75210]:         <nova:port uuid="7a2f4623-853c-43d9-9964-d00e16199a0c">
Nov 29 01:45:42 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 01:45:42 user nova-compute[75210]:         </nova:port>
Nov 29 01:45:42 user nova-compute[75210]:       </nova:ports>
Nov 29 01:45:42 user nova-compute[75210]:     </nova:instance>
Nov 29 01:45:42 user nova-compute[75210]:   </metadata>
Nov 29 01:45:42 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:45:42 user nova-compute[75210]:     <system>
Nov 29 01:45:42 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:45:42 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:45:42 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:45:42 user nova-compute[75210]:       <entry name="serial">13274e43-2984-4aa6-ad9b-23e3bbe7c959</entry>
Nov 29 01:45:42 user nova-compute[75210]:       <entry name="uuid">13274e43-2984-4aa6-ad9b-23e3bbe7c959</entry>
Nov 29 01:45:42 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:45:42 user nova-compute[75210]:     </system>
Nov 29 01:45:42 user nova-compute[75210]:   </sysinfo>
Nov 29 01:45:42 user nova-compute[75210]:   <os>
Nov 29 01:45:42 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:45:42 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:45:42 user nova-compute[75210]:   </os>
Nov 29 01:45:42 user nova-compute[75210]:   <features>
Nov 29 01:45:42 user nova-compute[75210]:     <acpi/>
Nov 29 01:45:42 user nova-compute[75210]:     <apic/>
Nov 29 01:45:42 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:45:42 user nova-compute[75210]:   </features>
Nov 29 01:45:42 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:45:42 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:45:42 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:45:42 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:45:42 user nova-compute[75210]:   </clock>
Nov 29 01:45:42 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:45:42 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:45:42 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:45:42 user nova-compute[75210]:   </cpu>
Nov 29 01:45:42 user nova-compute[75210]:   <devices>
Nov 29 01:45:42 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:45:42 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:45:42 user nova-compute[75210]:       <source dev="/dev/sdb"/>
Nov 29 01:45:42 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:45:42 user nova-compute[75210]:       <serial>6ecc5284-b9f3-4bc1-a19f-a2ca55318e29</serial>
Nov 29 01:45:42 user nova-compute[75210]:     </disk>
Nov 29 01:45:42 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:45:42 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:45:42 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.rescue"/>
Nov 29 01:45:42 user nova-compute[75210]:       <target dev="vdb" bus="virtio"/>
Nov 29 01:45:42 user nova-compute[75210]:       <boot order="1"/>
Nov 29 01:45:42 user nova-compute[75210]:     </disk>
Nov 29 01:45:42 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:45:42 user nova-compute[75210]:       <mac address="fa:16:3e:3d:a2:c4"/>
Nov 29 01:45:42 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:45:42 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:45:42 user nova-compute[75210]:       <target dev="tap7a2f4623-85"/>
Nov 29 01:45:42 user nova-compute[75210]:     </interface>
Nov 29 01:45:42 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:45:42 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/console.log" append="off"/>
Nov 29 01:45:42 user nova-compute[75210]:     </serial>
Nov 29 01:45:42 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:45:42 user nova-compute[75210]:     <video>
Nov 29 01:45:42 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:45:42 user nova-compute[75210]:     </video>
Nov 29 01:45:42 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:45:42 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:45:42 user nova-compute[75210]:     </rng>
Nov 29 01:45:42 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:45:42 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:45:42 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:45:42 user nova-compute[75210]:     </memballoon>
Nov 29 01:45:42 user nova-compute[75210]:   </devices>
Nov 29 01:45:42 user nova-compute[75210]: </domain>
Nov 29 01:45:42 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:45:42 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Instance destroyed successfully.
Nov 29 01:45:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No VIF found with MAC fa:16:3e:3d:a2:c4, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-ef9f98ac-494d-48e7-9b1c-144ca7945a6d req-36233863-ea97-471c-a173-23c15a6d6316 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Received event network-changed-8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-ef9f98ac-494d-48e7-9b1c-144ca7945a6d req-36233863-ea97-471c-a173-23c15a6d6316 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Refreshing instance network info cache due to event network-changed-8e683807-4401-4160-a0b1-ae1ca4cc8090. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ef9f98ac-494d-48e7-9b1c-144ca7945a6d req-36233863-ea97-471c-a173-23c15a6d6316 service nova] Acquiring lock "refresh_cache-e6c9606c-5a27-417d-9042-259ce728e175" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ef9f98ac-494d-48e7-9b1c-144ca7945a6d req-36233863-ea97-471c-a173-23c15a6d6316 service nova] Acquired lock "refresh_cache-e6c9606c-5a27-417d-9042-259ce728e175" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:45:42 user nova-compute[75210]: DEBUG nova.network.neutron [req-ef9f98ac-494d-48e7-9b1c-144ca7945a6d req-36233863-ea97-471c-a173-23c15a6d6316 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Refreshing network info cache for port 8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:45:43 user nova-compute[75210]: DEBUG nova.network.neutron [req-ef9f98ac-494d-48e7-9b1c-144ca7945a6d req-36233863-ea97-471c-a173-23c15a6d6316 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Updated VIF entry in instance network info cache for port 8e683807-4401-4160-a0b1-ae1ca4cc8090. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:45:43 user nova-compute[75210]: DEBUG nova.network.neutron [req-ef9f98ac-494d-48e7-9b1c-144ca7945a6d req-36233863-ea97-471c-a173-23c15a6d6316 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Updating instance_info_cache with network_info: [{"id": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "address": "fa:16:3e:e2:b3:10", "network": {"id": "0cf68b22-09b9-450b-9c93-c653686008ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1379362399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f125ec37cd94d9eb54cd9ecc2343331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e683807-44", "ovs_interfaceid": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:45:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ef9f98ac-494d-48e7-9b1c-144ca7945a6d req-36233863-ea97-471c-a173-23c15a6d6316 service nova] Releasing lock "refresh_cache-e6c9606c-5a27-417d-9042-259ce728e175" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:45:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG nova.objects.instance [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'flavor' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-2b7a53e0-6cc4-4251-8fd8-9eabf6c417fb req-151d931d-3990-46fd-ba48-63f9c9af05a1 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2b7a53e0-6cc4-4251-8fd8-9eabf6c417fb req-151d931d-3990-46fd-ba48-63f9c9af05a1 service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2b7a53e0-6cc4-4251-8fd8-9eabf6c417fb req-151d931d-3990-46fd-ba48-63f9c9af05a1 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2b7a53e0-6cc4-4251-8fd8-9eabf6c417fb req-151d931d-3990-46fd-ba48-63f9c9af05a1 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-2b7a53e0-6cc4-4251-8fd8-9eabf6c417fb req-151d931d-3990-46fd-ba48-63f9c9af05a1 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:44 user nova-compute[75210]: WARNING nova.compute.manager [req-2b7a53e0-6cc4-4251-8fd8-9eabf6c417fb req-151d931d-3990-46fd-ba48-63f9c9af05a1 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state active and task_state rescuing.
Nov 29 01:45:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-2b7a53e0-6cc4-4251-8fd8-9eabf6c417fb req-151d931d-3990-46fd-ba48-63f9c9af05a1 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2b7a53e0-6cc4-4251-8fd8-9eabf6c417fb req-151d931d-3990-46fd-ba48-63f9c9af05a1 service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2b7a53e0-6cc4-4251-8fd8-9eabf6c417fb req-151d931d-3990-46fd-ba48-63f9c9af05a1 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2b7a53e0-6cc4-4251-8fd8-9eabf6c417fb req-151d931d-3990-46fd-ba48-63f9c9af05a1 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-2b7a53e0-6cc4-4251-8fd8-9eabf6c417fb req-151d931d-3990-46fd-ba48-63f9c9af05a1 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:44 user nova-compute[75210]: WARNING nova.compute.manager [req-2b7a53e0-6cc4-4251-8fd8-9eabf6c417fb req-151d931d-3990-46fd-ba48-63f9c9af05a1 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state active and task_state rescuing.
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:44 user nova-compute[75210]: INFO nova.compute.manager [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Attaching volume e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 to /dev/vdb
Nov 29 01:45:44 user nova-compute[75210]: DEBUG os_brick.utils [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14a9650-d41d-417e-ae02-eff56427e0eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70935c0-644f-4da1-b985-2e8957c84494]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[351ee981-8d75-4e77-ab20-5f99243e708d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d68bd5-dab1-450e-8df3-7e969a5d9a23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:45:45 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:45:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:45:45 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:45:45 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d963d2-10cf-4bdb-84b8-75e6ba71d795]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:45 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:45:45 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:45:45 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:45:45 user nova-compute[75210]: DEBUG os_brick.utils [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:45:45 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Updating existing volume attachment record: 44c2b006-04ad-4479-b473-85ff96c28db7 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:45:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-85dc0205-2028-4694-96bb-60f3432182ff tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:45:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:45:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:45:47 user nova-compute[75210]: INFO nova.compute.claims [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Claim successful on node user
Nov 29 01:45:47 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:45:47 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjKiOnuk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:45:48 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:45:48 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:45:48 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c803dc7-9e4e-43d6-b701-947530ca6acc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:45:48 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dd99ab-3b77-44f5-ba03-129c52da5e13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28] added
Nov 29 01:45:48 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c543e9-8f9e-41bf-8c6f-6337a7ac6802]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6a123d-6b20-4f15-9d45-cc9e1f4a9c85]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG nova.policy [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d98e0c98f554dd5b8a84f9b3933cf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30940563d2c94d87b2e350faf4d0c5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjKiOnuk {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JjKiOnuk" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b30eca2-9aa2-494c-8eb2-cca9c2c3e903]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JjKiOnuk'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edf6465-ba3f-408b-993f-9159d5b0a506]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:45:48 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Creating image(s)
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "/opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "/opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1d825b-5b23-48bd-aeef-4035c977811b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:48 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:48 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e33f45-90e8-4f67-8fb9-585085db95b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28, portal: 172.16.0.220,3260]
Nov 29 01:45:48 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28, portal: 172.16.0.220,3260] successful.
Nov 29 01:45:48 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[499b899e-cc19-4a99-b996-c65d85baecf6]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39c95bc-bafa-4b19-8bf3-bc77b031aad2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:48 user nova-compute[75210]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 (non-flash)
Nov 29 01:45:48 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:48 user nova-compute[75210]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 (non-flash)
Nov 29 01:45:48 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d7b019-7b7d-4c0b-9fab-24c116a90006]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjKiOnuk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.247s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk 1073741824" returned: 0 in 0.051s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.194s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:45:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Successfully created port: 2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Cannot resize image /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Ensure instance console log exists: /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26136373162396534', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136373162396534', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG nova.objects.instance [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lazy-loading 'flavor' on Instance uuid 9e68205c-08b3-40c4-aa6e-7a4730506dd7 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:45:49 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:45:49 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:45:49 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:45:49 user nova-compute[75210]:   <serial>e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28</serial>
Nov 29 01:45:49 user nova-compute[75210]: </disk>
Nov 29 01:45:49 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Successfully updated port: 2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "refresh_cache-3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquired lock "refresh_cache-3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-45f34772-0317-469a-b718-b819e363a55f req-143c1345-875f-468c-b0f3-560f06a6fa02 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received event network-changed-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-45f34772-0317-469a-b718-b819e363a55f req-143c1345-875f-468c-b0f3-560f06a6fa02 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Refreshing instance network info cache due to event network-changed-2d168686-6764-45e3-85bd-a8dff60fa4f0. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-45f34772-0317-469a-b718-b819e363a55f req-143c1345-875f-468c-b0f3-560f06a6fa02 service nova] Acquiring lock "refresh_cache-3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:45:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] No VIF found with MAC fa:16:3e:2c:d5:60, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Updating instance_info_cache with network_info: [{"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Releasing lock "refresh_cache-3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Instance network_info: |[{"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-45f34772-0317-469a-b718-b819e363a55f req-143c1345-875f-468c-b0f3-560f06a6fa02 service nova] Acquired lock "refresh_cache-3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.network.neutron [req-45f34772-0317-469a-b718-b819e363a55f req-143c1345-875f-468c-b0f3-560f06a6fa02 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Refreshing network info cache for port 2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Start _get_guest_xml network_info=[{"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:45:50 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:45:50 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17ac4cb9-4a67-42ad-81d1-cf07b899d314 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.027s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1671026619',display_name='tempest-tempest.common.compute-instance-1671026619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1671026619',id=28,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrAlkYCYFiG8HsPQ0MfXXz1CYvZvlSHO1nMa3YfzgL7Z5ZuVG5QkHtT6bn5NIQcIY/LXA39c0x9WLdrksniaIEuzEu31JLX8B5Z0tDXbGHkL+U+PKd9kCVGtrOpM+5bKg==',key_name='tempest-keypair-982499079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-86osubk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:45:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:45:50 user nova-compute[75210]:   <uuid>3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03</uuid>
Nov 29 01:45:50 user nova-compute[75210]:   <name>instance-0000001c</name>
Nov 29 01:45:50 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:45:50 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:45:50 user nova-compute[75210]:   <metadata>
Nov 29 01:45:50 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:45:50 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:45:50 user nova-compute[75210]:       <nova:name>tempest-tempest.common.compute-instance-1671026619</nova:name>
Nov 29 01:45:50 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:45:50</nova:creationTime>
Nov 29 01:45:50 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:45:50 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:45:50 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:45:50 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:45:50 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:45:50 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:45:50 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:45:50 user nova-compute[75210]:       <nova:owner>
Nov 29 01:45:50 user nova-compute[75210]:         <nova:user uuid="2d98e0c98f554dd5b8a84f9b3933cf1a">tempest-ServerActionsTestOtherA-1921082789-project-member</nova:user>
Nov 29 01:45:50 user nova-compute[75210]:         <nova:project uuid="30940563d2c94d87b2e350faf4d0c5b0">tempest-ServerActionsTestOtherA-1921082789</nova:project>
Nov 29 01:45:50 user nova-compute[75210]:       </nova:owner>
Nov 29 01:45:50 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:45:50 user nova-compute[75210]:       <nova:ports>
Nov 29 01:45:50 user nova-compute[75210]:         <nova:port uuid="2d168686-6764-45e3-85bd-a8dff60fa4f0">
Nov 29 01:45:50 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 01:45:50 user nova-compute[75210]:         </nova:port>
Nov 29 01:45:50 user nova-compute[75210]:       </nova:ports>
Nov 29 01:45:50 user nova-compute[75210]:     </nova:instance>
Nov 29 01:45:50 user nova-compute[75210]:   </metadata>
Nov 29 01:45:50 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:45:50 user nova-compute[75210]:     <system>
Nov 29 01:45:50 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:45:50 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:45:50 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:45:50 user nova-compute[75210]:       <entry name="serial">3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03</entry>
Nov 29 01:45:50 user nova-compute[75210]:       <entry name="uuid">3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03</entry>
Nov 29 01:45:50 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:45:50 user nova-compute[75210]:     </system>
Nov 29 01:45:50 user nova-compute[75210]:   </sysinfo>
Nov 29 01:45:50 user nova-compute[75210]:   <os>
Nov 29 01:45:50 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:45:50 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:45:50 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:45:50 user nova-compute[75210]:   </os>
Nov 29 01:45:50 user nova-compute[75210]:   <features>
Nov 29 01:45:50 user nova-compute[75210]:     <acpi/>
Nov 29 01:45:50 user nova-compute[75210]:     <apic/>
Nov 29 01:45:50 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:45:50 user nova-compute[75210]:   </features>
Nov 29 01:45:50 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:45:50 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:45:50 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:45:50 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:45:50 user nova-compute[75210]:   </clock>
Nov 29 01:45:50 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:45:50 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:45:50 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:45:50 user nova-compute[75210]:   </cpu>
Nov 29 01:45:50 user nova-compute[75210]:   <devices>
Nov 29 01:45:50 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:45:50 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:45:50 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk"/>
Nov 29 01:45:50 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:45:50 user nova-compute[75210]:     </disk>
Nov 29 01:45:50 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:45:50 user nova-compute[75210]:       <mac address="fa:16:3e:c6:54:7a"/>
Nov 29 01:45:50 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:45:50 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:45:50 user nova-compute[75210]:       <target dev="tap2d168686-67"/>
Nov 29 01:45:50 user nova-compute[75210]:     </interface>
Nov 29 01:45:50 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:45:50 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/console.log" append="off"/>
Nov 29 01:45:50 user nova-compute[75210]:     </serial>
Nov 29 01:45:50 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:45:50 user nova-compute[75210]:     <video>
Nov 29 01:45:50 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:45:50 user nova-compute[75210]:     </video>
Nov 29 01:45:50 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:45:50 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:45:50 user nova-compute[75210]:     </rng>
Nov 29 01:45:50 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:45:50 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:45:50 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:45:50 user nova-compute[75210]:     </memballoon>
Nov 29 01:45:50 user nova-compute[75210]:   </devices>
Nov 29 01:45:50 user nova-compute[75210]: </domain>
Nov 29 01:45:50 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1671026619',display_name='tempest-tempest.common.compute-instance-1671026619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1671026619',id=28,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrAlkYCYFiG8HsPQ0MfXXz1CYvZvlSHO1nMa3YfzgL7Z5ZuVG5QkHtT6bn5NIQcIY/LXA39c0x9WLdrksniaIEuzEu31JLX8B5Z0tDXbGHkL+U+PKd9kCVGtrOpM+5bKg==',key_name='tempest-keypair-982499079',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-86osubk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:45:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG os_vif [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8c12032-f441-5de6-bae1-3479fa09d558', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d168686-67, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d168686-67, col_values=(('qos', UUID('1fa13354-bf33-4350-be19-c98fff2a7d28')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d168686-67, col_values=(('external_ids', {'iface-id': '2d168686-6764-45e3-85bd-a8dff60fa4f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:54:7a', 'vm-uuid': '3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:50 user nova-compute[75210]: INFO os_vif [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67')
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No VIF found with MAC fa:16:3e:c6:54:7a, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.network.neutron [req-45f34772-0317-469a-b718-b819e363a55f req-143c1345-875f-468c-b0f3-560f06a6fa02 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Updated VIF entry in instance network info cache for port 2d168686-6764-45e3-85bd-a8dff60fa4f0. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG nova.network.neutron [req-45f34772-0317-469a-b718-b819e363a55f req-143c1345-875f-468c-b0f3-560f06a6fa02 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Updating instance_info_cache with network_info: [{"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-45f34772-0317-469a-b718-b819e363a55f req-143c1345-875f-468c-b0f3-560f06a6fa02 service nova] Releasing lock "refresh_cache-3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:45:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:51 user nova-compute[75210]: INFO nova.compute.manager [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Terminating instance
Nov 29 01:45:51 user nova-compute[75210]: DEBUG nova.compute.manager [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:45:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-925f84e2-52f9-40ee-b28f-1ca432ef00d9 req-e1c6614a-81e3-4322-9f26-7fe12a862829 service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Received event network-vif-unplugged-beb5773e-cc94-4ca8-b059-edccdafe0ee2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-925f84e2-52f9-40ee-b28f-1ca432ef00d9 req-e1c6614a-81e3-4322-9f26-7fe12a862829 service nova] Acquiring lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-925f84e2-52f9-40ee-b28f-1ca432ef00d9 req-e1c6614a-81e3-4322-9f26-7fe12a862829 service nova] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-925f84e2-52f9-40ee-b28f-1ca432ef00d9 req-e1c6614a-81e3-4322-9f26-7fe12a862829 service nova] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-925f84e2-52f9-40ee-b28f-1ca432ef00d9 req-e1c6614a-81e3-4322-9f26-7fe12a862829 service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] No waiting events found dispatching network-vif-unplugged-beb5773e-cc94-4ca8-b059-edccdafe0ee2 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-925f84e2-52f9-40ee-b28f-1ca432ef00d9 req-e1c6614a-81e3-4322-9f26-7fe12a862829 service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Received event network-vif-unplugged-beb5773e-cc94-4ca8-b059-edccdafe0ee2 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-03467ca2-338b-4764-9ad8-8a4fff6f841c req-cee9a92c-ce23-431d-932e-b36363a06542 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received event network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-03467ca2-338b-4764-9ad8-8a4fff6f841c req-cee9a92c-ce23-431d-932e-b36363a06542 service nova] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-03467ca2-338b-4764-9ad8-8a4fff6f841c req-cee9a92c-ce23-431d-932e-b36363a06542 service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-03467ca2-338b-4764-9ad8-8a4fff6f841c req-cee9a92c-ce23-431d-932e-b36363a06542 service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-03467ca2-338b-4764-9ad8-8a4fff6f841c req-cee9a92c-ce23-431d-932e-b36363a06542 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] No waiting events found dispatching network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:52 user nova-compute[75210]: WARNING nova.compute.manager [req-03467ca2-338b-4764-9ad8-8a4fff6f841c req-cee9a92c-ce23-431d-932e-b36363a06542 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received unexpected event network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 for instance with vm_state building and task_state spawning.
Nov 29 01:45:52 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Instance destroyed successfully.
Nov 29 01:45:52 user nova-compute[75210]: DEBUG nova.objects.instance [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lazy-loading 'resources' on Instance uuid 9e68205c-08b3-40c4-aa6e-7a4730506dd7 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2065532084',display_name='tempest-DeleteServersTestJSON-server-2065532084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2065532084',id=23,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:43:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b3548901d314e8594d539c6f41563e5',ramdisk_id='',reservation_id='r-72tny6p0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1271149131',owner_user_name='tempest-DeleteServersTestJSON-1271149131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:43:55Z,user_data=None,user_id='4ead7b0e78f3404fa0d0a1140bfb87d7',uuid=9e68205c-08b3-40c4-aa6e-7a4730506dd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "address": "fa:16:3e:2c:d5:60", "network": {"id": "f7f2fdcd-98d0-400f-ab35-1b17eb41c393", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-857788537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b3548901d314e8594d539c6f41563e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb5773e-cc", "ovs_interfaceid": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Converting VIF {"id": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "address": "fa:16:3e:2c:d5:60", "network": {"id": "f7f2fdcd-98d0-400f-ab35-1b17eb41c393", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-857788537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b3548901d314e8594d539c6f41563e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeb5773e-cc", "ovs_interfaceid": "beb5773e-cc94-4ca8-b059-edccdafe0ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=beb5773e-cc94-4ca8-b059-edccdafe0ee2,network=Network(f7f2fdcd-98d0-400f-ab35-1b17eb41c393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb5773e-cc') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_vif [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=beb5773e-cc94-4ca8-b059-edccdafe0ee2,network=Network(f7f2fdcd-98d0-400f-ab35-1b17eb41c393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb5773e-cc') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbeb5773e-cc, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a98a90b-25a0-483f-a200-a6c14119fbdf) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:45:52 user nova-compute[75210]: INFO os_vif [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:d5:60,bridge_name='br-int',has_traffic_filtering=True,id=beb5773e-cc94-4ca8-b059-edccdafe0ee2,network=Network(f7f2fdcd-98d0-400f-ab35-1b17eb41c393),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeb5773e-cc')
Nov 29 01:45:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JjKiOnuk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:45:52 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f52d008-257e-47fb-942b-38300b5197cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:45:52 user nova-compute[75210]: No targets found.
Nov 29 01:45:52 user nova-compute[75210]: iSNS:
Nov 29 01:45:52 user nova-compute[75210]: No targets found.
Nov 29 01:45:52 user nova-compute[75210]: STATIC:
Nov 29 01:45:52 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28
Nov 29 01:45:52 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:45:52 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:45:52 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:45:52 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:45:52 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:45:52 user nova-compute[75210]: FIRMWARE:
Nov 29 01:45:52 user nova-compute[75210]: No targets found.
Nov 29 01:45:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:45:52 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:45:52 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfdc83f-b4c2-4a21-ba8c-86ea091313ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[809fa5ee-74a1-4ebc-9f12-16c25842d13e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:52 user nova-compute[75210]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 (non-flash)
Nov 29 01:45:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:52 user nova-compute[75210]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 (non-flash)
Nov 29 01:45:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f3f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11ed9e0-f92c-428f-b5a8-86f5d9fb3364]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7deb60-5e73-404c-aeb8-424fa9dbdd56]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[32033966-fb19-461b-b9e3-fbe67877259f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f47266a-00d6-40e8-b5a0-1e54991d7935]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2000dff1-9bf5-4a96-9126-5ecd335bc210]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dc1840-f6e1-4aab-bec9-60a88a8b8659]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28, portal: 172.16.0.220,3260]
Nov 29 01:45:52 user nova-compute[75210]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28, portal: 172.16.0.220,3260] successful.
Nov 29 01:45:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1d6a972-7bca-4f54-b0b7-ebb9bae7fa28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.130s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4688b6e5-39e1-4bfb-b082-8c51734c12bd]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] <== disconnect_volume: return (461ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:45:53 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Deleting instance files /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7_del
Nov 29 01:45:53 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Deletion of /opt/stack/data/nova/instances/9e68205c-08b3-40c4-aa6e-7a4730506dd7_del complete
Nov 29 01:45:53 user nova-compute[75210]: INFO nova.compute.manager [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Took 1.80 seconds to destroy the instance on the hypervisor.
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBryAZxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:45:53 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:45:53 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:45:53 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[77992c97-02bd-46b0-8a0a-3d0d6db68dce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:45:53 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c4b707-e124-4d4c-af7c-a3e38cd4cf34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2] added
Nov 29 01:45:53 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[65253c92-0878-4f35-887a-9d7e50a89ac1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5833800a-d445-4131-9a9c-25f45e8d86df]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bBryAZxG {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bBryAZxG" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaebbab-4fde-4e2f-b8da-47c3a375fc9e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bBryAZxG'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[050a74f4-1b63-4b3e-80a7-f78d13228cce]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f093955-cbf7-4737-9a7f-ef80e7e245db]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:53 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:53 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a41a6-d77e-48b9-8bda-49a929ec0223]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2, portal: 172.16.0.220,3260]
Nov 29 01:45:53 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2, portal: 172.16.0.220,3260] successful.
Nov 29 01:45:53 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1424d428-7ecb-4796-af94-92d2eca55432]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa46bf99-8c7c-4059-a63a-2d39d98e5d08]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:53 user nova-compute[75210]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 (non-flash)
Nov 29 01:45:53 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:45:53 user nova-compute[75210]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 (non-flash)
Nov 29 01:45:53 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f615a81-fae6-4709-ae72-25af8b7054c7]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBryAZxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:45:53 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:45:54 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Took 0.85 seconds to deallocate network for instance.
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-dc9d1861-0066-4f19-8f68-a90c979d54bb req-9f7dcb81-750c-40ac-995c-672a395c315f service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Received event network-vif-deleted-beb5773e-cc94-4ca8-b059-edccdafe0ee2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee251506-7747-441f-aafd-f754256cd7f6 req-a405c3b2-508e-47c7-ac79-133caecb9f16 service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Received event network-vif-plugged-beb5773e-cc94-4ca8-b059-edccdafe0ee2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee251506-7747-441f-aafd-f754256cd7f6 req-a405c3b2-508e-47c7-ac79-133caecb9f16 service nova] Acquiring lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee251506-7747-441f-aafd-f754256cd7f6 req-a405c3b2-508e-47c7-ac79-133caecb9f16 service nova] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee251506-7747-441f-aafd-f754256cd7f6 req-a405c3b2-508e-47c7-ac79-133caecb9f16 service nova] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee251506-7747-441f-aafd-f754256cd7f6 req-a405c3b2-508e-47c7-ac79-133caecb9f16 service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] No waiting events found dispatching network-vif-plugged-beb5773e-cc94-4ca8-b059-edccdafe0ee2 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:54 user nova-compute[75210]: WARNING nova.compute.manager [req-ee251506-7747-441f-aafd-f754256cd7f6 req-a405c3b2-508e-47c7-ac79-133caecb9f16 service nova] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Received unexpected event network-vif-plugged-beb5773e-cc94-4ca8-b059-edccdafe0ee2 for instance with vm_state active and task_state deleting.
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a7bdab77-8d99-4498-837e-3ae2fd6ccbad req-b91f8385-85ab-4cf3-9c22-67e6cbc0441d service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received event network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a7bdab77-8d99-4498-837e-3ae2fd6ccbad req-b91f8385-85ab-4cf3-9c22-67e6cbc0441d service nova] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a7bdab77-8d99-4498-837e-3ae2fd6ccbad req-b91f8385-85ab-4cf3-9c22-67e6cbc0441d service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a7bdab77-8d99-4498-837e-3ae2fd6ccbad req-b91f8385-85ab-4cf3-9c22-67e6cbc0441d service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-a7bdab77-8d99-4498-837e-3ae2fd6ccbad req-b91f8385-85ab-4cf3-9c22-67e6cbc0441d service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] No waiting events found dispatching network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:45:54 user nova-compute[75210]: WARNING nova.compute.manager [req-a7bdab77-8d99-4498-837e-3ae2fd6ccbad req-b91f8385-85ab-4cf3-9c22-67e6cbc0441d service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received unexpected event network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 for instance with vm_state building and task_state spawning.
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:45:54 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Instance spawned successfully.
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:45:54 user nova-compute[75210]: INFO nova.compute.manager [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Took 6.48 seconds to spawn the instance on the hypervisor.
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:45:54 user nova-compute[75210]: INFO nova.compute.manager [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Took 7.35 seconds to build instance.
Nov 29 01:45:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6e694980-d186-40ad-a0f6-77b230929f70 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.457s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26161393334343464', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161393334343464', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.objects.instance [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'flavor' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:45:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:45:54 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:45:54 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:45:54 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:45:54 user nova-compute[75210]:   <serial>e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2</serial>
Nov 29 01:45:54 user nova-compute[75210]: </disk>
Nov 29 01:45:54 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:45:54 user nova-compute[75210]: INFO nova.compute.manager [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] [instance: 9e68205c-08b3-40c4-aa6e-7a4730506dd7] Took 0.98 seconds to detach 1 volumes for instance.
Nov 29 01:45:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:45:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:45:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:45:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:45:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No VIF found with MAC fa:16:3e:e2:b3:10, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:45:55 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:45:55 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:45:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:55 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Deleted allocations for instance 9e68205c-08b3-40c4-aa6e-7a4730506dd7
Nov 29 01:45:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-944de326-a820-44a6-9263-b6a43552665d tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.786s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8f4079c3-b05c-422f-9561-1b1d55a8f309 tempest-DeleteServersTestJSON-1271149131 tempest-DeleteServersTestJSON-1271149131-project-member] Lock "9e68205c-08b3-40c4-aa6e-7a4730506dd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.308s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:45:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:45:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:01 user nova-compute[75210]: INFO nova.compute.manager [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Terminating instance
Nov 29 01:46:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:46:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-ffeee29c-a142-4d1c-99cb-ada46083d9ce req-f0cf1931-52e7-495e-bb32-86fa1dcb07be service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Received event network-vif-unplugged-7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ffeee29c-a142-4d1c-99cb-ada46083d9ce req-f0cf1931-52e7-495e-bb32-86fa1dcb07be service nova] Acquiring lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ffeee29c-a142-4d1c-99cb-ada46083d9ce req-f0cf1931-52e7-495e-bb32-86fa1dcb07be service nova] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ffeee29c-a142-4d1c-99cb-ada46083d9ce req-f0cf1931-52e7-495e-bb32-86fa1dcb07be service nova] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-ffeee29c-a142-4d1c-99cb-ada46083d9ce req-f0cf1931-52e7-495e-bb32-86fa1dcb07be service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] No waiting events found dispatching network-vif-unplugged-7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-ffeee29c-a142-4d1c-99cb-ada46083d9ce req-f0cf1931-52e7-495e-bb32-86fa1dcb07be service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Received event network-vif-unplugged-7bb61315-6ffe-4248-b5bc-0a4816f95e35 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:46:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Instance destroyed successfully.
Nov 29 01:46:02 user nova-compute[75210]: DEBUG nova.objects.instance [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'resources' on Instance uuid c3eec4ab-96b5-4197-9633-6ffad4f3954e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:43:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1693452363',display_name='tempest-AttachVolumeNegativeTest-server-1693452363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1693452363',id=22,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOIDqdbpxOnXafw+emnKKHglGc9YqumNs2Mh+KBNgOD1wHCiA67w8FP03jUW7M2Zf7FT5MADNWn6G/wRgW1zBhZ874E837TzppedqWhuLHt0JV1q6mjHQhPHumLy4VYAg==',key_name='tempest-keypair-1797049600',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18f1a3d6f5994f6eb15e0ab2294efd53',ramdisk_id='',reservation_id='r-fkz6royw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-648523364',owner_user_name='tempest-AttachVolumeNegativeTest-648523364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd39b87d15084d84983873b59f36a211',uuid=c3eec4ab-96b5-4197-9633-6ffad4f3954e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "address": "fa:16:3e:45:d9:df", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb61315-6f", "ovs_interfaceid": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converting VIF {"id": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "address": "fa:16:3e:45:d9:df", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb61315-6f", "ovs_interfaceid": "7bb61315-6ffe-4248-b5bc-0a4816f95e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:d9:df,bridge_name='br-int',has_traffic_filtering=True,id=7bb61315-6ffe-4248-b5bc-0a4816f95e35,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb61315-6f') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG os_vif [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:d9:df,bridge_name='br-int',has_traffic_filtering=True,id=7bb61315-6ffe-4248-b5bc-0a4816f95e35,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb61315-6f') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bb61315-6f, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7dfc015-2f56-401d-b614-196e16dab999) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:02 user nova-compute[75210]: INFO os_vif [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:d9:df,bridge_name='br-int',has_traffic_filtering=True,id=7bb61315-6ffe-4248-b5bc-0a4816f95e35,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb61315-6f')
Nov 29 01:46:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Deleting instance files /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e_del
Nov 29 01:46:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Deletion of /opt/stack/data/nova/instances/c3eec4ab-96b5-4197-9633-6ffad4f3954e_del complete
Nov 29 01:46:02 user nova-compute[75210]: INFO nova.compute.manager [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 29 01:46:02 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:46:02 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:46:03 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:46:03 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Took 0.79 seconds to deallocate network for instance.
Nov 29 01:46:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:03 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:46:03 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:46:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:03 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Deleted allocations for instance c3eec4ab-96b5-4197-9633-6ffad4f3954e
Nov 29 01:46:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-408ce49f-1702-4eef-a158-b69ac849c1e2 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.211s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-8a352f89-a502-4dd7-8885-86910bbe7bcc req-f8eec433-73b9-4e3d-98c4-8b9ada3e2f6a service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Received event network-vif-plugged-7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8a352f89-a502-4dd7-8885-86910bbe7bcc req-f8eec433-73b9-4e3d-98c4-8b9ada3e2f6a service nova] Acquiring lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8a352f89-a502-4dd7-8885-86910bbe7bcc req-f8eec433-73b9-4e3d-98c4-8b9ada3e2f6a service nova] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8a352f89-a502-4dd7-8885-86910bbe7bcc req-f8eec433-73b9-4e3d-98c4-8b9ada3e2f6a service nova] Lock "c3eec4ab-96b5-4197-9633-6ffad4f3954e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-8a352f89-a502-4dd7-8885-86910bbe7bcc req-f8eec433-73b9-4e3d-98c4-8b9ada3e2f6a service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] No waiting events found dispatching network-vif-plugged-7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:46:04 user nova-compute[75210]: WARNING nova.compute.manager [req-8a352f89-a502-4dd7-8885-86910bbe7bcc req-f8eec433-73b9-4e3d-98c4-8b9ada3e2f6a service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Received unexpected event network-vif-plugged-7bb61315-6ffe-4248-b5bc-0a4816f95e35 for instance with vm_state deleted and task_state None.
Nov 29 01:46:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-8a352f89-a502-4dd7-8885-86910bbe7bcc req-f8eec433-73b9-4e3d-98c4-8b9ada3e2f6a service nova] [instance: c3eec4ab-96b5-4197-9633-6ffad4f3954e] Received event network-vif-deleted-7bb61315-6ffe-4248-b5bc-0a4816f95e35 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:10 user nova-compute[75210]: INFO nova.compute.manager [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Detaching volume e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2
Nov 29 01:46:10 user nova-compute[75210]: INFO nova.virt.block_device [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Attempting to driver detach volume e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 from mountpoint /dev/vdb
Nov 29 01:46:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Attempting to detach device vdb from instance e6c9606c-5a27-417d-9042-259ce728e175 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:46:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:46:10 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:46:10 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:46:10 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:46:10 user nova-compute[75210]:   <serial>e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2</serial>
Nov 29 01:46:10 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:46:10 user nova-compute[75210]: </disk>
Nov 29 01:46:10 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:46:10 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Successfully detached device vdb from instance e6c9606c-5a27-417d-9042-259ce728e175 from the persistent domain config.
Nov 29 01:46:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6c9606c-5a27-417d-9042-259ce728e175 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:46:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:46:10 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:46:10 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:46:10 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:46:10 user nova-compute[75210]:   <serial>e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2</serial>
Nov 29 01:46:10 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:46:10 user nova-compute[75210]: </disk>
Nov 29 01:46:10 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:46:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:46:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:18 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:46:20 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:46:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:21 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:46:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:23 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:46:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:46:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:46:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:46:23 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:46:23 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Updating instance_info_cache with network_info: [{"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:46:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:46:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:46:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:46:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:24 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:46:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:46:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:28 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:46:28 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:46:28 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7474MB free_disk=25.216915130615234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:46:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance e6c9606c-5a27-417d-9042-259ce728e175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance aaf1b90e-3ea7-4d65-8298-de2ca684573e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 4fab87e3-2f7c-4db4-9f14-ace1813fe046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:46:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:46:30 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e6c9606c-5a27-417d-9042-259ce728e175 is timed out.
Nov 29 01:46:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Successfully detached device vdb from instance e6c9606c-5a27-417d-9042-259ce728e175 from the live domain config.
Nov 29 01:46:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bBryAZxG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:46:30 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[910c0502-b493-4c6a-ad48-096abadb8aa2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:46:30 user nova-compute[75210]: No targets found.
Nov 29 01:46:30 user nova-compute[75210]: iSNS:
Nov 29 01:46:30 user nova-compute[75210]: No targets found.
Nov 29 01:46:30 user nova-compute[75210]: STATIC:
Nov 29 01:46:30 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2
Nov 29 01:46:30 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:46:30 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:46:30 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:46:30 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:46:30 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:46:30 user nova-compute[75210]: FIRMWARE:
Nov 29 01:46:30 user nova-compute[75210]: No targets found.
Nov 29 01:46:30 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:46:30 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:46:30 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5212e433-1300-4069-85b1-fa4313f62ab3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f48c93-bedc-45d7-b6fa-07ace6923afa]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:46:30 user nova-compute[75210]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 (non-flash)
Nov 29 01:46:30 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:46:30 user nova-compute[75210]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 (non-flash)
Nov 29 01:46:30 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4e5fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[64464d35-4593-403f-a0ff-921e5f3e32d3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f932abdc-9811-44a3-8b8d-cb6ac5b0ffbd]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[de11b31f-fcab-4a9d-8dc5-50b1f87de82d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[875a6930-8d32-4acd-9e3c-d7641110b260]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a9b1b6-5d07-4ea5-bb51-5510c2360d62]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:46:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[769187e5-c8ce-4b61-b6f3-1a09eb45ddfe]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:46:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2, portal: 172.16.0.220,3260]
Nov 29 01:46:31 user nova-compute[75210]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2, portal: 172.16.0.220,3260] successful.
Nov 29 01:46:31 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:46:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1f2f230-b3c8-4d5f-b25b-8f2ca6180cf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebecfdbc-d215-4402-8cbb-54d2c09f75e1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:46:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:46:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:46:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] <== disconnect_volume: return (275ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:46:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:46:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:31 user nova-compute[75210]: DEBUG nova.objects.instance [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'flavor' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:46:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-19ab94e9-a2b6-4fe8-a2fa-2f066015f011 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.869s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:46:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 01:46:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:46:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:46:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:48 user nova-compute[75210]: INFO nova.compute.manager [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Rescuing
Nov 29 01:46:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:46:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquired lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:46:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:46:49 user nova-compute[75210]: DEBUG nova.network.neutron [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Updating instance_info_cache with network_info: [{"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:46:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Releasing lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:46:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-43b2883a-f6e9-4a93-977b-6696fb5f87d1 req-e7aeaa5a-0c55-4764-af93-58865631904e service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-43b2883a-f6e9-4a93-977b-6696fb5f87d1 req-e7aeaa5a-0c55-4764-af93-58865631904e service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-43b2883a-f6e9-4a93-977b-6696fb5f87d1 req-e7aeaa5a-0c55-4764-af93-58865631904e service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-43b2883a-f6e9-4a93-977b-6696fb5f87d1 req-e7aeaa5a-0c55-4764-af93-58865631904e service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-43b2883a-f6e9-4a93-977b-6696fb5f87d1 req-e7aeaa5a-0c55-4764-af93-58865631904e service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:46:49 user nova-compute[75210]: WARNING nova.compute.manager [req-43b2883a-f6e9-4a93-977b-6696fb5f87d1 req-e7aeaa5a-0c55-4764-af93-58865631904e service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state active and task_state rescuing.
Nov 29 01:46:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Instance destroyed successfully.
Nov 29 01:46:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Attempting rescue
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75210) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Instance directory exists: not creating {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 01:46:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Creating image(s)
Nov 29 01:46:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "/opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "/opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "/opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'trusted_certs' on Instance uuid 391642f0-2293-46bf-a93a-c6f2e61698f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.190s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.rescue {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.rescue" returned: 0 in 0.058s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'migration_context' on Instance uuid 391642f0-2293-46bf-a93a-c6f2e61698f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.objects.base [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<391642f0-2293-46bf-a93a-c6f2e61698f6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Start _get_guest_xml network_info=[{"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "vif_mac": "fa:16:3e:57:a8:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'resources' on Instance uuid 391642f0-2293-46bf-a93a-c6f2e61698f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.objects.base [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<391642f0-2293-46bf-a93a-c6f2e61698f6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'numa_topology' on Instance uuid 391642f0-2293-46bf-a93a-c6f2e61698f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.objects.base [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<391642f0-2293-46bf-a93a-c6f2e61698f6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:46:50 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:46:50 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'vcpu_model' on Instance uuid 391642f0-2293-46bf-a93a-c6f2e61698f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.objects.base [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<391642f0-2293-46bf-a93a-c6f2e61698f6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2054332848',display_name='tempest-ServerRescueNegativeTestJSON-server-2054332848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2054332848',id=19,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ea74c32e3354c9bb76465b39f437026',ramdisk_id='',reservation_id='r-fr65hu1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-948038897',owner_user_name='tempest-ServerRescueNegativeTestJSON-948038897-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:42:15Z,user_data=None,user_id='339a0127c78144a989498320081f2c15',uuid=391642f0-2293-46bf-a93a-c6f2e61698f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "vif_mac": "fa:16:3e:57:a8:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converting VIF {"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "vif_mac": "fa:16:3e:57:a8:7e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=81029dcc-8ce3-4765-b4a9-9dbe2860f2cd,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81029dcc-8c') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'pci_devices' on Instance uuid 391642f0-2293-46bf-a93a-c6f2e61698f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.objects.base [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<391642f0-2293-46bf-a93a-c6f2e61698f6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:46:50 user nova-compute[75210]:   <uuid>391642f0-2293-46bf-a93a-c6f2e61698f6</uuid>
Nov 29 01:46:50 user nova-compute[75210]:   <name>instance-00000013</name>
Nov 29 01:46:50 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:46:50 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:46:50 user nova-compute[75210]:   <metadata>
Nov 29 01:46:50 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:46:50 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:46:50 user nova-compute[75210]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2054332848</nova:name>
Nov 29 01:46:50 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:46:50</nova:creationTime>
Nov 29 01:46:50 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:46:50 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:46:50 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:46:50 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:46:50 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:46:50 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:46:50 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:46:50 user nova-compute[75210]:       <nova:owner>
Nov 29 01:46:50 user nova-compute[75210]:         <nova:user uuid="339a0127c78144a989498320081f2c15">tempest-ServerRescueNegativeTestJSON-948038897-project-member</nova:user>
Nov 29 01:46:50 user nova-compute[75210]:         <nova:project uuid="9ea74c32e3354c9bb76465b39f437026">tempest-ServerRescueNegativeTestJSON-948038897</nova:project>
Nov 29 01:46:50 user nova-compute[75210]:       </nova:owner>
Nov 29 01:46:50 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:46:50 user nova-compute[75210]:       <nova:ports>
Nov 29 01:46:50 user nova-compute[75210]:         <nova:port uuid="81029dcc-8ce3-4765-b4a9-9dbe2860f2cd">
Nov 29 01:46:50 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 01:46:50 user nova-compute[75210]:         </nova:port>
Nov 29 01:46:50 user nova-compute[75210]:       </nova:ports>
Nov 29 01:46:50 user nova-compute[75210]:     </nova:instance>
Nov 29 01:46:50 user nova-compute[75210]:   </metadata>
Nov 29 01:46:50 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:46:50 user nova-compute[75210]:     <system>
Nov 29 01:46:50 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:46:50 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:46:50 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:46:50 user nova-compute[75210]:       <entry name="serial">391642f0-2293-46bf-a93a-c6f2e61698f6</entry>
Nov 29 01:46:50 user nova-compute[75210]:       <entry name="uuid">391642f0-2293-46bf-a93a-c6f2e61698f6</entry>
Nov 29 01:46:50 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:46:50 user nova-compute[75210]:     </system>
Nov 29 01:46:50 user nova-compute[75210]:   </sysinfo>
Nov 29 01:46:50 user nova-compute[75210]:   <os>
Nov 29 01:46:50 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:46:50 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:46:50 user nova-compute[75210]:   </os>
Nov 29 01:46:50 user nova-compute[75210]:   <features>
Nov 29 01:46:50 user nova-compute[75210]:     <acpi/>
Nov 29 01:46:50 user nova-compute[75210]:     <apic/>
Nov 29 01:46:50 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:46:50 user nova-compute[75210]:   </features>
Nov 29 01:46:50 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:46:50 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:46:50 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:46:50 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:46:50 user nova-compute[75210]:   </clock>
Nov 29 01:46:50 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:46:50 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:46:50 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:46:50 user nova-compute[75210]:   </cpu>
Nov 29 01:46:50 user nova-compute[75210]:   <devices>
Nov 29 01:46:50 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:46:50 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:46:50 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.rescue"/>
Nov 29 01:46:50 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:46:50 user nova-compute[75210]:     </disk>
Nov 29 01:46:50 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:46:50 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:46:50 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk"/>
Nov 29 01:46:50 user nova-compute[75210]:       <target dev="vdb" bus="virtio"/>
Nov 29 01:46:50 user nova-compute[75210]:     </disk>
Nov 29 01:46:50 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:46:50 user nova-compute[75210]:       <mac address="fa:16:3e:57:a8:7e"/>
Nov 29 01:46:50 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:46:50 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:46:50 user nova-compute[75210]:       <target dev="tap81029dcc-8c"/>
Nov 29 01:46:50 user nova-compute[75210]:     </interface>
Nov 29 01:46:50 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:46:50 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/console.log" append="off"/>
Nov 29 01:46:50 user nova-compute[75210]:     </serial>
Nov 29 01:46:50 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:46:50 user nova-compute[75210]:     <video>
Nov 29 01:46:50 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:46:50 user nova-compute[75210]:     </video>
Nov 29 01:46:50 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:46:50 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:46:50 user nova-compute[75210]:     </rng>
Nov 29 01:46:50 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:46:50 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:46:50 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:46:50 user nova-compute[75210]:     </memballoon>
Nov 29 01:46:50 user nova-compute[75210]:   </devices>
Nov 29 01:46:50 user nova-compute[75210]: </domain>
Nov 29 01:46:50 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:46:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Instance destroyed successfully.
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No VIF found with MAC fa:16:3e:57:a8:7e, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:46:51 user nova-compute[75210]: WARNING nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state active and task_state rescuing.
Nov 29 01:46:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:46:51 user nova-compute[75210]: WARNING nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state active and task_state rescuing.
Nov 29 01:46:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:46:51 user nova-compute[75210]: WARNING nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state active and task_state rescuing.
Nov 29 01:46:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:46:51 user nova-compute[75210]: WARNING nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state active and task_state rescuing.
Nov 29 01:46:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:46:51 user nova-compute[75210]: WARNING nova.compute.manager [req-ee6962f0-09cd-4d61-a229-6ca7440ba09d req-c79b11a7-48c5-4ac6-af42-746f81d7c224 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state active and task_state rescuing.
Nov 29 01:46:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-c1c04e1d-f8e4-42a6-b9f0-c19eb892af68 req-ec97d2b4-a6aa-4db0-a188-8118b192aa8d service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c1c04e1d-f8e4-42a6-b9f0-c19eb892af68 req-ec97d2b4-a6aa-4db0-a188-8118b192aa8d service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c1c04e1d-f8e4-42a6-b9f0-c19eb892af68 req-ec97d2b4-a6aa-4db0-a188-8118b192aa8d service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c1c04e1d-f8e4-42a6-b9f0-c19eb892af68 req-ec97d2b4-a6aa-4db0-a188-8118b192aa8d service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-c1c04e1d-f8e4-42a6-b9f0-c19eb892af68 req-ec97d2b4-a6aa-4db0-a188-8118b192aa8d service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:46:54 user nova-compute[75210]: WARNING nova.compute.manager [req-c1c04e1d-f8e4-42a6-b9f0-c19eb892af68 req-ec97d2b4-a6aa-4db0-a188-8118b192aa8d service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state active and task_state rescuing.
Nov 29 01:46:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-c1c04e1d-f8e4-42a6-b9f0-c19eb892af68 req-ec97d2b4-a6aa-4db0-a188-8118b192aa8d service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c1c04e1d-f8e4-42a6-b9f0-c19eb892af68 req-ec97d2b4-a6aa-4db0-a188-8118b192aa8d service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c1c04e1d-f8e4-42a6-b9f0-c19eb892af68 req-ec97d2b4-a6aa-4db0-a188-8118b192aa8d service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c1c04e1d-f8e4-42a6-b9f0-c19eb892af68 req-ec97d2b4-a6aa-4db0-a188-8118b192aa8d service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-c1c04e1d-f8e4-42a6-b9f0-c19eb892af68 req-ec97d2b4-a6aa-4db0-a188-8118b192aa8d service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:46:54 user nova-compute[75210]: WARNING nova.compute.manager [req-c1c04e1d-f8e4-42a6-b9f0-c19eb892af68 req-ec97d2b4-a6aa-4db0-a188-8118b192aa8d service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state active and task_state rescuing.
Nov 29 01:46:54 user nova-compute[75210]: DEBUG nova.compute.manager [None req-2e015b34-6544-4c63-ad2e-783ec2f4a8ac tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:46:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:46:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:56 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:46:56 user nova-compute[75210]: INFO nova.compute.claims [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Claim successful on node user
Nov 29 01:46:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:57 user nova-compute[75210]: INFO nova.compute.manager [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Terminating instance
Nov 29 01:46:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:46:57 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:46:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG nova.compute.manager [req-7391ad29-e376-44c4-b013-0929c1553862 req-3a0c856c-f614-453b-a62c-99b093a79173 service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Received event network-vif-unplugged-af98fbff-3a16-4423-9c11-733538ad4326 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7391ad29-e376-44c4-b013-0929c1553862 req-3a0c856c-f614-453b-a62c-99b093a79173 service nova] Acquiring lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7391ad29-e376-44c4-b013-0929c1553862 req-3a0c856c-f614-453b-a62c-99b093a79173 service nova] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7391ad29-e376-44c4-b013-0929c1553862 req-3a0c856c-f614-453b-a62c-99b093a79173 service nova] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG nova.compute.manager [req-7391ad29-e376-44c4-b013-0929c1553862 req-3a0c856c-f614-453b-a62c-99b093a79173 service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] No waiting events found dispatching network-vif-unplugged-af98fbff-3a16-4423-9c11-733538ad4326 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG nova.compute.manager [req-7391ad29-e376-44c4-b013-0929c1553862 req-3a0c856c-f614-453b-a62c-99b093a79173 service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Received event network-vif-unplugged-af98fbff-3a16-4423-9c11-733538ad4326 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG nova.policy [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd39b87d15084d84983873b59f36a211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f1a3d6f5994f6eb15e0ab2294efd53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:46:57 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Creating image(s)
Nov 29 01:46:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "/opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "/opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "/opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.215s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.214s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:58 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Instance destroyed successfully.
Nov 29 01:46:58 user nova-compute[75210]: DEBUG nova.objects.instance [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lazy-loading 'resources' on Instance uuid aaf1b90e-3ea7-4d65-8298-de2ca684573e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk 1073741824" returned: 0 in 0.058s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1520174672',display_name='tempest-VolumesActionsTest-instance-1520174672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1520174672',id=26,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:45:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ab6f8371c2b41d6b8a56647698c9639',ramdisk_id='',reservation_id='r-1l8o3q10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1214713951',owner_user_name='tempest-VolumesActionsTest-1214713951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:45:13Z,user_data=None,user_id='56716f093b9044078cb70385c84d53bf',uuid=aaf1b90e-3ea7-4d65-8298-de2ca684573e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af98fbff-3a16-4423-9c11-733538ad4326", "address": "fa:16:3e:ad:cf:da", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98fbff-3a", "ovs_interfaceid": "af98fbff-3a16-4423-9c11-733538ad4326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Converting VIF {"id": "af98fbff-3a16-4423-9c11-733538ad4326", "address": "fa:16:3e:ad:cf:da", "network": {"id": "8982db50-c497-4d1b-8d14-038aeee974f3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1087001237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ab6f8371c2b41d6b8a56647698c9639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf98fbff-3a", "ovs_interfaceid": "af98fbff-3a16-4423-9c11-733538ad4326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:cf:da,bridge_name='br-int',has_traffic_filtering=True,id=af98fbff-3a16-4423-9c11-733538ad4326,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98fbff-3a') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG os_vif [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:cf:da,bridge_name='br-int',has_traffic_filtering=True,id=af98fbff-3a16-4423-9c11-733538ad4326,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98fbff-3a') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf98fbff-3a, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=729af81a-7d49-457d-aa8e-999f405ce9bd) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:46:58 user nova-compute[75210]: INFO os_vif [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:cf:da,bridge_name='br-int',has_traffic_filtering=True,id=af98fbff-3a16-4423-9c11-733538ad4326,network=Network(8982db50-c497-4d1b-8d14-038aeee974f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf98fbff-3a')
Nov 29 01:46:58 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Deleting instance files /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e_del
Nov 29 01:46:58 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Deletion of /opt/stack/data/nova/instances/aaf1b90e-3ea7-4d65-8298-de2ca684573e_del complete
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.213s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:46:58 user nova-compute[75210]: INFO nova.compute.manager [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Successfully created port: 1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Cannot resize image /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Ensure instance console log exists: /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:59 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:46:59 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Took 1.09 seconds to deallocate network for instance.
Nov 29 01:46:59 user nova-compute[75210]: DEBUG nova.compute.manager [req-4d5d6561-5abb-4728-ba67-b235f031cbaf req-c21906f2-8651-41cf-8e20-9ce4ec1fcf3a service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Received event network-vif-plugged-af98fbff-3a16-4423-9c11-733538ad4326 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4d5d6561-5abb-4728-ba67-b235f031cbaf req-c21906f2-8651-41cf-8e20-9ce4ec1fcf3a service nova] Acquiring lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4d5d6561-5abb-4728-ba67-b235f031cbaf req-c21906f2-8651-41cf-8e20-9ce4ec1fcf3a service nova] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4d5d6561-5abb-4728-ba67-b235f031cbaf req-c21906f2-8651-41cf-8e20-9ce4ec1fcf3a service nova] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:46:59 user nova-compute[75210]: DEBUG nova.compute.manager [req-4d5d6561-5abb-4728-ba67-b235f031cbaf req-c21906f2-8651-41cf-8e20-9ce4ec1fcf3a service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] No waiting events found dispatching network-vif-plugged-af98fbff-3a16-4423-9c11-733538ad4326 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:46:59 user nova-compute[75210]: WARNING nova.compute.manager [req-4d5d6561-5abb-4728-ba67-b235f031cbaf req-c21906f2-8651-41cf-8e20-9ce4ec1fcf3a service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Received unexpected event network-vif-plugged-af98fbff-3a16-4423-9c11-733538ad4326 for instance with vm_state active and task_state deleting.
Nov 29 01:46:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:46:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:46:59 user nova-compute[75210]: DEBUG nova.compute.manager [req-7a6fa7fe-0dcb-41fb-8f71-bfaa8002a8fd req-e03394ce-04dc-4c95-a801-16f8ce0dfb85 service nova] [instance: aaf1b90e-3ea7-4d65-8298-de2ca684573e] Received event network-vif-deleted-af98fbff-3a16-4423-9c11-733538ad4326 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:46:59 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Successfully updated port: 1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "refresh_cache-c754f3a2-db8d-4619-aa14-462c6b7fc94c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquired lock "refresh_cache-c754f3a2-db8d-4619-aa14-462c6b7fc94c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:00 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Deleted allocations for instance aaf1b90e-3ea7-4d65-8298-de2ca684573e
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Updating instance_info_cache with network_info: [{"id": "1117eeaf-d531-47b1-848a-26b672999bd4", "address": "fa:16:3e:c9:cc:87", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1117eeaf-d5", "ovs_interfaceid": "1117eeaf-d531-47b1-848a-26b672999bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-91a0e51a-b754-4693-bfcd-14abe1427eed tempest-VolumesActionsTest-1214713951 tempest-VolumesActionsTest-1214713951-project-member] Lock "aaf1b90e-3ea7-4d65-8298-de2ca684573e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.124s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Releasing lock "refresh_cache-c754f3a2-db8d-4619-aa14-462c6b7fc94c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Instance network_info: |[{"id": "1117eeaf-d531-47b1-848a-26b672999bd4", "address": "fa:16:3e:c9:cc:87", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1117eeaf-d5", "ovs_interfaceid": "1117eeaf-d531-47b1-848a-26b672999bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Start _get_guest_xml network_info=[{"id": "1117eeaf-d531-47b1-848a-26b672999bd4", "address": "fa:16:3e:c9:cc:87", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1117eeaf-d5", "ovs_interfaceid": "1117eeaf-d531-47b1-848a-26b672999bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:47:00 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:47:00 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:46:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-101343481',display_name='tempest-AttachVolumeNegativeTest-server-101343481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-101343481',id=29,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSd4g+Jxpb5yNT3Eye7G0+L1scoDjeZdB3cNXc+m/jk9m0gPJNNI5oAp+pIZst1K3MUPMux4uwI4b4xNMW3yCLnyn0qUtkM7chsYX5AiRpXEk4eUCCqcBgtH4+GQalzjw==',key_name='tempest-keypair-856703655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18f1a3d6f5994f6eb15e0ab2294efd53',ramdisk_id='',reservation_id='r-2n0t29r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-648523364',owner_user_name='tempest-AttachVolumeNegativeTest-648523364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd39b87d15084d84983873b59f36a211',uuid=c754f3a2-db8d-4619-aa14-462c6b7fc94c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1117eeaf-d531-47b1-848a-26b672999bd4", "address": "fa:16:3e:c9:cc:87", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1117eeaf-d5", "ovs_interfaceid": "1117eeaf-d531-47b1-848a-26b672999bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converting VIF {"id": "1117eeaf-d531-47b1-848a-26b672999bd4", "address": "fa:16:3e:c9:cc:87", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1117eeaf-d5", "ovs_interfaceid": "1117eeaf-d531-47b1-848a-26b672999bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=1117eeaf-d531-47b1-848a-26b672999bd4,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1117eeaf-d5') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.objects.instance [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'pci_devices' on Instance uuid c754f3a2-db8d-4619-aa14-462c6b7fc94c {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:47:00 user nova-compute[75210]:   <uuid>c754f3a2-db8d-4619-aa14-462c6b7fc94c</uuid>
Nov 29 01:47:00 user nova-compute[75210]:   <name>instance-0000001d</name>
Nov 29 01:47:00 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:47:00 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:47:00 user nova-compute[75210]:   <metadata>
Nov 29 01:47:00 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:47:00 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:47:00 user nova-compute[75210]:       <nova:name>tempest-AttachVolumeNegativeTest-server-101343481</nova:name>
Nov 29 01:47:00 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:47:00</nova:creationTime>
Nov 29 01:47:00 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:47:00 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:47:00 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:47:00 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:47:00 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:47:00 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:47:00 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:47:00 user nova-compute[75210]:       <nova:owner>
Nov 29 01:47:00 user nova-compute[75210]:         <nova:user uuid="bd39b87d15084d84983873b59f36a211">tempest-AttachVolumeNegativeTest-648523364-project-member</nova:user>
Nov 29 01:47:00 user nova-compute[75210]:         <nova:project uuid="18f1a3d6f5994f6eb15e0ab2294efd53">tempest-AttachVolumeNegativeTest-648523364</nova:project>
Nov 29 01:47:00 user nova-compute[75210]:       </nova:owner>
Nov 29 01:47:00 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:47:00 user nova-compute[75210]:       <nova:ports>
Nov 29 01:47:00 user nova-compute[75210]:         <nova:port uuid="1117eeaf-d531-47b1-848a-26b672999bd4">
Nov 29 01:47:00 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 01:47:00 user nova-compute[75210]:         </nova:port>
Nov 29 01:47:00 user nova-compute[75210]:       </nova:ports>
Nov 29 01:47:00 user nova-compute[75210]:     </nova:instance>
Nov 29 01:47:00 user nova-compute[75210]:   </metadata>
Nov 29 01:47:00 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:47:00 user nova-compute[75210]:     <system>
Nov 29 01:47:00 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:47:00 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:47:00 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:47:00 user nova-compute[75210]:       <entry name="serial">c754f3a2-db8d-4619-aa14-462c6b7fc94c</entry>
Nov 29 01:47:00 user nova-compute[75210]:       <entry name="uuid">c754f3a2-db8d-4619-aa14-462c6b7fc94c</entry>
Nov 29 01:47:00 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:47:00 user nova-compute[75210]:     </system>
Nov 29 01:47:00 user nova-compute[75210]:   </sysinfo>
Nov 29 01:47:00 user nova-compute[75210]:   <os>
Nov 29 01:47:00 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:47:00 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:47:00 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:47:00 user nova-compute[75210]:   </os>
Nov 29 01:47:00 user nova-compute[75210]:   <features>
Nov 29 01:47:00 user nova-compute[75210]:     <acpi/>
Nov 29 01:47:00 user nova-compute[75210]:     <apic/>
Nov 29 01:47:00 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:47:00 user nova-compute[75210]:   </features>
Nov 29 01:47:00 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:47:00 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:47:00 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:47:00 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:47:00 user nova-compute[75210]:   </clock>
Nov 29 01:47:00 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:47:00 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:47:00 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:47:00 user nova-compute[75210]:   </cpu>
Nov 29 01:47:00 user nova-compute[75210]:   <devices>
Nov 29 01:47:00 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:47:00 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:47:00 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk"/>
Nov 29 01:47:00 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:47:00 user nova-compute[75210]:     </disk>
Nov 29 01:47:00 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:47:00 user nova-compute[75210]:       <mac address="fa:16:3e:c9:cc:87"/>
Nov 29 01:47:00 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:47:00 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:47:00 user nova-compute[75210]:       <target dev="tap1117eeaf-d5"/>
Nov 29 01:47:00 user nova-compute[75210]:     </interface>
Nov 29 01:47:00 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:47:00 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/console.log" append="off"/>
Nov 29 01:47:00 user nova-compute[75210]:     </serial>
Nov 29 01:47:00 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:47:00 user nova-compute[75210]:     <video>
Nov 29 01:47:00 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:47:00 user nova-compute[75210]:     </video>
Nov 29 01:47:00 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:47:00 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:47:00 user nova-compute[75210]:     </rng>
Nov 29 01:47:00 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:47:00 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:47:00 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:47:00 user nova-compute[75210]:     </memballoon>
Nov 29 01:47:00 user nova-compute[75210]:   </devices>
Nov 29 01:47:00 user nova-compute[75210]: </domain>
Nov 29 01:47:00 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:46:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-101343481',display_name='tempest-AttachVolumeNegativeTest-server-101343481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-101343481',id=29,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSd4g+Jxpb5yNT3Eye7G0+L1scoDjeZdB3cNXc+m/jk9m0gPJNNI5oAp+pIZst1K3MUPMux4uwI4b4xNMW3yCLnyn0qUtkM7chsYX5AiRpXEk4eUCCqcBgtH4+GQalzjw==',key_name='tempest-keypair-856703655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18f1a3d6f5994f6eb15e0ab2294efd53',ramdisk_id='',reservation_id='r-2n0t29r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-648523364',owner_user_name='tempest-AttachVolumeNegativeTest-648523364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:46:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd39b87d15084d84983873b59f36a211',uuid=c754f3a2-db8d-4619-aa14-462c6b7fc94c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1117eeaf-d531-47b1-848a-26b672999bd4", "address": "fa:16:3e:c9:cc:87", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1117eeaf-d5", "ovs_interfaceid": "1117eeaf-d531-47b1-848a-26b672999bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converting VIF {"id": "1117eeaf-d531-47b1-848a-26b672999bd4", "address": "fa:16:3e:c9:cc:87", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1117eeaf-d5", "ovs_interfaceid": "1117eeaf-d531-47b1-848a-26b672999bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=1117eeaf-d531-47b1-848a-26b672999bd4,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1117eeaf-d5') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG os_vif [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=1117eeaf-d531-47b1-848a-26b672999bd4,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1117eeaf-d5') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c64bdd87-3808-5731-9ac6-bb48a6ee37aa', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1117eeaf-d5, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1117eeaf-d5, col_values=(('qos', UUID('301d6b83-2c89-429c-852a-0e99fa0af887')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1117eeaf-d5, col_values=(('external_ids', {'iface-id': '1117eeaf-d531-47b1-848a-26b672999bd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:cc:87', 'vm-uuid': 'c754f3a2-db8d-4619-aa14-462c6b7fc94c'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:00 user nova-compute[75210]: INFO os_vif [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=1117eeaf-d531-47b1-848a-26b672999bd4,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1117eeaf-d5')
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:47:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No VIF found with MAC fa:16:3e:c9:cc:87, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-315acf22-d64d-488c-b85e-b64f55125764 req-50f94db0-8edc-4c61-b5e3-ba5aa4c2a80f service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Received event network-changed-1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-315acf22-d64d-488c-b85e-b64f55125764 req-50f94db0-8edc-4c61-b5e3-ba5aa4c2a80f service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Refreshing instance network info cache due to event network-changed-1117eeaf-d531-47b1-848a-26b672999bd4. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-315acf22-d64d-488c-b85e-b64f55125764 req-50f94db0-8edc-4c61-b5e3-ba5aa4c2a80f service nova] Acquiring lock "refresh_cache-c754f3a2-db8d-4619-aa14-462c6b7fc94c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-315acf22-d64d-488c-b85e-b64f55125764 req-50f94db0-8edc-4c61-b5e3-ba5aa4c2a80f service nova] Acquired lock "refresh_cache-c754f3a2-db8d-4619-aa14-462c6b7fc94c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG nova.network.neutron [req-315acf22-d64d-488c-b85e-b64f55125764 req-50f94db0-8edc-4c61-b5e3-ba5aa4c2a80f service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Refreshing network info cache for port 1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-001d8011-0fdc-4134-afd0-c712e62e4737 req-e2ed43f8-ca2d-4a8d-b5d7-29f107bdbfcf service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-changed-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-001d8011-0fdc-4134-afd0-c712e62e4737 req-e2ed43f8-ca2d-4a8d-b5d7-29f107bdbfcf service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Refreshing instance network info cache due to event network-changed-60309b43-09f2-4bc7-81a2-9c764df78b5d. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-001d8011-0fdc-4134-afd0-c712e62e4737 req-e2ed43f8-ca2d-4a8d-b5d7-29f107bdbfcf service nova] Acquiring lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-001d8011-0fdc-4134-afd0-c712e62e4737 req-e2ed43f8-ca2d-4a8d-b5d7-29f107bdbfcf service nova] Acquired lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG nova.network.neutron [req-001d8011-0fdc-4134-afd0-c712e62e4737 req-e2ed43f8-ca2d-4a8d-b5d7-29f107bdbfcf service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Refreshing network info cache for port 60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG nova.network.neutron [req-315acf22-d64d-488c-b85e-b64f55125764 req-50f94db0-8edc-4c61-b5e3-ba5aa4c2a80f service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Updated VIF entry in instance network info cache for port 1117eeaf-d531-47b1-848a-26b672999bd4. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG nova.network.neutron [req-315acf22-d64d-488c-b85e-b64f55125764 req-50f94db0-8edc-4c61-b5e3-ba5aa4c2a80f service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Updating instance_info_cache with network_info: [{"id": "1117eeaf-d531-47b1-848a-26b672999bd4", "address": "fa:16:3e:c9:cc:87", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1117eeaf-d5", "ovs_interfaceid": "1117eeaf-d531-47b1-848a-26b672999bd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-315acf22-d64d-488c-b85e-b64f55125764 req-50f94db0-8edc-4c61-b5e3-ba5aa4c2a80f service nova] Releasing lock "refresh_cache-c754f3a2-db8d-4619-aa14-462c6b7fc94c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:47:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG nova.network.neutron [req-001d8011-0fdc-4134-afd0-c712e62e4737 req-e2ed43f8-ca2d-4a8d-b5d7-29f107bdbfcf service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updated VIF entry in instance network info cache for port 60309b43-09f2-4bc7-81a2-9c764df78b5d. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG nova.network.neutron [req-001d8011-0fdc-4134-afd0-c712e62e4737 req-e2ed43f8-ca2d-4a8d-b5d7-29f107bdbfcf service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating instance_info_cache with network_info: [{"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-001d8011-0fdc-4134-afd0-c712e62e4737 req-e2ed43f8-ca2d-4a8d-b5d7-29f107bdbfcf service nova] Releasing lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG nova.objects.instance [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'flavor' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:03 user nova-compute[75210]: INFO nova.compute.manager [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Attaching volume 35697ae4-f8b8-4118-929f-e51af79d15f4 to /dev/vdb
Nov 29 01:47:03 user nova-compute[75210]: DEBUG os_brick.utils [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72a2328-0a72-4d78-9b6d-40b826a87486]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2209d30b-fda1-427c-bdec-ec2b6646a88b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bb9eb6-40fc-4315-9c44-1ab26286e2b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1808be72-319a-4a69-b555-940c65c9d555]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:47:03 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:47:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6aa0966-8917-4ca9-8547-f0c893ae6091]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG os_brick.utils [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:47:03 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Updating existing volume attachment record: 48f0899c-a9cb-4681-90c1-4dda92a453bd {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-3e26a8f5-b085-4043-8238-946429538729 req-fbb86437-1556-48ce-8b48-8cc3ac60e969 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Received event network-vif-plugged-1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3e26a8f5-b085-4043-8238-946429538729 req-fbb86437-1556-48ce-8b48-8cc3ac60e969 service nova] Acquiring lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3e26a8f5-b085-4043-8238-946429538729 req-fbb86437-1556-48ce-8b48-8cc3ac60e969 service nova] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3e26a8f5-b085-4043-8238-946429538729 req-fbb86437-1556-48ce-8b48-8cc3ac60e969 service nova] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-3e26a8f5-b085-4043-8238-946429538729 req-fbb86437-1556-48ce-8b48-8cc3ac60e969 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] No waiting events found dispatching network-vif-plugged-1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:47:04 user nova-compute[75210]: WARNING nova.compute.manager [req-3e26a8f5-b085-4043-8238-946429538729 req-fbb86437-1556-48ce-8b48-8cc3ac60e969 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Received unexpected event network-vif-plugged-1117eeaf-d531-47b1-848a-26b672999bd4 for instance with vm_state building and task_state spawning.
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-3e26a8f5-b085-4043-8238-946429538729 req-fbb86437-1556-48ce-8b48-8cc3ac60e969 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Received event network-vif-plugged-1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3e26a8f5-b085-4043-8238-946429538729 req-fbb86437-1556-48ce-8b48-8cc3ac60e969 service nova] Acquiring lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3e26a8f5-b085-4043-8238-946429538729 req-fbb86437-1556-48ce-8b48-8cc3ac60e969 service nova] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3e26a8f5-b085-4043-8238-946429538729 req-fbb86437-1556-48ce-8b48-8cc3ac60e969 service nova] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-3e26a8f5-b085-4043-8238-946429538729 req-fbb86437-1556-48ce-8b48-8cc3ac60e969 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] No waiting events found dispatching network-vif-plugged-1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:47:04 user nova-compute[75210]: WARNING nova.compute.manager [req-3e26a8f5-b085-4043-8238-946429538729 req-fbb86437-1556-48ce-8b48-8cc3ac60e969 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Received unexpected event network-vif-plugged-1117eeaf-d531-47b1-848a-26b672999bd4 for instance with vm_state building and task_state spawning.
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:47:04 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Instance spawned successfully.
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:47:04 user nova-compute[75210]: INFO nova.compute.manager [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Took 7.04 seconds to spawn the instance on the hypervisor.
Nov 29 01:47:04 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:47:04 user nova-compute[75210]: INFO nova.compute.manager [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Took 8.10 seconds to build instance.
Nov 29 01:47:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1ab3c39b-1e00-47f9-b822-d364a80dd840 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.231s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:47:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JQoiCmMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:47:11 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:47:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:47:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:47:11 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:47:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:47:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:47:11 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:47:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1e7a4c-a130-4828-ad8d-e9dff5b8bcc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:47:12 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a0e4b6-20b1-48b6-a161-453e5790e864]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4] added
Nov 29 01:47:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1147cccf-21b2-48ed-96b6-482637005bc8]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbea615-b79b-4d32-86bb-cd33ff3517cd]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JQoiCmMq {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JQoiCmMq" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16893e0-4f17-43d5-847e-630a41e58b6e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JQoiCmMq'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4b45a1-cc10-4ffc-9495-b8fe141dd48b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0c7b7d-c36d-46e2-b183-f03710576cce]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bd9b10-d52c-45a9-afb7-0b044cfd0a80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4, portal: 172.16.0.220,3260]
Nov 29 01:47:12 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4, portal: 172.16.0.220,3260] successful.
Nov 29 01:47:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a0e483-664e-4de2-b4c0-1701a2d934d2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09273fa-f1b9-4a52-bb3a-25367751468b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:12 user nova-compute[75210]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 (non-flash)
Nov 29 01:47:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:12 user nova-compute[75210]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 (non-flash)
Nov 29 01:47:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[37493b23-6f0e-45ca-989e-a373001235a3]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:47:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JQoiCmMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:47:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:47:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26339393035633037', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:47:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339393035633037', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:47:13 user nova-compute[75210]: DEBUG nova.objects.instance [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'flavor' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:47:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:47:13 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:47:13 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:47:13 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:47:13 user nova-compute[75210]:   <serial>35697ae4-f8b8-4118-929f-e51af79d15f4</serial>
Nov 29 01:47:13 user nova-compute[75210]: </disk>
Nov 29 01:47:13 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:47:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:47:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:47:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No VIF found with MAC fa:16:3e:e2:b3:10, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:47:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d75db446-eadd-409e-9ff1-426ce7a598d6 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.227s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:16 user nova-compute[75210]: INFO nova.compute.manager [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Detaching volume 35697ae4-f8b8-4118-929f-e51af79d15f4
Nov 29 01:47:16 user nova-compute[75210]: INFO nova.virt.block_device [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Attempting to driver detach volume 35697ae4-f8b8-4118-929f-e51af79d15f4 from mountpoint /dev/vdb
Nov 29 01:47:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Attempting to detach device vdb from instance e6c9606c-5a27-417d-9042-259ce728e175 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:47:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:47:16 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:47:16 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:47:16 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:47:16 user nova-compute[75210]:   <serial>35697ae4-f8b8-4118-929f-e51af79d15f4</serial>
Nov 29 01:47:16 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:47:16 user nova-compute[75210]: </disk>
Nov 29 01:47:16 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:47:16 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Successfully detached device vdb from instance e6c9606c-5a27-417d-9042-259ce728e175 from the persistent domain config.
Nov 29 01:47:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6c9606c-5a27-417d-9042-259ce728e175 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:47:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:47:16 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:47:16 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:47:16 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:47:16 user nova-compute[75210]:   <serial>35697ae4-f8b8-4118-929f-e51af79d15f4</serial>
Nov 29 01:47:16 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:47:16 user nova-compute[75210]: </disk>
Nov 29 01:47:16 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:47:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:47:18 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:47:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:21 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:47:22 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:47:25 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:47:25 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:47:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:47:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:47:25 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:47:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Updating instance_info_cache with network_info: [{"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:47:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:29 user nova-compute[75210]: INFO nova.compute.manager [None req-e9850206-9089-490a-ae1a-e230791dade1 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Unrescuing
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e9850206-9089-490a-ae1a-e230791dade1 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e9850206-9089-490a-ae1a-e230791dade1 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquired lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e9850206-9089-490a-ae1a-e230791dade1 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG nova.network.neutron [None req-e9850206-9089-490a-ae1a-e230791dade1 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Updating instance_info_cache with network_info: [{"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e9850206-9089-490a-ae1a-e230791dade1 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Releasing lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG nova.objects.instance [None req-e9850206-9089-490a-ae1a-e230791dade1 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'flavor' on Instance uuid 13274e43-2984-4aa6-ad9b-23e3bbe7c959 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG nova.compute.manager [req-144e756b-5fb0-4858-b701-f7f5def5d370 req-c3250541-454e-4db6-be16-0ef59006b518 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-144e756b-5fb0-4858-b701-f7f5def5d370 req-c3250541-454e-4db6-be16-0ef59006b518 service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-144e756b-5fb0-4858-b701-f7f5def5d370 req-c3250541-454e-4db6-be16-0ef59006b518 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-144e756b-5fb0-4858-b701-f7f5def5d370 req-c3250541-454e-4db6-be16-0ef59006b518 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG nova.compute.manager [req-144e756b-5fb0-4858-b701-f7f5def5d370 req-c3250541-454e-4db6-be16-0ef59006b518 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:47:29 user nova-compute[75210]: WARNING nova.compute.manager [req-144e756b-5fb0-4858-b701-f7f5def5d370 req-c3250541-454e-4db6-be16-0ef59006b518 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Instance destroyed successfully.
Nov 29 01:47:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:31 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:47:31 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7688MB free_disk=25.202423095703125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance e6c9606c-5a27-417d-9042-259ce728e175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 4fab87e3-2f7c-4db4-9f14-ace1813fe046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c754f3a2-db8d-4619-aa14-462c6b7fc94c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing inventories for resource provider 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating ProviderTree inventory for provider 28871a06-d5c8-43d0-87af-3689cd143011 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating inventory in ProviderTree for provider 28871a06-d5c8-43d0-87af-3689cd143011 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing aggregate associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, aggregates: None {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing trait associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, traits: HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:47:31 user nova-compute[75210]: WARNING nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:47:31 user nova-compute[75210]: WARNING nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:47:31 user nova-compute[75210]: WARNING nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:47:31 user nova-compute[75210]: WARNING nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:47:31 user nova-compute[75210]: WARNING nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:47:31 user nova-compute[75210]: WARNING nova.compute.manager [req-67b61ae8-e0aa-4dcf-a86d-c3dec8398ed8 req-5fede4d2-bd9c-420f-a302-d144922cd4a4 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:47:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:32 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:47:32 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:47:32 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:47:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.774s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:32 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:47:32 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:47:32 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:47:32 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:47:32 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:47:32 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:47:32 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 01:47:32 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] There are 0 instances to clean {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 01:47:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-09319a7f-d47d-4008-ac40-4b9177857832 req-030c89fb-548d-4612-b8fb-3ffdefb4c943 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-09319a7f-d47d-4008-ac40-4b9177857832 req-030c89fb-548d-4612-b8fb-3ffdefb4c943 service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-09319a7f-d47d-4008-ac40-4b9177857832 req-030c89fb-548d-4612-b8fb-3ffdefb4c943 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-09319a7f-d47d-4008-ac40-4b9177857832 req-030c89fb-548d-4612-b8fb-3ffdefb4c943 service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-09319a7f-d47d-4008-ac40-4b9177857832 req-030c89fb-548d-4612-b8fb-3ffdefb4c943 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:47:34 user nova-compute[75210]: WARNING nova.compute.manager [req-09319a7f-d47d-4008-ac40-4b9177857832 req-030c89fb-548d-4612-b8fb-3ffdefb4c943 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:47:34 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e9850206-9089-490a-ae1a-e230791dade1 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:47:34 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:47:34 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances with incomplete migration  {{(pid=75210) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 01:47:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:36 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e6c9606c-5a27-417d-9042-259ce728e175 is timed out.
Nov 29 01:47:36 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Successfully detached device vdb from instance e6c9606c-5a27-417d-9042-259ce728e175 from the live domain config.
Nov 29 01:47:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JQoiCmMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:47:36 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:47:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[faab745e-e586-46de-959a-b49ef78037da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:47:36 user nova-compute[75210]: No targets found.
Nov 29 01:47:36 user nova-compute[75210]: iSNS:
Nov 29 01:47:36 user nova-compute[75210]: No targets found.
Nov 29 01:47:36 user nova-compute[75210]: STATIC:
Nov 29 01:47:36 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:47:36 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:47:36 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:47:36 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4
Nov 29 01:47:36 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:47:36 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:47:36 user nova-compute[75210]: FIRMWARE:
Nov 29 01:47:36 user nova-compute[75210]: No targets found.
Nov 29 01:47:36 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:47:36 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:47:36 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b111c623-9d01-4ff1-be43-14a4e851b6c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[77096d14-d82e-4549-8b55-8c7a7c3b14e2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:36 user nova-compute[75210]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 (non-flash)
Nov 29 01:47:36 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:36 user nova-compute[75210]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 (non-flash)
Nov 29 01:47:36 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e85272e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b60bbc-1020-4d0f-8052-29690a3d784a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45cdde0-f5bd-4f38-970e-f454ec39f2c9]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c541e87-15ea-44a4-8e17-291a9b8d1a77]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[40eec1f5-f647-446d-b3dc-f732b674f1a2]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb9778d-f554-44c6-8950-449e5bd64cb2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[25dbc9bc-fc08-4008-81ff-692b8cb2d603]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4, portal: 172.16.0.220,3260]
Nov 29 01:47:37 user nova-compute[75210]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4, portal: 172.16.0.220,3260] successful.
Nov 29 01:47:37 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35697ae4-f8b8-4118-929f-e51af79d15f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[070459d6-3c70-4554-8b1a-5d715ec19392]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] <== disconnect_volume: return (286ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:47:37 user nova-compute[75210]: DEBUG nova.objects.instance [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'flavor' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:47:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cd4e88ba-aa01-477d-9a1f-e6d8e219efd8 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.696s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-789d7bd9-492d-4b08-bd09-0a9877d66173 req-71e9635f-c32f-4499-b441-363712d2ac79 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received event network-changed-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-789d7bd9-492d-4b08-bd09-0a9877d66173 req-71e9635f-c32f-4499-b441-363712d2ac79 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Refreshing instance network info cache due to event network-changed-2d168686-6764-45e3-85bd-a8dff60fa4f0. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:47:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-789d7bd9-492d-4b08-bd09-0a9877d66173 req-71e9635f-c32f-4499-b441-363712d2ac79 service nova] Acquiring lock "refresh_cache-3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:47:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-789d7bd9-492d-4b08-bd09-0a9877d66173 req-71e9635f-c32f-4499-b441-363712d2ac79 service nova] Acquired lock "refresh_cache-3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:47:38 user nova-compute[75210]: DEBUG nova.network.neutron [req-789d7bd9-492d-4b08-bd09-0a9877d66173 req-71e9635f-c32f-4499-b441-363712d2ac79 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Refreshing network info cache for port 2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG nova.network.neutron [req-789d7bd9-492d-4b08-bd09-0a9877d66173 req-71e9635f-c32f-4499-b441-363712d2ac79 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Updated VIF entry in instance network info cache for port 2d168686-6764-45e3-85bd-a8dff60fa4f0. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG nova.network.neutron [req-789d7bd9-492d-4b08-bd09-0a9877d66173 req-71e9635f-c32f-4499-b441-363712d2ac79 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Updating instance_info_cache with network_info: [{"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-789d7bd9-492d-4b08-bd09-0a9877d66173 req-71e9635f-c32f-4499-b441-363712d2ac79 service nova] Releasing lock "refresh_cache-3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG nova.objects.instance [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lazy-loading 'flavor' on Instance uuid 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:39 user nova-compute[75210]: INFO nova.compute.manager [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Attaching volume 12057d3a-a4d5-4feb-a093-4dcc0dd5858b to /dev/vdb
Nov 29 01:47:39 user nova-compute[75210]: DEBUG os_brick.utils [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c972662b-544a-4f38-9fe0-4d52237aaaa6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99221cf-b1d8-41b2-b933-a0c5b9de76c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ab257e-3f42-45cd-8024-5be478fd1b00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3042af-075b-4933-be8c-c3843c695aa0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:47:39 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:47:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7847c6a-1564-4275-96cf-05c6ff17c05a]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG os_brick.utils [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:47:39 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Updating existing volume attachment record: b4815da1-76d7-44ba-832e-b322e67c7796 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:47:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AtGLrIbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:47:46 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:47:46 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:47:46 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ba2dac-afc6-47f1-a695-ec0976c28a71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:47:46 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf9afbc-1940-4ec1-abc9-8247d3e13beb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b] added
Nov 29 01:47:46 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af2b7b6-58a9-4714-8e0d-d6ff3a0027b9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda3fe7d-f3f8-4d02-aff6-a5ccec9d6658]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AtGLrIbR {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AtGLrIbR" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[069d05b1-8015-4dbd-9f62-8ba9a03d5ed0]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AtGLrIbR'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[05af1ba8-45a0-470b-bfc9-72220fdbd527]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0b698d-34e5-48f9-a54f-c97498a1a6e6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:46 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:46 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb54d1f-cc80-4a25-b0c8-dca2e6342e83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260]
Nov 29 01:47:46 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260] successful.
Nov 29 01:47:46 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[031b8848-ebb8-4f39-81c5-11d1dcfa9f3d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1d186f-8753-40fd-a81e-c34d5c11b2d5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:46 user nova-compute[75210]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:47:46 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:46 user nova-compute[75210]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:47:46 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[568874bd-bb0b-4e10-ae05-91ee39184f0d]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:46 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:47:47 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:47:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AtGLrIbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:47:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:47:47 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26538373365386466', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:47:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538373365386466', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:47:47 user nova-compute[75210]: DEBUG nova.objects.instance [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lazy-loading 'flavor' on Instance uuid 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:47:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:47:47 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:47:47 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:47:47 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:47:47 user nova-compute[75210]:   <serial>12057d3a-a4d5-4feb-a093-4dcc0dd5858b</serial>
Nov 29 01:47:47 user nova-compute[75210]: </disk>
Nov 29 01:47:47 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:47:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:47:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:47:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No VIF found with MAC fa:16:3e:c6:54:7a, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:47:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8801a2c8-bf8c-4954-9b56-1ae1865113e9 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.892s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:49 user nova-compute[75210]: INFO nova.compute.manager [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Rebuilding instance
Nov 29 01:47:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:47:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-dd0de120-0982-4832-a38c-fa74a67fbf67 req-176e3da0-44da-44a5-84ec-7825d9745dec service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received event network-vif-unplugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dd0de120-0982-4832-a38c-fa74a67fbf67 req-176e3da0-44da-44a5-84ec-7825d9745dec service nova] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dd0de120-0982-4832-a38c-fa74a67fbf67 req-176e3da0-44da-44a5-84ec-7825d9745dec service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dd0de120-0982-4832-a38c-fa74a67fbf67 req-176e3da0-44da-44a5-84ec-7825d9745dec service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-dd0de120-0982-4832-a38c-fa74a67fbf67 req-176e3da0-44da-44a5-84ec-7825d9745dec service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] No waiting events found dispatching network-vif-unplugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:47:50 user nova-compute[75210]: WARNING nova.compute.manager [req-dd0de120-0982-4832-a38c-fa74a67fbf67 req-176e3da0-44da-44a5-84ec-7825d9745dec service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received unexpected event network-vif-unplugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 for instance with vm_state active and task_state rebuilding.
Nov 29 01:47:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Instance destroyed successfully.
Nov 29 01:47:51 user nova-compute[75210]: INFO nova.compute.manager [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Detaching volume 12057d3a-a4d5-4feb-a093-4dcc0dd5858b
Nov 29 01:47:51 user nova-compute[75210]: INFO nova.virt.block_device [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Attempting to driver detach volume 12057d3a-a4d5-4feb-a093-4dcc0dd5858b from mountpoint /dev/vdb
Nov 29 01:47:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Attempting to detach device vdb from instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:47:51 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:47:51 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:47:51 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:47:51 user nova-compute[75210]:   <serial>12057d3a-a4d5-4feb-a093-4dcc0dd5858b</serial>
Nov 29 01:47:51 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:47:51 user nova-compute[75210]: </disk>
Nov 29 01:47:51 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:47:51 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Successfully detached device vdb from instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 from the persistent domain config.
Nov 29 01:47:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AtGLrIbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:47:51 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[52375a3b-bf53-45b4-b58e-b7c66ba1283d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:47:51 user nova-compute[75210]: No targets found.
Nov 29 01:47:51 user nova-compute[75210]: iSNS:
Nov 29 01:47:51 user nova-compute[75210]: No targets found.
Nov 29 01:47:51 user nova-compute[75210]: STATIC:
Nov 29 01:47:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:47:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:47:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:47:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b
Nov 29 01:47:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:47:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:47:51 user nova-compute[75210]: FIRMWARE:
Nov 29 01:47:51 user nova-compute[75210]: No targets found.
Nov 29 01:47:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:47:51 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:47:51 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff5f57b-07ea-4200-b551-8a0f0f9b3827]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba5523e-18cc-462c-a1dc-d3215c3d5e7e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:51 user nova-compute[75210]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:47:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:51 user nova-compute[75210]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:47:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f001f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feca544-0ddd-4da1-8140-d53f6e7b1283]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[698ef0e4-d3fb-4ca6-add7-6ac97a5eb73e]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e14ce5-7516-460a-a18e-34c646760b46]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2dac6e-2663-4390-991b-6a13c380a955]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be967bc-bbd9-476b-a032-b7ae7f17799b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b04bf6-7feb-4665-a727-288bedc24176]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260]
Nov 29 01:47:51 user nova-compute[75210]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260] successful.
Nov 29 01:47:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdc649f-1da4-4d63-a1b0-60ecf559215c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] <== disconnect_volume: return (312ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:47:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:47:52 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Instance destroyed successfully.
Nov 29 01:47:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1671026619',display_name='tempest-ServerActionsTestOtherA-server-523310911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1671026619',id=28,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrAlkYCYFiG8HsPQ0MfXXz1CYvZvlSHO1nMa3YfzgL7Z5ZuVG5QkHtT6bn5NIQcIY/LXA39c0x9WLdrksniaIEuzEu31JLX8B5Z0tDXbGHkL+U+PKd9kCVGtrOpM+5bKg==',key_name='tempest-keypair-982499079',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:45:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-86osubk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:47:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_vif [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d168686-67, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fa13354-bf33-4350-be19-c98fff2a7d28) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:47:52 user nova-compute[75210]: INFO os_vif [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67')
Nov 29 01:47:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AtGLrIbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:47:52 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[785af096-9abd-410d-94f5-0ef5610350c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:47:52 user nova-compute[75210]: No targets found.
Nov 29 01:47:52 user nova-compute[75210]: iSNS:
Nov 29 01:47:52 user nova-compute[75210]: No targets found.
Nov 29 01:47:52 user nova-compute[75210]: STATIC:
Nov 29 01:47:52 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:47:52 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:47:52 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:47:52 user nova-compute[75210]: FIRMWARE:
Nov 29 01:47:52 user nova-compute[75210]: No targets found.
Nov 29 01:47:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:47:52 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:47:52 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d9b33e-dfaf-4b54-a213-632252e70c95]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96345d3-5de6-4756-bf38-726ad1cfc99d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:47:52 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24082d7640>, {}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Disconnecting from: [] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.061s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] <== disconnect_volume: return (62ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:47:52 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Deleting instance files /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03_del
Nov 29 01:47:52 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Deletion of /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03_del complete
Nov 29 01:47:52 user nova-compute[75210]: INFO nova.virt.block_device [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Booting with volume 12057d3a-a4d5-4feb-a093-4dcc0dd5858b at /dev/vdb
Nov 29 01:47:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-f3ee245a-5228-43ad-938d-cfb94d5fde4e req-1a7ba4ef-da7d-4855-8d10-e2286467edb5 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received event network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f3ee245a-5228-43ad-938d-cfb94d5fde4e req-1a7ba4ef-da7d-4855-8d10-e2286467edb5 service nova] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f3ee245a-5228-43ad-938d-cfb94d5fde4e req-1a7ba4ef-da7d-4855-8d10-e2286467edb5 service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f3ee245a-5228-43ad-938d-cfb94d5fde4e req-1a7ba4ef-da7d-4855-8d10-e2286467edb5 service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-f3ee245a-5228-43ad-938d-cfb94d5fde4e req-1a7ba4ef-da7d-4855-8d10-e2286467edb5 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] No waiting events found dispatching network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:47:52 user nova-compute[75210]: WARNING nova.compute.manager [req-f3ee245a-5228-43ad-938d-cfb94d5fde4e req-1a7ba4ef-da7d-4855-8d10-e2286467edb5 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received unexpected event network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 for instance with vm_state active and task_state rebuild_block_device_mapping.
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.utils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b1f65f-6871-471f-8bda-8b2fd94a4dee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3e0ffa-092a-4add-8c84-f38cedf069b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b68a6c7-fc2c-4188-86db-4132e58de932]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58184a8-5761-42d5-9056-bd179ec76353]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:47:52 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:47:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b47b28-a62a-4c29-8655-22cf130a7ba9]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG os_brick.utils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:47:52 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Updating existing volume attachment record: 4adb96a3-e873-4241-873d-9070bd972f32 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:47:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:47:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:47:59 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Creating image(s)
Nov 29 01:47:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "/opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:47:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "/opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:47:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "/opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.190s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk 1073741824" returned: 0 in 0.059s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.192s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Cannot resize image /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Ensure instance console log exists: /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Start _get_guest_xml network_info=[{"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '4adb96a3-e873-4241-873d-9070bd972f32', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AtGLrIbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03', 'attached_at': '', 'detached_at': '', 'volume_id': '12057d3a-a4d5-4feb-a093-4dcc0dd5858b', 'serial': '12057d3a-a4d5-4feb-a093-4dcc0dd5858b'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:48:00 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 01:48:00 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.objects.instance [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:48:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AtGLrIbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:48:01 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:48:01 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:48:01 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[48608094-9981-488e-a89c-3465df71d6c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:48:01 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2448693b-51e4-4acc-9d85-a5cb4c42aa42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b] added
Nov 29 01:48:01 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d03198e-9957-48f9-b554-284033f9aab1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2a7b7e-93fb-4b8b-a319-6aa4bc707d48]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AtGLrIbR {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AtGLrIbR" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[febaa204-f6fa-48c5-a096-d1d903487fd7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AtGLrIbR'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b64970-9a5d-4580-aa55-a819950da3fe]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba8c5e3-7a82-48cc-8119-8535a538f4ef]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3222c2-ae63-49eb-950a-dd5b049c9037 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:01 user nova-compute[75210]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3222c2-ae63-49eb-950a-dd5b049c9037 (non-flash)
Nov 29 01:48:01 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:01 user nova-compute[75210]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3222c2-ae63-49eb-950a-dd5b049c9037 (non-flash)
Nov 29 01:48:01 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e8c481-e831-4479-9f01-c15071c33f09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260]
Nov 29 01:48:01 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260] successful.
Nov 29 01:48:01 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b551d6-3c7d-4134-b830-cdea411f6736]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b160fbb2-1db1-4954-b230-e0e46e4c5dd4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3222c2-ae63-49eb-950a-dd5b049c9037 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:01 user nova-compute[75210]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3222c2-ae63-49eb-950a-dd5b049c9037 (non-flash)
Nov 29 01:48:01 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:01 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:01 user nova-compute[75210]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3222c2-ae63-49eb-950a-dd5b049c9037 (non-flash)
Nov 29 01:48:01 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:01 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1449430b-fe1f-4c65-bb9c-08f740fd095c]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:48:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AtGLrIbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26538373365386466', 'path': '/dev/sdd'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538373365386466', 'path': '/dev/sdd'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T01:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1671026619',display_name='tempest-ServerActionsTestOtherA-server-523310911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1671026619',id=28,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrAlkYCYFiG8HsPQ0MfXXz1CYvZvlSHO1nMa3YfzgL7Z5ZuVG5QkHtT6bn5NIQcIY/LXA39c0x9WLdrksniaIEuzEu31JLX8B5Z0tDXbGHkL+U+PKd9kCVGtrOpM+5bKg==',key_name='tempest-keypair-982499079',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:45:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-86osubk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:47:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:48:02 user nova-compute[75210]:   <uuid>3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03</uuid>
Nov 29 01:48:02 user nova-compute[75210]:   <name>instance-0000001c</name>
Nov 29 01:48:02 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:48:02 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:48:02 user nova-compute[75210]:   <metadata>
Nov 29 01:48:02 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:48:02 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:48:02 user nova-compute[75210]:       <nova:name>tempest-ServerActionsTestOtherA-server-523310911</nova:name>
Nov 29 01:48:02 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:48:00</nova:creationTime>
Nov 29 01:48:02 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:48:02 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:48:02 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:48:02 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:48:02 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:48:02 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:48:02 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:48:02 user nova-compute[75210]:       <nova:owner>
Nov 29 01:48:02 user nova-compute[75210]:         <nova:user uuid="2d98e0c98f554dd5b8a84f9b3933cf1a">tempest-ServerActionsTestOtherA-1921082789-project-member</nova:user>
Nov 29 01:48:02 user nova-compute[75210]:         <nova:project uuid="30940563d2c94d87b2e350faf4d0c5b0">tempest-ServerActionsTestOtherA-1921082789</nova:project>
Nov 29 01:48:02 user nova-compute[75210]:       </nova:owner>
Nov 29 01:48:02 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:48:02 user nova-compute[75210]:       <nova:ports>
Nov 29 01:48:02 user nova-compute[75210]:         <nova:port uuid="2d168686-6764-45e3-85bd-a8dff60fa4f0">
Nov 29 01:48:02 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 01:48:02 user nova-compute[75210]:         </nova:port>
Nov 29 01:48:02 user nova-compute[75210]:       </nova:ports>
Nov 29 01:48:02 user nova-compute[75210]:     </nova:instance>
Nov 29 01:48:02 user nova-compute[75210]:   </metadata>
Nov 29 01:48:02 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:48:02 user nova-compute[75210]:     <system>
Nov 29 01:48:02 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:48:02 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:48:02 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:48:02 user nova-compute[75210]:       <entry name="serial">3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03</entry>
Nov 29 01:48:02 user nova-compute[75210]:       <entry name="uuid">3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03</entry>
Nov 29 01:48:02 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:48:02 user nova-compute[75210]:     </system>
Nov 29 01:48:02 user nova-compute[75210]:   </sysinfo>
Nov 29 01:48:02 user nova-compute[75210]:   <os>
Nov 29 01:48:02 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:48:02 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:48:02 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:48:02 user nova-compute[75210]:   </os>
Nov 29 01:48:02 user nova-compute[75210]:   <features>
Nov 29 01:48:02 user nova-compute[75210]:     <acpi/>
Nov 29 01:48:02 user nova-compute[75210]:     <apic/>
Nov 29 01:48:02 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:48:02 user nova-compute[75210]:   </features>
Nov 29 01:48:02 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:48:02 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:48:02 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:48:02 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:48:02 user nova-compute[75210]:   </clock>
Nov 29 01:48:02 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:48:02 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:48:02 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:48:02 user nova-compute[75210]:   </cpu>
Nov 29 01:48:02 user nova-compute[75210]:   <devices>
Nov 29 01:48:02 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:48:02 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:48:02 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk"/>
Nov 29 01:48:02 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:48:02 user nova-compute[75210]:     </disk>
Nov 29 01:48:02 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:48:02 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:48:02 user nova-compute[75210]:       <source dev="/dev/sdd"/>
Nov 29 01:48:02 user nova-compute[75210]:       <target dev="vdb" bus="virtio"/>
Nov 29 01:48:02 user nova-compute[75210]:       <serial>12057d3a-a4d5-4feb-a093-4dcc0dd5858b</serial>
Nov 29 01:48:02 user nova-compute[75210]:     </disk>
Nov 29 01:48:02 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:48:02 user nova-compute[75210]:       <mac address="fa:16:3e:c6:54:7a"/>
Nov 29 01:48:02 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:48:02 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:48:02 user nova-compute[75210]:       <target dev="tap2d168686-67"/>
Nov 29 01:48:02 user nova-compute[75210]:     </interface>
Nov 29 01:48:02 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:48:02 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/console.log" append="off"/>
Nov 29 01:48:02 user nova-compute[75210]:     </serial>
Nov 29 01:48:02 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:48:02 user nova-compute[75210]:     <video>
Nov 29 01:48:02 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:48:02 user nova-compute[75210]:     </video>
Nov 29 01:48:02 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:48:02 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:48:02 user nova-compute[75210]:     </rng>
Nov 29 01:48:02 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:48:02 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:48:02 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:48:02 user nova-compute[75210]:     </memballoon>
Nov 29 01:48:02 user nova-compute[75210]:   </devices>
Nov 29 01:48:02 user nova-compute[75210]: </domain>
Nov 29 01:48:02 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T01:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1671026619',display_name='tempest-ServerActionsTestOtherA-server-523310911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1671026619',id=28,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrAlkYCYFiG8HsPQ0MfXXz1CYvZvlSHO1nMa3YfzgL7Z5ZuVG5QkHtT6bn5NIQcIY/LXA39c0x9WLdrksniaIEuzEu31JLX8B5Z0tDXbGHkL+U+PKd9kCVGtrOpM+5bKg==',key_name='tempest-keypair-982499079',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:45:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-86osubk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:47:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG os_vif [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8c12032-f441-5de6-bae1-3479fa09d558', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d168686-67, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d168686-67, col_values=(('qos', UUID('c9ee633a-0a17-499b-b50a-c3b8057f90ed')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d168686-67, col_values=(('external_ids', {'iface-id': '2d168686-6764-45e3-85bd-a8dff60fa4f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:54:7a', 'vm-uuid': '3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:02 user nova-compute[75210]: INFO os_vif [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67')
Nov 29 01:48:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:48:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No VIF found with MAC fa:16:3e:c6:54:7a, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:48:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-0662c76b-54d4-41fa-8120-8d7b7285ed00 req-2c56e249-af3f-4623-a521-49341c46f659 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received event network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:48:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0662c76b-54d4-41fa-8120-8d7b7285ed00 req-2c56e249-af3f-4623-a521-49341c46f659 service nova] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0662c76b-54d4-41fa-8120-8d7b7285ed00 req-2c56e249-af3f-4623-a521-49341c46f659 service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0662c76b-54d4-41fa-8120-8d7b7285ed00 req-2c56e249-af3f-4623-a521-49341c46f659 service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-0662c76b-54d4-41fa-8120-8d7b7285ed00 req-2c56e249-af3f-4623-a521-49341c46f659 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] No waiting events found dispatching network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:48:04 user nova-compute[75210]: WARNING nova.compute.manager [req-0662c76b-54d4-41fa-8120-8d7b7285ed00 req-2c56e249-af3f-4623-a521-49341c46f659 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received unexpected event network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 01:48:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-7138ac59-35da-4277-a4fb-2b2e28563c4e req-5b42bbf7-d68f-433b-9434-a24ff08dd767 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received event network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7138ac59-35da-4277-a4fb-2b2e28563c4e req-5b42bbf7-d68f-433b-9434-a24ff08dd767 service nova] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7138ac59-35da-4277-a4fb-2b2e28563c4e req-5b42bbf7-d68f-433b-9434-a24ff08dd767 service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7138ac59-35da-4277-a4fb-2b2e28563c4e req-5b42bbf7-d68f-433b-9434-a24ff08dd767 service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-7138ac59-35da-4277-a4fb-2b2e28563c4e req-5b42bbf7-d68f-433b-9434-a24ff08dd767 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] No waiting events found dispatching network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:48:06 user nova-compute[75210]: WARNING nova.compute.manager [req-7138ac59-35da-4277-a4fb-2b2e28563c4e req-5b42bbf7-d68f-433b-9434-a24ff08dd767 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received unexpected event network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 for instance with vm_state active and task_state rebuild_spawning.
Nov 29 01:48:06 user nova-compute[75210]: DEBUG nova.compute.manager [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:48:06 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Instance spawned successfully.
Nov 29 01:48:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG nova.compute.manager [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG nova.objects.instance [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75210) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 29 01:48:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7dcea6c4-8709-4398-a6d2-7049bc7c5e97 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.091s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:10 user nova-compute[75210]: DEBUG nova.objects.instance [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'flavor' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:48:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.189s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:11 user nova-compute[75210]: INFO nova.compute.manager [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Attaching volume c6cb4c56-89a5-479b-bcfc-8b1d5f79106b to /dev/vdb
Nov 29 01:48:11 user nova-compute[75210]: DEBUG os_brick.utils [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bad70a-ee7e-454f-abbc-a1abb31860fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4a9daa-e894-43c6-9607-6f955dee9810]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3155ad8-c6f4-4763-a01b-a6058193ac7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1a489a-b486-4631-be26-137b9e25cb7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:48:11 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:48:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a7c7d9-12e4-41b7-a4ae-61a1f96c403b]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG os_brick.utils [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:48:11 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Updating existing volume attachment record: aaa9e019-5ffa-496f-9ff3-0101da18a2d2 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:48:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQoUdiMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:48:19 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:48:19 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:48:19 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[15979e3a-c4c6-47be-a368-56eaee772cc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:48:19 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd210286-66d1-46d2-93b5-43028963ab2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b] added
Nov 29 01:48:19 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80ebee8-72cb-4089-a193-5c6cb5f13f6b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf45cbc-8dbf-4b80-a7a2-b2e4b42d41f2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQoUdiMZ {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQoUdiMZ" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ca2945-9157-4b7e-9f5c-5e4e4b0ee29d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fQoUdiMZ'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4872fe-18de-498d-981d-daee9a46eb1d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[30100ebb-1773-446d-a5b2-016c314db735]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:19 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:19 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:19 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:19 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b01ca06-d821-4f6f-ad63-b659826e33a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b, portal: 172.16.0.220,3260]
Nov 29 01:48:19 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b, portal: 172.16.0.220,3260] successful.
Nov 29 01:48:19 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec5acb2-5304-4d75-af73-23458790fb43]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[769906ea-7f41-43eb-ac58-2c3305d6c39c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:19 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:19 user nova-compute[75210]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b (non-flash)
Nov 29 01:48:19 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:19 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:19 user nova-compute[75210]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b (non-flash)
Nov 29 01:48:19 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c5fbe0-be30-4ed1-b453-bd3df051a703]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:48:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQoUdiMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:48:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:48:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23539613432623764', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:48:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539613432623764', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:48:20 user nova-compute[75210]: DEBUG nova.objects.instance [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'flavor' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:48:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:48:20 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:48:20 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:48:20 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:48:20 user nova-compute[75210]:   <serial>c6cb4c56-89a5-479b-bcfc-8b1d5f79106b</serial>
Nov 29 01:48:20 user nova-compute[75210]: </disk>
Nov 29 01:48:20 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:48:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:48:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:48:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No VIF found with MAC fa:16:3e:e2:b3:10, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:48:21 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:48:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-94eddc8a-c96b-4bb3-a436-a8ed78d37f30 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.332s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:23 user nova-compute[75210]: INFO nova.compute.manager [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Detaching volume c6cb4c56-89a5-479b-bcfc-8b1d5f79106b
Nov 29 01:48:23 user nova-compute[75210]: INFO nova.virt.block_device [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Attempting to driver detach volume c6cb4c56-89a5-479b-bcfc-8b1d5f79106b from mountpoint /dev/vdb
Nov 29 01:48:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Attempting to detach device vdb from instance e6c9606c-5a27-417d-9042-259ce728e175 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:48:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:48:23 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:48:23 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:48:23 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:48:23 user nova-compute[75210]:   <serial>c6cb4c56-89a5-479b-bcfc-8b1d5f79106b</serial>
Nov 29 01:48:23 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:48:23 user nova-compute[75210]: </disk>
Nov 29 01:48:23 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:48:23 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Successfully detached device vdb from instance e6c9606c-5a27-417d-9042-259ce728e175 from the persistent domain config.
Nov 29 01:48:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6c9606c-5a27-417d-9042-259ce728e175 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:48:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:48:23 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:48:23 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:48:23 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:48:23 user nova-compute[75210]:   <serial>c6cb4c56-89a5-479b-bcfc-8b1d5f79106b</serial>
Nov 29 01:48:23 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:48:23 user nova-compute[75210]: </disk>
Nov 29 01:48:23 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:48:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:48:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:48:25 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:48:25 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:48:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:25 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:48:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:25 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:48:25 user nova-compute[75210]: INFO nova.compute.claims [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Claim successful on node user
Nov 29 01:48:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG nova.network.neutron [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 01:48:26 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:48:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Skipping network cache update for instance because it is Building. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:26 user nova-compute[75210]: INFO nova.virt.block_device [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Booting with volume c462ff66-874b-4d31-bf54-0a25b733af23 at /dev/vda
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid 996b4364-9920-4b91-8a06-0b6f2c138aab {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG nova.policy [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd46d52d26394d0190fb0060bc2311f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bf4d56ff4eb43269de28f4acb4578b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG os_brick.utils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[79864d9f-d42a-447e-a9ac-faf5b2068985]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafdb48c-7101-4685-a81f-9919bd6ca305]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[844d7f76-7afd-4243-9596-0aab608bf91f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4320e56b-b389-4401-ab6b-fa5cc99daae6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:48:26 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:48:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c473dc7-89d3-448e-98ec-efcab132d1e5]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG os_brick.utils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:48:26 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updating existing volume attachment record: 21804454-15f8-4f63-acd3-5ed15d7da74b {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:48:27 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Updating instance_info_cache with network_info: [{"id": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "address": "fa:16:3e:e0:7c:09", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dba9f4e-29", "ovs_interfaceid": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:48:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:48:27 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:48:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:27 user nova-compute[75210]: DEBUG nova.network.neutron [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Successfully created port: 87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG nova.network.neutron [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Successfully updated port: 87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquired lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG nova.network.neutron [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-883d1f14-9435-495a-a56c-1421b65f8144 req-9cb4f282-c70d-4bff-96da-f5950f123f46 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-changed-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-883d1f14-9435-495a-a56c-1421b65f8144 req-9cb4f282-c70d-4bff-96da-f5950f123f46 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Refreshing instance network info cache due to event network-changed-87448b14-8dd8-439b-ae2f-7c2e5a0cf813. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-883d1f14-9435-495a-a56c-1421b65f8144 req-9cb4f282-c70d-4bff-96da-f5950f123f46 service nova] Acquiring lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG nova.network.neutron [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG nova.network.neutron [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updating instance_info_cache with network_info: [{"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Releasing lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Instance network_info: |[{"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-883d1f14-9435-495a-a56c-1421b65f8144 req-9cb4f282-c70d-4bff-96da-f5950f123f46 service nova] Acquired lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG nova.network.neutron [req-883d1f14-9435-495a-a56c-1421b65f8144 req-9cb4f282-c70d-4bff-96da-f5950f123f46 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Refreshing network info cache for port 87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:29 user nova-compute[75210]: DEBUG nova.network.neutron [req-883d1f14-9435-495a-a56c-1421b65f8144 req-9cb4f282-c70d-4bff-96da-f5950f123f46 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updated VIF entry in instance network info cache for port 87448b14-8dd8-439b-ae2f-7c2e5a0cf813. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:48:29 user nova-compute[75210]: DEBUG nova.network.neutron [req-883d1f14-9435-495a-a56c-1421b65f8144 req-9cb4f282-c70d-4bff-96da-f5950f123f46 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updating instance_info_cache with network_info: [{"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:48:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-883d1f14-9435-495a-a56c-1421b65f8144 req-9cb4f282-c70d-4bff-96da-f5950f123f46 service nova] Releasing lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:48:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:48:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:48:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:33 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:48:33 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7840MB free_disk=25.189708709716797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance e6c9606c-5a27-417d-9042-259ce728e175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 4fab87e3-2f7c-4db4-9f14-ace1813fe046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c754f3a2-db8d-4619-aa14-462c6b7fc94c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 0a239b54-6717-4f3c-b455-3326a8f0bdc2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:48:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:48:35 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Creating image(s)
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Ensure instance console log exists: /opt/stack/data/nova/instances/0a239b54-6717-4f3c-b455-3326a8f0bdc2/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Start _get_guest_xml network_info=[{"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': '21804454-15f8-4f63-acd3-5ed15d7da74b', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTOXPUgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a239b54-6717-4f3c-b455-3326a8f0bdc2', 'attached_at': '', 'detached_at': '', 'volume_id': 'c462ff66-874b-4d31-bf54-0a25b733af23', 'serial': 'c462ff66-874b-4d31-bf54-0a25b733af23'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:48:35 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:48:35 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTOXPUgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:48:35 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:48:35 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:48:35 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1afdc2f-d163-4acd-928d-59ecf757bd44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:48:35 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72507a6-2325-4ac4-b66f-d34686f90ca3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23] added
Nov 29 01:48:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f6f71b-a2c5-4e2c-bb96-71e3bbad6533]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8086bc9-40d5-4aae-82a8-c2de85099d82]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FTOXPUgS {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FTOXPUgS" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9713e43-92c9-410d-b306-956717b64b38]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FTOXPUgS'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca54f4d8-5ecd-43ac-a1e3-507c646a1454]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5637e4a0-f7bc-4007-921b-fa2134eb312b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:35 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:35 user nova-compute[75210]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b (non-flash)
Nov 29 01:48:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:35 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:35 user nova-compute[75210]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b (non-flash)
Nov 29 01:48:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0af06f-2460-489f-9fa4-bd12901797c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260]
Nov 29 01:48:35 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260] successful.
Nov 29 01:48:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d607208a-85f5-4fe5-9c92-8257575c1769]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec386da9-ecd1-4dc1-a1d2-c8ccb2158b6b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:35 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:35 user nova-compute[75210]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b (non-flash)
Nov 29 01:48:35 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:48:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:35 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:35 user nova-compute[75210]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b (non-flash)
Nov 29 01:48:35 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:48:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fc5fa3-1e58-473f-b959-8e9200358f43]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTOXPUgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:48:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23435333362303232', 'path': '/dev/sde'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435333362303232', 'path': '/dev/sde'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-243949346',display_name='tempest-TestShelveInstance-server-243949346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-243949346',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4LjG3IxpsBiQB9Qf7TjHQ7xubkfSfT2Y2dVPvS9ktTV/GSTtT/jspevE88d67HvvQ4SnunUkS0tgiRglqXBUBVtnsF9YzJyyu8vYLLd8WblCCvlG4YEXAmyTXpLTjMhQ==',key_name='tempest-TestShelveInstance-1194317885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bf4d56ff4eb43269de28f4acb4578b5',ramdisk_id='',reservation_id='r-713d5ykr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1973174297',owner_user_name='tempest-TestShelveInstance-1973174297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:48:27Z,user_data=None,user_id='cd46d52d26394d0190fb0060bc2311f1',uuid=0a239b54-6717-4f3c-b455-3326a8f0bdc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Converting VIF {"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG nova.objects.instance [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a239b54-6717-4f3c-b455-3326a8f0bdc2 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:48:36 user nova-compute[75210]:   <uuid>0a239b54-6717-4f3c-b455-3326a8f0bdc2</uuid>
Nov 29 01:48:36 user nova-compute[75210]:   <name>instance-0000001e</name>
Nov 29 01:48:36 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:48:36 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:48:36 user nova-compute[75210]:   <metadata>
Nov 29 01:48:36 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:48:36 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:48:36 user nova-compute[75210]:       <nova:name>tempest-TestShelveInstance-server-243949346</nova:name>
Nov 29 01:48:36 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:48:35</nova:creationTime>
Nov 29 01:48:36 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:48:36 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:48:36 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:48:36 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:48:36 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:48:36 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:48:36 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:48:36 user nova-compute[75210]:       <nova:owner>
Nov 29 01:48:36 user nova-compute[75210]:         <nova:user uuid="cd46d52d26394d0190fb0060bc2311f1">tempest-TestShelveInstance-1973174297-project-member</nova:user>
Nov 29 01:48:36 user nova-compute[75210]:         <nova:project uuid="3bf4d56ff4eb43269de28f4acb4578b5">tempest-TestShelveInstance-1973174297</nova:project>
Nov 29 01:48:36 user nova-compute[75210]:       </nova:owner>
Nov 29 01:48:36 user nova-compute[75210]:       <nova:ports>
Nov 29 01:48:36 user nova-compute[75210]:         <nova:port uuid="87448b14-8dd8-439b-ae2f-7c2e5a0cf813">
Nov 29 01:48:36 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 01:48:36 user nova-compute[75210]:         </nova:port>
Nov 29 01:48:36 user nova-compute[75210]:       </nova:ports>
Nov 29 01:48:36 user nova-compute[75210]:     </nova:instance>
Nov 29 01:48:36 user nova-compute[75210]:   </metadata>
Nov 29 01:48:36 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:48:36 user nova-compute[75210]:     <system>
Nov 29 01:48:36 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:48:36 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:48:36 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:48:36 user nova-compute[75210]:       <entry name="serial">0a239b54-6717-4f3c-b455-3326a8f0bdc2</entry>
Nov 29 01:48:36 user nova-compute[75210]:       <entry name="uuid">0a239b54-6717-4f3c-b455-3326a8f0bdc2</entry>
Nov 29 01:48:36 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:48:36 user nova-compute[75210]:     </system>
Nov 29 01:48:36 user nova-compute[75210]:   </sysinfo>
Nov 29 01:48:36 user nova-compute[75210]:   <os>
Nov 29 01:48:36 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:48:36 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:48:36 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:48:36 user nova-compute[75210]:   </os>
Nov 29 01:48:36 user nova-compute[75210]:   <features>
Nov 29 01:48:36 user nova-compute[75210]:     <acpi/>
Nov 29 01:48:36 user nova-compute[75210]:     <apic/>
Nov 29 01:48:36 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:48:36 user nova-compute[75210]:   </features>
Nov 29 01:48:36 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:48:36 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:48:36 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:48:36 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:48:36 user nova-compute[75210]:   </clock>
Nov 29 01:48:36 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:48:36 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:48:36 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:48:36 user nova-compute[75210]:   </cpu>
Nov 29 01:48:36 user nova-compute[75210]:   <devices>
Nov 29 01:48:36 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:48:36 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:48:36 user nova-compute[75210]:       <source dev="/dev/sde"/>
Nov 29 01:48:36 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:48:36 user nova-compute[75210]:       <serial>c462ff66-874b-4d31-bf54-0a25b733af23</serial>
Nov 29 01:48:36 user nova-compute[75210]:     </disk>
Nov 29 01:48:36 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:48:36 user nova-compute[75210]:       <mac address="fa:16:3e:89:56:4f"/>
Nov 29 01:48:36 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:48:36 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:48:36 user nova-compute[75210]:       <target dev="tap87448b14-8d"/>
Nov 29 01:48:36 user nova-compute[75210]:     </interface>
Nov 29 01:48:36 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:48:36 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/0a239b54-6717-4f3c-b455-3326a8f0bdc2/console.log" append="off"/>
Nov 29 01:48:36 user nova-compute[75210]:     </serial>
Nov 29 01:48:36 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:48:36 user nova-compute[75210]:     <video>
Nov 29 01:48:36 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:48:36 user nova-compute[75210]:     </video>
Nov 29 01:48:36 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:48:36 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:48:36 user nova-compute[75210]:     </rng>
Nov 29 01:48:36 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:48:36 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:48:36 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:48:36 user nova-compute[75210]:     </memballoon>
Nov 29 01:48:36 user nova-compute[75210]:   </devices>
Nov 29 01:48:36 user nova-compute[75210]: </domain>
Nov 29 01:48:36 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-243949346',display_name='tempest-TestShelveInstance-server-243949346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-243949346',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4LjG3IxpsBiQB9Qf7TjHQ7xubkfSfT2Y2dVPvS9ktTV/GSTtT/jspevE88d67HvvQ4SnunUkS0tgiRglqXBUBVtnsF9YzJyyu8vYLLd8WblCCvlG4YEXAmyTXpLTjMhQ==',key_name='tempest-TestShelveInstance-1194317885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3bf4d56ff4eb43269de28f4acb4578b5',ramdisk_id='',reservation_id='r-713d5ykr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1973174297',owner_user_name='tempest-TestShelveInstance-1973174297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:48:27Z,user_data=None,user_id='cd46d52d26394d0190fb0060bc2311f1',uuid=0a239b54-6717-4f3c-b455-3326a8f0bdc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Converting VIF {"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG os_vif [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbfe60d6-e96e-5fa9-8a07-400a5fc77e2d', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87448b14-8d, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87448b14-8d, col_values=(('qos', UUID('346d36b7-f931-47a1-86f2-7101b5525a46')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87448b14-8d, col_values=(('external_ids', {'iface-id': '87448b14-8dd8-439b-ae2f-7c2e5a0cf813', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:56:4f', 'vm-uuid': '0a239b54-6717-4f3c-b455-3326a8f0bdc2'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:36 user nova-compute[75210]: INFO os_vif [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d')
Nov 29 01:48:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:48:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] No VIF found with MAC fa:16:3e:89:56:4f, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:48:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:39 user nova-compute[75210]: INFO nova.compute.manager [None req-7539562c-6d91-4864-b7cc-de152a6a3cb0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Unrescuing
Nov 29 01:48:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7539562c-6d91-4864-b7cc-de152a6a3cb0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:48:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7539562c-6d91-4864-b7cc-de152a6a3cb0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquired lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:48:39 user nova-compute[75210]: DEBUG nova.network.neutron [None req-7539562c-6d91-4864-b7cc-de152a6a3cb0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-b6cb93e3-bb0d-43d7-a93a-848f31c4e62c req-eef959ec-04f4-4e39-9861-134a5e772cdd service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b6cb93e3-bb0d-43d7-a93a-848f31c4e62c req-eef959ec-04f4-4e39-9861-134a5e772cdd service nova] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b6cb93e3-bb0d-43d7-a93a-848f31c4e62c req-eef959ec-04f4-4e39-9861-134a5e772cdd service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b6cb93e3-bb0d-43d7-a93a-848f31c4e62c req-eef959ec-04f4-4e39-9861-134a5e772cdd service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-b6cb93e3-bb0d-43d7-a93a-848f31c4e62c req-eef959ec-04f4-4e39-9861-134a5e772cdd service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] No waiting events found dispatching network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:48:40 user nova-compute[75210]: WARNING nova.compute.manager [req-b6cb93e3-bb0d-43d7-a93a-848f31c4e62c req-eef959ec-04f4-4e39-9861-134a5e772cdd service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received unexpected event network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 for instance with vm_state building and task_state spawning.
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.network.neutron [None req-7539562c-6d91-4864-b7cc-de152a6a3cb0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Updating instance_info_cache with network_info: [{"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7539562c-6d91-4864-b7cc-de152a6a3cb0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Releasing lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.objects.instance [None req-7539562c-6d91-4864-b7cc-de152a6a3cb0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'flavor' on Instance uuid 391642f0-2293-46bf-a93a-c6f2e61698f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:48:40 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Instance spawned successfully.
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:40 user nova-compute[75210]: INFO nova.compute.manager [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 29 01:48:40 user nova-compute[75210]: DEBUG nova.compute.manager [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:40 user nova-compute[75210]: INFO nova.compute.manager [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Took 14.72 seconds to build instance.
Nov 29 01:48:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0d2f8811-3d15-4424-86d0-7061877fcc4f tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.861s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:41 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Instance destroyed successfully.
Nov 29 01:48:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-569aba29-719a-4282-8530-6ad51547c007 req-6148f5ff-9ca5-433f-b8aa-d6e9db4d1397 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:48:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-569aba29-719a-4282-8530-6ad51547c007 req-6148f5ff-9ca5-433f-b8aa-d6e9db4d1397 service nova] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-569aba29-719a-4282-8530-6ad51547c007 req-6148f5ff-9ca5-433f-b8aa-d6e9db4d1397 service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-569aba29-719a-4282-8530-6ad51547c007 req-6148f5ff-9ca5-433f-b8aa-d6e9db4d1397 service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-569aba29-719a-4282-8530-6ad51547c007 req-6148f5ff-9ca5-433f-b8aa-d6e9db4d1397 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] No waiting events found dispatching network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:48:42 user nova-compute[75210]: WARNING nova.compute.manager [req-569aba29-719a-4282-8530-6ad51547c007 req-6148f5ff-9ca5-433f-b8aa-d6e9db4d1397 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received unexpected event network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 for instance with vm_state active and task_state None.
Nov 29 01:48:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:44 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e6c9606c-5a27-417d-9042-259ce728e175 is timed out.
Nov 29 01:48:44 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Successfully detached device vdb from instance e6c9606c-5a27-417d-9042-259ce728e175 from the live domain config.
Nov 29 01:48:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQoUdiMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:48:44 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d0f7ff-35a2-4f16-850f-2deeb0a64bf0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:48:44 user nova-compute[75210]: No targets found.
Nov 29 01:48:44 user nova-compute[75210]: iSNS:
Nov 29 01:48:44 user nova-compute[75210]: No targets found.
Nov 29 01:48:44 user nova-compute[75210]: STATIC:
Nov 29 01:48:44 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b
Nov 29 01:48:44 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:48:44 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:48:44 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:48:44 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:48:44 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:48:44 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23
Nov 29 01:48:44 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:48:44 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:48:44 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b
Nov 29 01:48:44 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:48:44 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:48:44 user nova-compute[75210]: FIRMWARE:
Nov 29 01:48:44 user nova-compute[75210]: No targets found.
Nov 29 01:48:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:48:44 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:48:44 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad893e0-062a-4197-8eaa-add771eb7716]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[153d28ba-5b23-4197-ae36-2814e616988f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:44 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:44 user nova-compute[75210]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b (non-flash)
Nov 29 01:48:44 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:48:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:44 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:44 user nova-compute[75210]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b (non-flash)
Nov 29 01:48:44 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:48:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f1e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[990179de-201e-4ef9-ad0d-31bc6dcb23a7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[83be23be-8827-4ee2-95ea-f7816d9fc79b]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb816f38-a744-4a83-a5cb-2c04af7fc32e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff47cdb-4973-417c-96f7-e7563ca2d4a9]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56ac145-41d5-4051-b9dc-e9a5e706738c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b40ff73-11f6-4bf3-b80c-d507fcdf807d]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b, portal: 172.16.0.220,3260]
Nov 29 01:48:44 user nova-compute[75210]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b, portal: 172.16.0.220,3260] successful.
Nov 29 01:48:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6cb4c56-89a5-479b-bcfc-8b1d5f79106b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[13712650-4ca8-40e7-8ccf-6f4ac9126a54]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] <== disconnect_volume: return (368ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "c163c27f-4cdd-4984-bd3b-eace62b14106" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG nova.compute.manager [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:44 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:48:44 user nova-compute[75210]: INFO nova.compute.claims [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Claim successful on node user
Nov 29 01:48:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-7539562c-6d91-4864-b7cc-de152a6a3cb0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG nova.network.neutron [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:48:45 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:48:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG nova.policy [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b86193fc42f43c7bfe2183f7edd9964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ed239b27cbd47a0a1ce5246177a992e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:48:45 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Creating image(s)
Nov 29 01:48:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "/opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "/opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "/opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG nova.objects.instance [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'flavor' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-0fe0aa52-d9b2-46c0-8dbe-ec64137ab82f tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.152s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.206s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.195s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk 1073741824" returned: 0 in 0.057s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG nova.network.neutron [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Successfully created port: fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.214s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Cannot resize image /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Ensure instance console log exists: /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG nova.network.neutron [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Successfully updated port: fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-047147ef-f189-499a-a5c2-00b8f6a105f0 req-c9424368-b7d4-40d2-8c84-f8ce9d6fae9c service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-047147ef-f189-499a-a5c2-00b8f6a105f0 req-c9424368-b7d4-40d2-8c84-f8ce9d6fae9c service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-047147ef-f189-499a-a5c2-00b8f6a105f0 req-c9424368-b7d4-40d2-8c84-f8ce9d6fae9c service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-047147ef-f189-499a-a5c2-00b8f6a105f0 req-c9424368-b7d4-40d2-8c84-f8ce9d6fae9c service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-047147ef-f189-499a-a5c2-00b8f6a105f0 req-c9424368-b7d4-40d2-8c84-f8ce9d6fae9c service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:48:46 user nova-compute[75210]: WARNING nova.compute.manager [req-047147ef-f189-499a-a5c2-00b8f6a105f0 req-c9424368-b7d4-40d2-8c84-f8ce9d6fae9c service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state active and task_state None.
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "refresh_cache-c163c27f-4cdd-4984-bd3b-eace62b14106" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquired lock "refresh_cache-c163c27f-4cdd-4984-bd3b-eace62b14106" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG nova.network.neutron [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-3ccf5046-d42c-440d-8f75-783c397d0232 req-929919fd-a5d2-4760-81bb-2f89239d3eb1 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Received event network-changed-fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-3ccf5046-d42c-440d-8f75-783c397d0232 req-929919fd-a5d2-4760-81bb-2f89239d3eb1 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Refreshing instance network info cache due to event network-changed-fbe23d5a-6995-423e-b74f-bcf005dfe21a. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:48:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3ccf5046-d42c-440d-8f75-783c397d0232 req-929919fd-a5d2-4760-81bb-2f89239d3eb1 service nova] Acquiring lock "refresh_cache-c163c27f-4cdd-4984-bd3b-eace62b14106" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.network.neutron [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.network.neutron [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Updating instance_info_cache with network_info: [{"id": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "address": "fa:16:3e:c9:c0:98", "network": {"id": "0b0059b2-e0a1-4d16-beee-c6fdf4a04431", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518067088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ed239b27cbd47a0a1ce5246177a992e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe23d5a-69", "ovs_interfaceid": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Releasing lock "refresh_cache-c163c27f-4cdd-4984-bd3b-eace62b14106" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Instance network_info: |[{"id": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "address": "fa:16:3e:c9:c0:98", "network": {"id": "0b0059b2-e0a1-4d16-beee-c6fdf4a04431", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518067088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ed239b27cbd47a0a1ce5246177a992e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe23d5a-69", "ovs_interfaceid": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3ccf5046-d42c-440d-8f75-783c397d0232 req-929919fd-a5d2-4760-81bb-2f89239d3eb1 service nova] Acquired lock "refresh_cache-c163c27f-4cdd-4984-bd3b-eace62b14106" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.network.neutron [req-3ccf5046-d42c-440d-8f75-783c397d0232 req-929919fd-a5d2-4760-81bb-2f89239d3eb1 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Refreshing network info cache for port fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Start _get_guest_xml network_info=[{"id": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "address": "fa:16:3e:c9:c0:98", "network": {"id": "0b0059b2-e0a1-4d16-beee-c6fdf4a04431", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518067088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ed239b27cbd47a0a1ce5246177a992e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe23d5a-69", "ovs_interfaceid": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:48:47 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:48:47 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:48:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1169725864',display_name='tempest-TestServerVolumeAttachmentScenario-server-1169725864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1169725864',id=31,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOquyQcMmb9Q0NUpdfmvEFvGn2//8iMT6Thg7V3dr+m9dTX5PHIqP8TU1rgJxMHAcOl9R+gU/i9YHKHFH80O/WsbZpn+o3geRZ0ztpd+CobL+awUCVefhBWglJOAm/MrRQ==',key_name='tempest-keypair-1750497578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ed239b27cbd47a0a1ce5246177a992e',ramdisk_id='',reservation_id='r-jopnajcp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-465000080',owner_user_name='tempest-TestServerVolumeAttachmentScenario-465000080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b86193fc42f43c7bfe2183f7edd9964',uuid=c163c27f-4cdd-4984-bd3b-eace62b14106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "address": "fa:16:3e:c9:c0:98", "network": {"id": "0b0059b2-e0a1-4d16-beee-c6fdf4a04431", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518067088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ed239b27cbd47a0a1ce5246177a992e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe23d5a-69", "ovs_interfaceid": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Converting VIF {"id": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "address": "fa:16:3e:c9:c0:98", "network": {"id": "0b0059b2-e0a1-4d16-beee-c6fdf4a04431", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518067088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ed239b27cbd47a0a1ce5246177a992e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe23d5a-69", "ovs_interfaceid": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=fbe23d5a-6995-423e-b74f-bcf005dfe21a,network=Network(0b0059b2-e0a1-4d16-beee-c6fdf4a04431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe23d5a-69') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.objects.instance [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lazy-loading 'pci_devices' on Instance uuid c163c27f-4cdd-4984-bd3b-eace62b14106 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:48:47 user nova-compute[75210]:   <uuid>c163c27f-4cdd-4984-bd3b-eace62b14106</uuid>
Nov 29 01:48:47 user nova-compute[75210]:   <name>instance-0000001f</name>
Nov 29 01:48:47 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:48:47 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:48:47 user nova-compute[75210]:   <metadata>
Nov 29 01:48:47 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:48:47 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:48:47 user nova-compute[75210]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1169725864</nova:name>
Nov 29 01:48:47 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:48:47</nova:creationTime>
Nov 29 01:48:47 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:48:47 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:48:47 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:48:47 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:48:47 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:48:47 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:48:47 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:48:47 user nova-compute[75210]:       <nova:owner>
Nov 29 01:48:47 user nova-compute[75210]:         <nova:user uuid="8b86193fc42f43c7bfe2183f7edd9964">tempest-TestServerVolumeAttachmentScenario-465000080-project-member</nova:user>
Nov 29 01:48:47 user nova-compute[75210]:         <nova:project uuid="8ed239b27cbd47a0a1ce5246177a992e">tempest-TestServerVolumeAttachmentScenario-465000080</nova:project>
Nov 29 01:48:47 user nova-compute[75210]:       </nova:owner>
Nov 29 01:48:47 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:48:47 user nova-compute[75210]:       <nova:ports>
Nov 29 01:48:47 user nova-compute[75210]:         <nova:port uuid="fbe23d5a-6995-423e-b74f-bcf005dfe21a">
Nov 29 01:48:47 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 01:48:47 user nova-compute[75210]:         </nova:port>
Nov 29 01:48:47 user nova-compute[75210]:       </nova:ports>
Nov 29 01:48:47 user nova-compute[75210]:     </nova:instance>
Nov 29 01:48:47 user nova-compute[75210]:   </metadata>
Nov 29 01:48:47 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:48:47 user nova-compute[75210]:     <system>
Nov 29 01:48:47 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:48:47 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:48:47 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:48:47 user nova-compute[75210]:       <entry name="serial">c163c27f-4cdd-4984-bd3b-eace62b14106</entry>
Nov 29 01:48:47 user nova-compute[75210]:       <entry name="uuid">c163c27f-4cdd-4984-bd3b-eace62b14106</entry>
Nov 29 01:48:47 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:48:47 user nova-compute[75210]:     </system>
Nov 29 01:48:47 user nova-compute[75210]:   </sysinfo>
Nov 29 01:48:47 user nova-compute[75210]:   <os>
Nov 29 01:48:47 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:48:47 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:48:47 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:48:47 user nova-compute[75210]:   </os>
Nov 29 01:48:47 user nova-compute[75210]:   <features>
Nov 29 01:48:47 user nova-compute[75210]:     <acpi/>
Nov 29 01:48:47 user nova-compute[75210]:     <apic/>
Nov 29 01:48:47 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:48:47 user nova-compute[75210]:   </features>
Nov 29 01:48:47 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:48:47 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:48:47 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:48:47 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:48:47 user nova-compute[75210]:   </clock>
Nov 29 01:48:47 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:48:47 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:48:47 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:48:47 user nova-compute[75210]:   </cpu>
Nov 29 01:48:47 user nova-compute[75210]:   <devices>
Nov 29 01:48:47 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:48:47 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:48:47 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk"/>
Nov 29 01:48:47 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:48:47 user nova-compute[75210]:     </disk>
Nov 29 01:48:47 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:48:47 user nova-compute[75210]:       <mac address="fa:16:3e:c9:c0:98"/>
Nov 29 01:48:47 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:48:47 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:48:47 user nova-compute[75210]:       <target dev="tapfbe23d5a-69"/>
Nov 29 01:48:47 user nova-compute[75210]:     </interface>
Nov 29 01:48:47 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:48:47 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/console.log" append="off"/>
Nov 29 01:48:47 user nova-compute[75210]:     </serial>
Nov 29 01:48:47 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:48:47 user nova-compute[75210]:     <video>
Nov 29 01:48:47 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:48:47 user nova-compute[75210]:     </video>
Nov 29 01:48:47 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:48:47 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:48:47 user nova-compute[75210]:     </rng>
Nov 29 01:48:47 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:48:47 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:48:47 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:48:47 user nova-compute[75210]:     </memballoon>
Nov 29 01:48:47 user nova-compute[75210]:   </devices>
Nov 29 01:48:47 user nova-compute[75210]: </domain>
Nov 29 01:48:47 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:48:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1169725864',display_name='tempest-TestServerVolumeAttachmentScenario-server-1169725864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1169725864',id=31,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOquyQcMmb9Q0NUpdfmvEFvGn2//8iMT6Thg7V3dr+m9dTX5PHIqP8TU1rgJxMHAcOl9R+gU/i9YHKHFH80O/WsbZpn+o3geRZ0ztpd+CobL+awUCVefhBWglJOAm/MrRQ==',key_name='tempest-keypair-1750497578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ed239b27cbd47a0a1ce5246177a992e',ramdisk_id='',reservation_id='r-jopnajcp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-465000080',owner_user_name='tempest-TestServerVolumeAttachmentScenario-465000080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:48:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b86193fc42f43c7bfe2183f7edd9964',uuid=c163c27f-4cdd-4984-bd3b-eace62b14106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "address": "fa:16:3e:c9:c0:98", "network": {"id": "0b0059b2-e0a1-4d16-beee-c6fdf4a04431", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518067088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ed239b27cbd47a0a1ce5246177a992e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe23d5a-69", "ovs_interfaceid": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Converting VIF {"id": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "address": "fa:16:3e:c9:c0:98", "network": {"id": "0b0059b2-e0a1-4d16-beee-c6fdf4a04431", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518067088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ed239b27cbd47a0a1ce5246177a992e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe23d5a-69", "ovs_interfaceid": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=fbe23d5a-6995-423e-b74f-bcf005dfe21a,network=Network(0b0059b2-e0a1-4d16-beee-c6fdf4a04431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe23d5a-69') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG os_vif [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=fbe23d5a-6995-423e-b74f-bcf005dfe21a,network=Network(0b0059b2-e0a1-4d16-beee-c6fdf4a04431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe23d5a-69') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7116d156-9afd-5622-93c3-45a72409ebed', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbe23d5a-69, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbe23d5a-69, col_values=(('qos', UUID('3718d4fa-6e50-4e13-929d-2d692d05abca')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbe23d5a-69, col_values=(('external_ids', {'iface-id': 'fbe23d5a-6995-423e-b74f-bcf005dfe21a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:c0:98', 'vm-uuid': 'c163c27f-4cdd-4984-bd3b-eace62b14106'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:47 user nova-compute[75210]: INFO os_vif [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=fbe23d5a-6995-423e-b74f-bcf005dfe21a,network=Network(0b0059b2-e0a1-4d16-beee-c6fdf4a04431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe23d5a-69')
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] No VIF found with MAC fa:16:3e:c9:c0:98, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.network.neutron [req-3ccf5046-d42c-440d-8f75-783c397d0232 req-929919fd-a5d2-4760-81bb-2f89239d3eb1 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Updated VIF entry in instance network info cache for port fbe23d5a-6995-423e-b74f-bcf005dfe21a. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG nova.network.neutron [req-3ccf5046-d42c-440d-8f75-783c397d0232 req-929919fd-a5d2-4760-81bb-2f89239d3eb1 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Updating instance_info_cache with network_info: [{"id": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "address": "fa:16:3e:c9:c0:98", "network": {"id": "0b0059b2-e0a1-4d16-beee-c6fdf4a04431", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518067088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ed239b27cbd47a0a1ce5246177a992e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe23d5a-69", "ovs_interfaceid": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:48:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3ccf5046-d42c-440d-8f75-783c397d0232 req-929919fd-a5d2-4760-81bb-2f89239d3eb1 service nova] Releasing lock "refresh_cache-c163c27f-4cdd-4984-bd3b-eace62b14106" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:48:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:48:49 user nova-compute[75210]: WARNING nova.compute.manager [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state active and task_state None.
Nov 29 01:48:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:48:49 user nova-compute[75210]: WARNING nova.compute.manager [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state active and task_state None.
Nov 29 01:48:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Received event network-changed-1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Refreshing instance network info cache due to event network-changed-1117eeaf-d531-47b1-848a-26b672999bd4. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] Acquiring lock "refresh_cache-c754f3a2-db8d-4619-aa14-462c6b7fc94c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] Acquired lock "refresh_cache-c754f3a2-db8d-4619-aa14-462c6b7fc94c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG nova.network.neutron [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Refreshing network info cache for port 1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG nova.network.neutron [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Updated VIF entry in instance network info cache for port 1117eeaf-d531-47b1-848a-26b672999bd4. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG nova.network.neutron [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Updating instance_info_cache with network_info: [{"id": "1117eeaf-d531-47b1-848a-26b672999bd4", "address": "fa:16:3e:c9:cc:87", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1117eeaf-d5", "ovs_interfaceid": "1117eeaf-d531-47b1-848a-26b672999bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] Releasing lock "refresh_cache-c754f3a2-db8d-4619-aa14-462c6b7fc94c" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:48:49 user nova-compute[75210]: WARNING nova.compute.manager [req-c260a5bd-4780-45b1-a04f-c3c233bf2532 req-759571f9-49b7-418d-9601-454354ff9a53 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state active and task_state None.
Nov 29 01:48:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'flavor' on Instance uuid c754f3a2-db8d-4619-aa14-462c6b7fc94c {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:50 user nova-compute[75210]: INFO nova.compute.manager [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Attaching volume 206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 to /dev/vdb
Nov 29 01:48:50 user nova-compute[75210]: DEBUG os_brick.utils [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45b885f-0cb4-4606-9be2-81928345ad0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[68750524-9e9d-41e5-a44a-51fb133bf047]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c44d7e3-50e0-4a28-a60d-5ac5c1bb96d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cada61-9a59-4ccd-8b32-4bc7e7ac5844]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:48:50 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:48:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c21613a-11c4-4637-9001-fa721fbef720]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG os_brick.utils [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Updating existing volume attachment record: 7979c0df-a899-4cf8-9a00-f26ede994b1c {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:48:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-93d3bbe8-e7d0-4a90-bd05-198f9ea04da3 req-951152a6-b25a-4f22-8567-8b4420327899 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Received event network-vif-plugged-fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-93d3bbe8-e7d0-4a90-bd05-198f9ea04da3 req-951152a6-b25a-4f22-8567-8b4420327899 service nova] Acquiring lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-93d3bbe8-e7d0-4a90-bd05-198f9ea04da3 req-951152a6-b25a-4f22-8567-8b4420327899 service nova] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-93d3bbe8-e7d0-4a90-bd05-198f9ea04da3 req-951152a6-b25a-4f22-8567-8b4420327899 service nova] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-93d3bbe8-e7d0-4a90-bd05-198f9ea04da3 req-951152a6-b25a-4f22-8567-8b4420327899 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] No waiting events found dispatching network-vif-plugged-fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:48:51 user nova-compute[75210]: WARNING nova.compute.manager [req-93d3bbe8-e7d0-4a90-bd05-198f9ea04da3 req-951152a6-b25a-4f22-8567-8b4420327899 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Received unexpected event network-vif-plugged-fbe23d5a-6995-423e-b74f-bcf005dfe21a for instance with vm_state building and task_state spawning.
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-93d3bbe8-e7d0-4a90-bd05-198f9ea04da3 req-951152a6-b25a-4f22-8567-8b4420327899 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Received event network-vif-plugged-fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-93d3bbe8-e7d0-4a90-bd05-198f9ea04da3 req-951152a6-b25a-4f22-8567-8b4420327899 service nova] Acquiring lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-93d3bbe8-e7d0-4a90-bd05-198f9ea04da3 req-951152a6-b25a-4f22-8567-8b4420327899 service nova] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-93d3bbe8-e7d0-4a90-bd05-198f9ea04da3 req-951152a6-b25a-4f22-8567-8b4420327899 service nova] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-93d3bbe8-e7d0-4a90-bd05-198f9ea04da3 req-951152a6-b25a-4f22-8567-8b4420327899 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] No waiting events found dispatching network-vif-plugged-fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:48:51 user nova-compute[75210]: WARNING nova.compute.manager [req-93d3bbe8-e7d0-4a90-bd05-198f9ea04da3 req-951152a6-b25a-4f22-8567-8b4420327899 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Received unexpected event network-vif-plugged-fbe23d5a-6995-423e-b74f-bcf005dfe21a for instance with vm_state building and task_state spawning.
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.compute.manager [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:48:51 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Instance spawned successfully.
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:48:51 user nova-compute[75210]: INFO nova.compute.manager [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 29 01:48:51 user nova-compute[75210]: DEBUG nova.compute.manager [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:48:51 user nova-compute[75210]: INFO nova.compute.manager [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Took 6.59 seconds to build instance.
Nov 29 01:48:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21d93c20-d9dd-43b2-89df-d0f2e27118f2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.715s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:48:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG nova.objects.instance [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lazy-loading 'flavor' on Instance uuid 4fab87e3-2f7c-4db4-9f14-ace1813fe046 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:48:58 user nova-compute[75210]: INFO nova.compute.manager [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Attaching volume 0701e0ea-4b69-4215-9da7-7a684d683866 to /dev/vdb
Nov 29 01:48:58 user nova-compute[75210]: DEBUG os_brick.utils [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[25af6038-16a8-428b-932a-274b58584b39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40f4b0a-ba59-4154-8d0a-81d0c7f07326]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[586829d8-a835-4c94-bc83-2638e2f0059b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b662d0-b523-4338-bd11-9d44304d112d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:48:58 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:48:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1f6e42-8c4d-4f32-8cd0-567a0eb56247]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG os_brick.utils [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:48:58 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating existing volume attachment record: e0f6d42b-5727-4311-b355-8a6901b8fc6c {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiHCBYvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:48:59 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:48:59 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:48:59 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[094a9a4a-343f-462e-8ed1-d0c564df8424]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:48:59 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7639adfc-d066-4cce-8fc3-a1ac11ee022a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0] added
Nov 29 01:48:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d660644e-8e73-4c0a-871d-81390bc52371]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e8a019-390e-49b6-b883-a39033b5f716]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TiHCBYvN {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TiHCBYvN" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3eb308-cf49-4b47-ae75-94c84ee5d2e9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TiHCBYvN'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[749772e6-e669-4dc2-a1d0-fc24462135b1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[335b80e6-79b0-4481-84f5-8828c9bf5441]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:59 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:59 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:48:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:59 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:59 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:48:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a676eda-da2c-41af-ada0-c08271bddfc5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0, portal: 172.16.0.220,3260]
Nov 29 01:48:59 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0, portal: 172.16.0.220,3260] successful.
Nov 29 01:48:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c4b002-c8da-4fe3-ac9e-a36bbebd1e63]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c5cad7-b4d4-4839-854d-271c7ec2fd64]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:59 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:59 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:48:59 user nova-compute[75210]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)
Nov 29 01:48:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:48:59 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:48:59 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:48:59 user nova-compute[75210]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)
Nov 29 01:48:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b738d8-6eda-4e3f-936e-b2d07b700463]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:48:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiHCBYvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:49:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:49:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26662656134303262', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:49:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662656134303262', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:49:00 user nova-compute[75210]: DEBUG nova.objects.instance [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'flavor' on Instance uuid c754f3a2-db8d-4619-aa14-462c6b7fc94c {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:49:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:49:00 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:49:00 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:49:00 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:49:00 user nova-compute[75210]:   <serial>206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0</serial>
Nov 29 01:49:00 user nova-compute[75210]: </disk>
Nov 29 01:49:00 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:49:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:49:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:49:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] No VIF found with MAC fa:16:3e:c9:cc:87, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:49:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6a4847a2-ebc7-4aa8-9b8c-cb2e7b99cdba tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.488s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:01 user nova-compute[75210]: INFO nova.compute.manager [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Detaching volume 206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0
Nov 29 01:49:01 user nova-compute[75210]: INFO nova.virt.block_device [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Attempting to driver detach volume 206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 from mountpoint /dev/vdb
Nov 29 01:49:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Attempting to detach device vdb from instance c754f3a2-db8d-4619-aa14-462c6b7fc94c from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:49:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:49:01 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:49:01 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:49:01 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:49:01 user nova-compute[75210]:   <serial>206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0</serial>
Nov 29 01:49:01 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:49:01 user nova-compute[75210]: </disk>
Nov 29 01:49:01 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:49:01 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully detached device vdb from instance c754f3a2-db8d-4619-aa14-462c6b7fc94c from the persistent domain config.
Nov 29 01:49:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c754f3a2-db8d-4619-aa14-462c6b7fc94c from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:49:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:49:01 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:49:01 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:49:01 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:49:01 user nova-compute[75210]:   <serial>206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0</serial>
Nov 29 01:49:01 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:49:01 user nova-compute[75210]: </disk>
Nov 29 01:49:01 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:49:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c754f3a2-db8d-4619-aa14-462c6b7fc94c {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:49:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzbKkiSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:49:05 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:49:05 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:49:05 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6925fa4-655b-43af-b902-9a538983485b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:49:05 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e906c044-a17c-476f-a891-73b69df44391]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866] added
Nov 29 01:49:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[696b5a0c-4fae-4fa8-8847-6bbd78e91067]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1844c267-a46c-4eea-a1c8-b08114166601]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzbKkiSH {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzbKkiSH" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b939724-1e44-48fe-a185-922d064f10d7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BzbKkiSH'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d510fbbc-a0d6-47f2-a812-c9179e7490fb]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ce51ee-1ae1-4e59-9edd-8986f641620d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:05 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:05 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:05 user nova-compute[75210]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)
Nov 29 01:49:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:05 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:05 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:05 user nova-compute[75210]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)
Nov 29 01:49:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec0717-d1ab-41b3-9911-1c1e41537bfc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260]
Nov 29 01:49:05 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260] successful.
Nov 29 01:49:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb0f802-0157-44ce-957a-783645b44039]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f993ce24-30e1-4084-96c8-cd4dd70a8065]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:06 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:06 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:06 user nova-compute[75210]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)
Nov 29 01:49:06 user nova-compute[75210]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:49:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:06 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:06 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:06 user nova-compute[75210]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)
Nov 29 01:49:06 user nova-compute[75210]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:49:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1952aca-f43f-4d94-9659-77f4582a64d6]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:06 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:49:07 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:49:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzbKkiSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:49:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:49:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26435376431616662', 'path': '/dev/sdf'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:49:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435376431616662', 'path': '/dev/sdf'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:49:07 user nova-compute[75210]: DEBUG nova.objects.instance [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lazy-loading 'flavor' on Instance uuid 4fab87e3-2f7c-4db4-9f14-ace1813fe046 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:49:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:49:07 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:49:07 user nova-compute[75210]:   <source dev="/dev/sdf"/>
Nov 29 01:49:07 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:49:07 user nova-compute[75210]:   <serial>0701e0ea-4b69-4215-9da7-7a684d683866</serial>
Nov 29 01:49:07 user nova-compute[75210]: </disk>
Nov 29 01:49:07 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:49:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:49:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:49:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] No VIF found with MAC fa:16:3e:95:cc:d2, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:49:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ad2d7ace-54ef-4d23-aa14-136a4eb1da15 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.342s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Stashing vm_state: active {{(pid=75210) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 01:49:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:49:09 user nova-compute[75210]: INFO nova.compute.claims [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Claim successful on node user
Nov 29 01:49:09 user nova-compute[75210]: INFO nova.compute.resource_tracker [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating resource usage from migration f33be2ae-820f-4d4c-92cb-02ec1f06bdd5
Nov 29 01:49:10 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:49:10 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:49:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.430s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:10 user nova-compute[75210]: INFO nova.compute.manager [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Migrating
Nov 29 01:49:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:49:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:49:10 user nova-compute[75210]: INFO nova.compute.rpcapi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 29 01:49:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:49:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:49:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquired lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:49:10 user nova-compute[75210]: DEBUG nova.network.neutron [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:49:10 user nova-compute[75210]: DEBUG nova.network.neutron [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating instance_info_cache with network_info: [{"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:49:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Releasing lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:49:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Starting migrate_disk_and_power_off {{(pid=75210) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 01:49:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d4f9ff3-fbb2-49d1-a4a6-07d21bb0dedc req-1c8b81e4-479b-4ee7-9389-0fbb3bc17909 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-unplugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d4f9ff3-fbb2-49d1-a4a6-07d21bb0dedc req-1c8b81e4-479b-4ee7-9389-0fbb3bc17909 service nova] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d4f9ff3-fbb2-49d1-a4a6-07d21bb0dedc req-1c8b81e4-479b-4ee7-9389-0fbb3bc17909 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d4f9ff3-fbb2-49d1-a4a6-07d21bb0dedc req-1c8b81e4-479b-4ee7-9389-0fbb3bc17909 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d4f9ff3-fbb2-49d1-a4a6-07d21bb0dedc req-1c8b81e4-479b-4ee7-9389-0fbb3bc17909 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] No waiting events found dispatching network-vif-unplugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:49:11 user nova-compute[75210]: WARNING nova.compute.manager [req-8d4f9ff3-fbb2-49d1-a4a6-07d21bb0dedc req-1c8b81e4-479b-4ee7-9389-0fbb3bc17909 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received unexpected event network-vif-unplugged-60309b43-09f2-4bc7-81a2-9c764df78b5d for instance with vm_state active and task_state resize_migrating.
Nov 29 01:49:11 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Instance destroyed successfully.
Nov 29 01:49:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1920078035',display_name='tempest-ServerActionsTestOtherB-server-1920078035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1920078035',id=27,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHTMCtMfKAyfL3sA07wByFhm2FHh83CKtTVWERl3aWtDAO+UO8rfcAbJD3gRH9oGCeL5Ksot/CKwepAmL20m57Zzo2MLfsvimSlewZEfHZ4/WEV9jR4p6/EvJ11L0KWcA==',key_name='tempest-keypair-53471645',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:45:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e7b24c627ca143e49731c22a555eacd1',ramdisk_id='',reservation_id='r-08i4j8ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-573973984',owner_user_name='tempest-ServerActionsTestOtherB-573973984-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:49:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b16390ddb64b9f8925f3e156bbe8d0',uuid=4fab87e3-2f7c-4db4-9f14-ace1813fe046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1522934833-network", "vif_mac": "fa:16:3e:95:cc:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converting VIF {"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1522934833-network", "vif_mac": "fa:16:3e:95:cc:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_vif [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60309b43-09, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7dae55e-b9bf-4d54-824c-70e4baf30667) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:49:11 user nova-compute[75210]: INFO os_vif [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09')
Nov 29 01:49:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzbKkiSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:49:11 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f607b9a2-510d-4ef0-934a-5f27a7ff34db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:49:11 user nova-compute[75210]: No targets found.
Nov 29 01:49:11 user nova-compute[75210]: iSNS:
Nov 29 01:49:11 user nova-compute[75210]: No targets found.
Nov 29 01:49:11 user nova-compute[75210]: STATIC:
Nov 29 01:49:11 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866
Nov 29 01:49:11 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:11 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:11 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:49:11 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:11 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:11 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23
Nov 29 01:49:11 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:11 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:11 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b
Nov 29 01:49:11 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:11 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:11 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0
Nov 29 01:49:11 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:11 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:11 user nova-compute[75210]: FIRMWARE:
Nov 29 01:49:11 user nova-compute[75210]: No targets found.
Nov 29 01:49:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:49:11 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:49:11 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3c76fe-affc-436d-adbb-007b7428f72e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a44ed87-5f0b-4af7-a1ed-4b4c7135ca11]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:11 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:11 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:11 user nova-compute[75210]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)
Nov 29 01:49:11 user nova-compute[75210]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:49:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:11 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:11 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:11 user nova-compute[75210]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)
Nov 29 01:49:11 user nova-compute[75210]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:49:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4e5dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866'): ({'sdf'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Removing single pathed devices sdf {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda95d55-06f1-4b56-ab4f-b5055e524318]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[97876e2d-3acf-4e2f-b04f-8a6f8f5fb344]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Flushing IO for device /dev/sdf {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfc4440-089b-49f2-9fc1-c9d2450d2935]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a4abe5-87a3-495f-ac7c-e6a8f8763f77]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] SCSI volumes sdf have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af5b901-5759-44e4-aa1c-57bc5ca043e2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc78f92-e7e0-486e-9f45-5941770692b1]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260]
Nov 29 01:49:11 user nova-compute[75210]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260] successful.
Nov 29 01:49:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17d5b3b-3251-4fa5-a20f-71c85329cd52]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] <== disconnect_volume: return (315ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:49:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:49:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046_resize/disk /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CMD "cp -r /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046_resize/disk /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk" returned: 0 in 0.437s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046_resize/disk.info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk.info {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CMD "cp -r /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046_resize/disk.info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk.info" returned: 0 in 0.040s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-cae74920-c39e-4514-9cb5-ac778e44aabb req-36ab1aeb-095b-44ea-b329-824b9ff7a13a service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:49:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cae74920-c39e-4514-9cb5-ac778e44aabb req-36ab1aeb-095b-44ea-b329-824b9ff7a13a service nova] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cae74920-c39e-4514-9cb5-ac778e44aabb req-36ab1aeb-095b-44ea-b329-824b9ff7a13a service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cae74920-c39e-4514-9cb5-ac778e44aabb req-36ab1aeb-095b-44ea-b329-824b9ff7a13a service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-cae74920-c39e-4514-9cb5-ac778e44aabb req-36ab1aeb-095b-44ea-b329-824b9ff7a13a service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] No waiting events found dispatching network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:49:13 user nova-compute[75210]: WARNING nova.compute.manager [req-cae74920-c39e-4514-9cb5-ac778e44aabb req-36ab1aeb-095b-44ea-b329-824b9ff7a13a service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received unexpected event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d for instance with vm_state active and task_state resize_migrating.
Nov 29 01:49:13 user nova-compute[75210]: DEBUG nova.network.neutron [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Port 60309b43-09f2-4bc7-81a2-9c764df78b5d binding to destination host user is already ACTIVE {{(pid=75210) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 01:49:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:49:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquired lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:49:13 user nova-compute[75210]: DEBUG nova.network.neutron [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG nova.network.neutron [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating instance_info_cache with network_info: [{"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Releasing lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG os_brick.utils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[efef05f3-c5fe-4890-93ff-bb0c232e91e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c1e685-b36b-4086-88c0-4c54962f550c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ffcdcf-ca57-471b-adac-b295e2e9777a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e167347-09c5-4b3b-b971-bd382a990974]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:49:14 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:49:14 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b022b68-4ad9-4d61-92b8-6abbe3010865]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:49:14 user nova-compute[75210]: DEBUG os_brick.utils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:49:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:16 user nova-compute[75210]: DEBUG nova.objects.instance [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'flavor' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:49:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:16 user nova-compute[75210]: INFO nova.compute.manager [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Attaching volume eff19ecd-f0ea-4dba-883c-bd5d637916e1 to /dev/vdb
Nov 29 01:49:17 user nova-compute[75210]: DEBUG os_brick.utils [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf6196f-1bc2-4d29-ba65-1017e51b93ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6386d012-e4eb-4636-a54d-f53db6e07f72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74873a6-6599-4ec9-942b-b14cbd3a4a1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[52673025-2a2d-4090-a382-3c1ced1f0c91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:49:17 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:49:17 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fd57ee-4bc4-4fc5-a088-0396df758841]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG os_brick.utils [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:49:17 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Updating existing volume attachment record: 8ed4ae69-1a6b-4012-b3f4-146fe74de9ed {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:49:20 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:49:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:49:21 user nova-compute[75210]: INFO nova.compute.claims [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Claim successful on node user
Nov 29 01:49:21 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG nova.compute.manager [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG nova.compute.manager [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG nova.network.neutron [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:49:21 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:49:21 user nova-compute[75210]: DEBUG nova.compute.manager [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG nova.policy [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28fd6f01158e4dd7a7df3e04e815a9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34af8bfc0e1b4cbbb803c3bf6a8f7715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG nova.compute.manager [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:49:21 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Creating image(s)
Nov 29 01:49:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "/opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "/opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "/opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Starting finish_migration {{(pid=75210) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Instance directory exists: not creating {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 01:49:22 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Creating image(s)
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.194s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk 1073741824" returned: 0 in 0.054s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Successfully created port: fbebc7dc-3846-49ae-8226-6a9559434359 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk. size=21474836480 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c754f3a2-db8d-4619-aa14-462c6b7fc94c is timed out.
Nov 29 01:49:22 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully detached device vdb from instance c754f3a2-db8d-4619-aa14-462c6b7fc94c from the live domain config.
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiHCBYvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:49:22 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca110c4-b1f6-4afa-ba3c-1341893fbe08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:49:22 user nova-compute[75210]: No targets found.
Nov 29 01:49:22 user nova-compute[75210]: iSNS:
Nov 29 01:49:22 user nova-compute[75210]: No targets found.
Nov 29 01:49:22 user nova-compute[75210]: STATIC:
Nov 29 01:49:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:49:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23
Nov 29 01:49:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b
Nov 29 01:49:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:22 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0
Nov 29 01:49:22 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:22 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:22 user nova-compute[75210]: FIRMWARE:
Nov 29 01:49:22 user nova-compute[75210]: No targets found.
Nov 29 01:49:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:49:22 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:49:22 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39a7ea5-6ca4-4f4f-8366-e97e4e4247fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b56e139-7c39-479d-9cbc-ec5673f8d205]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:22 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:22 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:22 user nova-compute[75210]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)
Nov 29 01:49:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:22 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:22 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:22 user nova-compute[75210]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 (non-flash)
Nov 29 01:49:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4e5ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f28b408-7179-42a1-81ee-2b11a8a12db0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk 21474836480 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[661dc2c9-d1fc-4d24-9fd3-ea52f825d966]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2902b6e5-4bc0-4c99-94df-4d4ffbd2947e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Cannot resize image /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Ensure instance console log exists: /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk 21474836480" returned: 0 in 0.091s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dabbb5-e568-4145-92b4-fea6d6c9b0e2]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Ensure instance console log exists: /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Start _get_guest_xml network_info=[{"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1522934833-network", "vif_mac": "fa:16:3e:95:cc:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'd8177afc-659c-4ac0-9e6c-96ff215f0664', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzbKkiSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4fab87e3-2f7c-4db4-9f14-ace1813fe046', 'attached_at': '2023-11-29T01:49:22.000000', 'detached_at': '', 'volume_id': '0701e0ea-4b69-4215-9da7-7a684d683866', 'serial': '0701e0ea-4b69-4215-9da7-7a684d683866'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:49:22 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[524af3f6-362c-4c93-b0bb-7e18d2825bd6]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzbKkiSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:49:22 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51b1eb7-0b72-4066-b5c0-88fcd718689d]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0, portal: 172.16.0.220,3260]
Nov 29 01:49:22 user nova-compute[75210]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0, portal: 172.16.0.220,3260] successful.
Nov 29 01:49:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206a1d3e-a5b8-480d-bc5e-d13ec85a3ca0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f397f63-50cd-485e-ba08-22c15a4394c6]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] <== disconnect_volume: return (367ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.054s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:49:22 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:49:22 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34e8b89-0e9d-4043-aac2-570223f55660]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:49:22 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc4ea3b-3398-4b4f-9b17-cdec84128f28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866] added
Nov 29 01:49:22 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e694527-d66a-40a7-8909-c1f80b0625cc]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ef1591-93d3-4211-9634-69bba38add51]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzbKkiSH {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzbKkiSH" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85ce72e-c67a-4c4c-8c30-2a65d109f1ec]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BzbKkiSH'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Successfully updated port: fbebc7dc-3846-49ae-8226-6a9559434359 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ff8aad-b3d1-4f29-8538-6f05e37e5ae2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "refresh_cache-3df17188-c87e-49e5-9ca2-5d04632ea9bb" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquired lock "refresh_cache-3df17188-c87e-49e5-9ca2-5d04632ea9bb" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:49:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f86392-ac08-4e0b-8b3d-40ef0b588382]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:23 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:23 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:23 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:23 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:23 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:23 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-6fa1d8a4-d00b-40d1-a85d-4e34160cb251 req-76843e9e-9c70-4475-bcc7-cd7b34aa7507 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Received event network-changed-fbebc7dc-3846-49ae-8226-6a9559434359 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-6fa1d8a4-d00b-40d1-a85d-4e34160cb251 req-76843e9e-9c70-4475-bcc7-cd7b34aa7507 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Refreshing instance network info cache due to event network-changed-fbebc7dc-3846-49ae-8226-6a9559434359. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6fa1d8a4-d00b-40d1-a85d-4e34160cb251 req-76843e9e-9c70-4475-bcc7-cd7b34aa7507 service nova] Acquiring lock "refresh_cache-3df17188-c87e-49e5-9ca2-5d04632ea9bb" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.network.neutron [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c41be6-b93c-4a12-bc57-8e0ceb44fb9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260]
Nov 29 01:49:23 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260] successful.
Nov 29 01:49:23 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12bb202-1e97-48f3-a5e4-0bf09cff7d3a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.055s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[112cfe9d-a2eb-41ee-bc09-487f29c24e26]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:23 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:23 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:23 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:49:23 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:23 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:23 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:23 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:49:23 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0366c0d-72fe-4641-af62-c84962d205ef]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzbKkiSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.network.neutron [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Updating instance_info_cache with network_info: [{"id": "fbebc7dc-3846-49ae-8226-6a9559434359", "address": "fa:16:3e:82:69:38", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbebc7dc-38", "ovs_interfaceid": "fbebc7dc-3846-49ae-8226-6a9559434359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Releasing lock "refresh_cache-3df17188-c87e-49e5-9ca2-5d04632ea9bb" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Instance network_info: |[{"id": "fbebc7dc-3846-49ae-8226-6a9559434359", "address": "fa:16:3e:82:69:38", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbebc7dc-38", "ovs_interfaceid": "fbebc7dc-3846-49ae-8226-6a9559434359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6fa1d8a4-d00b-40d1-a85d-4e34160cb251 req-76843e9e-9c70-4475-bcc7-cd7b34aa7507 service nova] Acquired lock "refresh_cache-3df17188-c87e-49e5-9ca2-5d04632ea9bb" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-6fa1d8a4-d00b-40d1-a85d-4e34160cb251 req-76843e9e-9c70-4475-bcc7-cd7b34aa7507 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Refreshing network info cache for port fbebc7dc-3846-49ae-8226-6a9559434359 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Start _get_guest_xml network_info=[{"id": "fbebc7dc-3846-49ae-8226-6a9559434359", "address": "fa:16:3e:82:69:38", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbebc7dc-38", "ovs_interfaceid": "fbebc7dc-3846-49ae-8226-6a9559434359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:49:23 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:49:23 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:49:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-85170163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-85170163',id=32,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-0mmk0g2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:49:22Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=3df17188-c87e-49e5-9ca2-5d04632ea9bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbebc7dc-3846-49ae-8226-6a9559434359", "address": "fa:16:3e:82:69:38", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbebc7dc-38", "ovs_interfaceid": "fbebc7dc-3846-49ae-8226-6a9559434359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "fbebc7dc-3846-49ae-8226-6a9559434359", "address": "fa:16:3e:82:69:38", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbebc7dc-38", "ovs_interfaceid": "fbebc7dc-3846-49ae-8226-6a9559434359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:69:38,bridge_name='br-int',has_traffic_filtering=True,id=fbebc7dc-3846-49ae-8226-6a9559434359,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbebc7dc-38') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.objects.instance [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'pci_devices' on Instance uuid 3df17188-c87e-49e5-9ca2-5d04632ea9bb {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.objects.instance [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'flavor' on Instance uuid c754f3a2-db8d-4619-aa14-462c6b7fc94c {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:49:23 user nova-compute[75210]:   <uuid>3df17188-c87e-49e5-9ca2-5d04632ea9bb</uuid>
Nov 29 01:49:23 user nova-compute[75210]:   <name>instance-00000020</name>
Nov 29 01:49:23 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:49:23 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:49:23 user nova-compute[75210]:   <metadata>
Nov 29 01:49:23 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:49:23 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:49:23 user nova-compute[75210]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-85170163</nova:name>
Nov 29 01:49:23 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:49:23</nova:creationTime>
Nov 29 01:49:23 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:49:23 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:49:23 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:49:23 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:49:23 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:49:23 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:49:23 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:49:23 user nova-compute[75210]:       <nova:owner>
Nov 29 01:49:23 user nova-compute[75210]:         <nova:user uuid="28fd6f01158e4dd7a7df3e04e815a9d0">tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member</nova:user>
Nov 29 01:49:23 user nova-compute[75210]:         <nova:project uuid="34af8bfc0e1b4cbbb803c3bf6a8f7715">tempest-ServerBootFromVolumeStableRescueTest-440893694</nova:project>
Nov 29 01:49:23 user nova-compute[75210]:       </nova:owner>
Nov 29 01:49:23 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:49:23 user nova-compute[75210]:       <nova:ports>
Nov 29 01:49:23 user nova-compute[75210]:         <nova:port uuid="fbebc7dc-3846-49ae-8226-6a9559434359">
Nov 29 01:49:23 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 01:49:23 user nova-compute[75210]:         </nova:port>
Nov 29 01:49:23 user nova-compute[75210]:       </nova:ports>
Nov 29 01:49:23 user nova-compute[75210]:     </nova:instance>
Nov 29 01:49:23 user nova-compute[75210]:   </metadata>
Nov 29 01:49:23 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:49:23 user nova-compute[75210]:     <system>
Nov 29 01:49:23 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:49:23 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:49:23 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:49:23 user nova-compute[75210]:       <entry name="serial">3df17188-c87e-49e5-9ca2-5d04632ea9bb</entry>
Nov 29 01:49:23 user nova-compute[75210]:       <entry name="uuid">3df17188-c87e-49e5-9ca2-5d04632ea9bb</entry>
Nov 29 01:49:23 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:49:23 user nova-compute[75210]:     </system>
Nov 29 01:49:23 user nova-compute[75210]:   </sysinfo>
Nov 29 01:49:23 user nova-compute[75210]:   <os>
Nov 29 01:49:23 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:49:23 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:49:23 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:49:23 user nova-compute[75210]:   </os>
Nov 29 01:49:23 user nova-compute[75210]:   <features>
Nov 29 01:49:23 user nova-compute[75210]:     <acpi/>
Nov 29 01:49:23 user nova-compute[75210]:     <apic/>
Nov 29 01:49:23 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:49:23 user nova-compute[75210]:   </features>
Nov 29 01:49:23 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:49:23 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:49:23 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:49:23 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:49:23 user nova-compute[75210]:   </clock>
Nov 29 01:49:23 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:49:23 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:49:23 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:49:23 user nova-compute[75210]:   </cpu>
Nov 29 01:49:23 user nova-compute[75210]:   <devices>
Nov 29 01:49:23 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:49:23 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:49:23 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk"/>
Nov 29 01:49:23 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:49:23 user nova-compute[75210]:     </disk>
Nov 29 01:49:23 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:49:23 user nova-compute[75210]:       <mac address="fa:16:3e:82:69:38"/>
Nov 29 01:49:23 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:49:23 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:49:23 user nova-compute[75210]:       <target dev="tapfbebc7dc-38"/>
Nov 29 01:49:23 user nova-compute[75210]:     </interface>
Nov 29 01:49:23 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:49:23 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/console.log" append="off"/>
Nov 29 01:49:23 user nova-compute[75210]:     </serial>
Nov 29 01:49:23 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:49:23 user nova-compute[75210]:     <video>
Nov 29 01:49:23 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:49:23 user nova-compute[75210]:     </video>
Nov 29 01:49:23 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:49:23 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:49:23 user nova-compute[75210]:     </rng>
Nov 29 01:49:23 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:49:23 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:49:23 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:49:23 user nova-compute[75210]:     </memballoon>
Nov 29 01:49:23 user nova-compute[75210]:   </devices>
Nov 29 01:49:23 user nova-compute[75210]: </domain>
Nov 29 01:49:23 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:49:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-85170163',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-85170163',id=32,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-0mmk0g2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:49:22Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=3df17188-c87e-49e5-9ca2-5d04632ea9bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbebc7dc-3846-49ae-8226-6a9559434359", "address": "fa:16:3e:82:69:38", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbebc7dc-38", "ovs_interfaceid": "fbebc7dc-3846-49ae-8226-6a9559434359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "fbebc7dc-3846-49ae-8226-6a9559434359", "address": "fa:16:3e:82:69:38", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbebc7dc-38", "ovs_interfaceid": "fbebc7dc-3846-49ae-8226-6a9559434359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:69:38,bridge_name='br-int',has_traffic_filtering=True,id=fbebc7dc-3846-49ae-8226-6a9559434359,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbebc7dc-38') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG os_vif [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:69:38,bridge_name='br-int',has_traffic_filtering=True,id=fbebc7dc-3846-49ae-8226-6a9559434359,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbebc7dc-38') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9f473eda-dc12-562b-b298-3c0181b64d66', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbebc7dc-38, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbebc7dc-38, col_values=(('qos', UUID('049fba0b-de66-4e1d-93dc-afac5ea5e48b')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbebc7dc-38, col_values=(('external_ids', {'iface-id': 'fbebc7dc-3846-49ae-8226-6a9559434359', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:69:38', 'vm-uuid': '3df17188-c87e-49e5-9ca2-5d04632ea9bb'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-63596940-f07b-457b-8210-52528f269ce6 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.884s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:23 user nova-compute[75210]: INFO os_vif [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:69:38,bridge_name='br-int',has_traffic_filtering=True,id=fbebc7dc-3846-49ae-8226-6a9559434359,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbebc7dc-38')
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No VIF found with MAC fa:16:3e:82:69:38, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-6fa1d8a4-d00b-40d1-a85d-4e34160cb251 req-76843e9e-9c70-4475-bcc7-cd7b34aa7507 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Updated VIF entry in instance network info cache for port fbebc7dc-3846-49ae-8226-6a9559434359. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-6fa1d8a4-d00b-40d1-a85d-4e34160cb251 req-76843e9e-9c70-4475-bcc7-cd7b34aa7507 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Updating instance_info_cache with network_info: [{"id": "fbebc7dc-3846-49ae-8226-6a9559434359", "address": "fa:16:3e:82:69:38", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbebc7dc-38", "ovs_interfaceid": "fbebc7dc-3846-49ae-8226-6a9559434359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:49:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6fa1d8a4-d00b-40d1-a85d-4e34160cb251 req-76843e9e-9c70-4475-bcc7-cd7b34aa7507 service nova] Releasing lock "refresh_cache-3df17188-c87e-49e5-9ca2-5d04632ea9bb" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '26435376431616662', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435376431616662', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1920078035',display_name='tempest-ServerActionsTestOtherB-server-1920078035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1920078035',id=27,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHTMCtMfKAyfL3sA07wByFhm2FHh83CKtTVWERl3aWtDAO+UO8rfcAbJD3gRH9oGCeL5Ksot/CKwepAmL20m57Zzo2MLfsvimSlewZEfHZ4/WEV9jR4p6/EvJ11L0KWcA==',key_name='tempest-keypair-53471645',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:45:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e7b24c627ca143e49731c22a555eacd1',ramdisk_id='',reservation_id='r-08i4j8ht',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-573973984',owner_user_name='tempest-ServerActionsTestOtherB-573973984-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b16390ddb64b9f8925f3e156bbe8d0',uuid=4fab87e3-2f7c-4db4-9f14-ace1813fe046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1522934833-network", "vif_mac": "fa:16:3e:95:cc:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converting VIF {"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1522934833-network", "vif_mac": "fa:16:3e:95:cc:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:49:24 user nova-compute[75210]:   <uuid>4fab87e3-2f7c-4db4-9f14-ace1813fe046</uuid>
Nov 29 01:49:24 user nova-compute[75210]:   <name>instance-0000001b</name>
Nov 29 01:49:24 user nova-compute[75210]:   <memory>2097152</memory>
Nov 29 01:49:24 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:49:24 user nova-compute[75210]:   <metadata>
Nov 29 01:49:24 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:49:24 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:49:24 user nova-compute[75210]:       <nova:name>tempest-ServerActionsTestOtherB-server-1920078035</nova:name>
Nov 29 01:49:24 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:49:22</nova:creationTime>
Nov 29 01:49:24 user nova-compute[75210]:       <nova:flavor name="m1.small">
Nov 29 01:49:24 user nova-compute[75210]:         <nova:memory>2048</nova:memory>
Nov 29 01:49:24 user nova-compute[75210]:         <nova:disk>20</nova:disk>
Nov 29 01:49:24 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:49:24 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:49:24 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:49:24 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:49:24 user nova-compute[75210]:       <nova:owner>
Nov 29 01:49:24 user nova-compute[75210]:         <nova:user uuid="b9b16390ddb64b9f8925f3e156bbe8d0">tempest-ServerActionsTestOtherB-573973984-project-member</nova:user>
Nov 29 01:49:24 user nova-compute[75210]:         <nova:project uuid="e7b24c627ca143e49731c22a555eacd1">tempest-ServerActionsTestOtherB-573973984</nova:project>
Nov 29 01:49:24 user nova-compute[75210]:       </nova:owner>
Nov 29 01:49:24 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:49:24 user nova-compute[75210]:       <nova:ports>
Nov 29 01:49:24 user nova-compute[75210]:         <nova:port uuid="60309b43-09f2-4bc7-81a2-9c764df78b5d">
Nov 29 01:49:24 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:49:24 user nova-compute[75210]:         </nova:port>
Nov 29 01:49:24 user nova-compute[75210]:       </nova:ports>
Nov 29 01:49:24 user nova-compute[75210]:     </nova:instance>
Nov 29 01:49:24 user nova-compute[75210]:   </metadata>
Nov 29 01:49:24 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:49:24 user nova-compute[75210]:     <system>
Nov 29 01:49:24 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:49:24 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:49:24 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:49:24 user nova-compute[75210]:       <entry name="serial">4fab87e3-2f7c-4db4-9f14-ace1813fe046</entry>
Nov 29 01:49:24 user nova-compute[75210]:       <entry name="uuid">4fab87e3-2f7c-4db4-9f14-ace1813fe046</entry>
Nov 29 01:49:24 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:49:24 user nova-compute[75210]:     </system>
Nov 29 01:49:24 user nova-compute[75210]:   </sysinfo>
Nov 29 01:49:24 user nova-compute[75210]:   <os>
Nov 29 01:49:24 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:49:24 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:49:24 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:49:24 user nova-compute[75210]:   </os>
Nov 29 01:49:24 user nova-compute[75210]:   <features>
Nov 29 01:49:24 user nova-compute[75210]:     <acpi/>
Nov 29 01:49:24 user nova-compute[75210]:     <apic/>
Nov 29 01:49:24 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:49:24 user nova-compute[75210]:   </features>
Nov 29 01:49:24 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:49:24 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:49:24 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:49:24 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:49:24 user nova-compute[75210]:   </clock>
Nov 29 01:49:24 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:49:24 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:49:24 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:49:24 user nova-compute[75210]:   </cpu>
Nov 29 01:49:24 user nova-compute[75210]:   <devices>
Nov 29 01:49:24 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:49:24 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:49:24 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk"/>
Nov 29 01:49:24 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:49:24 user nova-compute[75210]:     </disk>
Nov 29 01:49:24 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:49:24 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:49:24 user nova-compute[75210]:       <source dev="/dev/sdc"/>
Nov 29 01:49:24 user nova-compute[75210]:       <target dev="vdb" bus="virtio"/>
Nov 29 01:49:24 user nova-compute[75210]:       <serial>0701e0ea-4b69-4215-9da7-7a684d683866</serial>
Nov 29 01:49:24 user nova-compute[75210]:     </disk>
Nov 29 01:49:24 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:49:24 user nova-compute[75210]:       <mac address="fa:16:3e:95:cc:d2"/>
Nov 29 01:49:24 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:49:24 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:49:24 user nova-compute[75210]:       <target dev="tap60309b43-09"/>
Nov 29 01:49:24 user nova-compute[75210]:     </interface>
Nov 29 01:49:24 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:49:24 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/console.log" append="off"/>
Nov 29 01:49:24 user nova-compute[75210]:     </serial>
Nov 29 01:49:24 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:49:24 user nova-compute[75210]:     <video>
Nov 29 01:49:24 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:49:24 user nova-compute[75210]:     </video>
Nov 29 01:49:24 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:49:24 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:49:24 user nova-compute[75210]:     </rng>
Nov 29 01:49:24 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:49:24 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:49:24 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:49:24 user nova-compute[75210]:     </memballoon>
Nov 29 01:49:24 user nova-compute[75210]:   </devices>
Nov 29 01:49:24 user nova-compute[75210]: </domain>
Nov 29 01:49:24 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1920078035',display_name='tempest-ServerActionsTestOtherB-server-1920078035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1920078035',id=27,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHTMCtMfKAyfL3sA07wByFhm2FHh83CKtTVWERl3aWtDAO+UO8rfcAbJD3gRH9oGCeL5Ksot/CKwepAmL20m57Zzo2MLfsvimSlewZEfHZ4/WEV9jR4p6/EvJ11L0KWcA==',key_name='tempest-keypair-53471645',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:45:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e7b24c627ca143e49731c22a555eacd1',ramdisk_id='',reservation_id='r-08i4j8ht',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-573973984',owner_user_name='tempest-ServerActionsTestOtherB-573973984-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b16390ddb64b9f8925f3e156bbe8d0',uuid=4fab87e3-2f7c-4db4-9f14-ace1813fe046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1522934833-network", "vif_mac": "fa:16:3e:95:cc:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converting VIF {"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1522934833-network", "vif_mac": "fa:16:3e:95:cc:d2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_vif [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8244a618-66e3-59f1-a9ad-ad44e1a57c8d', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60309b43-09, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60309b43-09, col_values=(('qos', UUID('2736126d-886a-40b4-bae9-f0e437822a61')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60309b43-09, col_values=(('external_ids', {'iface-id': '60309b43-09f2-4bc7-81a2-9c764df78b5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:cc:d2', 'vm-uuid': '4fab87e3-2f7c-4db4-9f14-ace1813fe046'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:24 user nova-compute[75210]: INFO os_vif [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09')
Nov 29 01:49:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] No VIF found with MAC fa:16:3e:95:cc:d2, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grKylMHm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:49:24 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:49:24 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:49:24 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cc26e4-762d-4f92-9409-eb4fbbe39145]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:49:24 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d62b9f-a9b1-42d6-8b49-d109c0c5ea33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1] added
Nov 29 01:49:24 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2208f14-b70b-4be6-9671-cb3bd8a9e4a9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cb3053-43ee-4d50-bf38-3d2d4ff62751]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grKylMHm {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v grKylMHm" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9a0a91-7716-47dc-afb3-99bb19f9ef18]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'grKylMHm'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d30d1d-713c-4c41-a1bb-5044435c1bdb]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbc6e7b-98cb-4e64-bee2-583f1d9ca990]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:24 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:24 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:24 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:49:24 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:24 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:24 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:24 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:49:24 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:49:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11d8b98-9ef3-4d14-ba95-8a2242a2027d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1, portal: 172.16.0.220,3260]
Nov 29 01:49:25 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1, portal: 172.16.0.220,3260] successful.
Nov 29 01:49:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f020880f-ca59-489b-b919-a04b417b1345]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2cbddd-58e8-4e36-88ff-eb7f513610a2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:25 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:25 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:25 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:49:25 user nova-compute[75210]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 (non-flash)
Nov 29 01:49:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:25 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:25 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:25 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:49:25 user nova-compute[75210]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 (non-flash)
Nov 29 01:49:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[31845de9-4da8-49cd-88ea-4439bea31b72]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grKylMHm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23339643137346164', 'path': '/dev/sdf'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339643137346164', 'path': '/dev/sdf'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG nova.objects.instance [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'flavor' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:49:26 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:49:26 user nova-compute[75210]:   <source dev="/dev/sdf"/>
Nov 29 01:49:26 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:49:26 user nova-compute[75210]:   <serial>eff19ecd-f0ea-4dba-883c-bd5d637916e1</serial>
Nov 29 01:49:26 user nova-compute[75210]: </disk>
Nov 29 01:49:26 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-b3bb6dda-eb7c-4cdc-97bb-49647e219838 req-31db0bce-b8ca-4d25-aef4-e986f263a434 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Received event network-vif-plugged-fbebc7dc-3846-49ae-8226-6a9559434359 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b3bb6dda-eb7c-4cdc-97bb-49647e219838 req-31db0bce-b8ca-4d25-aef4-e986f263a434 service nova] Acquiring lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b3bb6dda-eb7c-4cdc-97bb-49647e219838 req-31db0bce-b8ca-4d25-aef4-e986f263a434 service nova] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b3bb6dda-eb7c-4cdc-97bb-49647e219838 req-31db0bce-b8ca-4d25-aef4-e986f263a434 service nova] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-b3bb6dda-eb7c-4cdc-97bb-49647e219838 req-31db0bce-b8ca-4d25-aef4-e986f263a434 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] No waiting events found dispatching network-vif-plugged-fbebc7dc-3846-49ae-8226-6a9559434359 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:49:26 user nova-compute[75210]: WARNING nova.compute.manager [req-b3bb6dda-eb7c-4cdc-97bb-49647e219838 req-31db0bce-b8ca-4d25-aef4-e986f263a434 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Received unexpected event network-vif-plugged-fbebc7dc-3846-49ae-8226-6a9559434359 for instance with vm_state building and task_state spawning.
Nov 29 01:49:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updating instance_info_cache with network_info: [{"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:49:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:49:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:49:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:49:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] No VIF found with MAC fa:16:3e:e2:b3:10, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:49:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-a3a474bc-724d-4a9c-b221-651a72b31f81 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.421s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:27 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:49:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Received event network-vif-plugged-fbebc7dc-3846-49ae-8226-6a9559434359 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:49:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] Acquiring lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] No waiting events found dispatching network-vif-plugged-fbebc7dc-3846-49ae-8226-6a9559434359 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:49:28 user nova-compute[75210]: WARNING nova.compute.manager [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Received unexpected event network-vif-plugged-fbebc7dc-3846-49ae-8226-6a9559434359 for instance with vm_state building and task_state spawning.
Nov 29 01:49:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:49:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] No waiting events found dispatching network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:49:28 user nova-compute[75210]: WARNING nova.compute.manager [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received unexpected event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d for instance with vm_state active and task_state resize_finish.
Nov 29 01:49:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:49:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] No waiting events found dispatching network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:49:28 user nova-compute[75210]: WARNING nova.compute.manager [req-26860229-e7a4-4bb4-8a66-039c73a2f59b req-d50b4ef8-faa0-428a-93bd-bf97c1e3b82a service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received unexpected event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d for instance with vm_state active and task_state resize_finish.
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:49:29 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Instance running successfully.
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Failed to set time: agent not configured {{(pid=75210) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-82fae456-9a3e-46d3-9ed9-10f1098ac648 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] finish_migration finished successfully. {{(pid=75210) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:49:29 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Instance spawned successfully.
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:49:29 user nova-compute[75210]: INFO nova.compute.manager [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Took 7.33 seconds to spawn the instance on the hypervisor.
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:49:29 user nova-compute[75210]: INFO nova.compute.manager [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Took 8.22 seconds to build instance.
Nov 29 01:49:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:29 user nova-compute[75210]: INFO nova.compute.manager [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Detaching volume eff19ecd-f0ea-4dba-883c-bd5d637916e1
Nov 29 01:49:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3a4fc4e6-1efe-451f-9ddc-dbe9d7836169 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.422s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:29 user nova-compute[75210]: INFO nova.virt.block_device [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Attempting to driver detach volume eff19ecd-f0ea-4dba-883c-bd5d637916e1 from mountpoint /dev/vdb
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Attempting to detach device vdb from instance e6c9606c-5a27-417d-9042-259ce728e175 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:49:29 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:49:29 user nova-compute[75210]:   <source dev="/dev/sdf"/>
Nov 29 01:49:29 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:49:29 user nova-compute[75210]:   <serial>eff19ecd-f0ea-4dba-883c-bd5d637916e1</serial>
Nov 29 01:49:29 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:49:29 user nova-compute[75210]: </disk>
Nov 29 01:49:29 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:49:29 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Successfully detached device vdb from instance e6c9606c-5a27-417d-9042-259ce728e175 from the persistent domain config.
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6c9606c-5a27-417d-9042-259ce728e175 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:49:29 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:49:29 user nova-compute[75210]:   <source dev="/dev/sdf"/>
Nov 29 01:49:29 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:49:29 user nova-compute[75210]:   <serial>eff19ecd-f0ea-4dba-883c-bd5d637916e1</serial>
Nov 29 01:49:29 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:49:29 user nova-compute[75210]: </disk>
Nov 29 01:49:29 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:49:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:49:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:49:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:49:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:49:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:49:35 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:49:35 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7498MB free_disk=25.11676788330078GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Applying migration context for instance 4fab87e3-2f7c-4db4-9f14-ace1813fe046 as it has an incoming, in-progress migration f33be2ae-820f-4d4c-92cb-02ec1f06bdd5. Migration status is finished {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 01:49:35 user nova-compute[75210]: INFO nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating resource usage from migration f33be2ae-820f-4d4c-92cb-02ec1f06bdd5
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance e6c9606c-5a27-417d-9042-259ce728e175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c754f3a2-db8d-4619-aa14-462c6b7fc94c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 0a239b54-6717-4f3c-b455-3326a8f0bdc2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c163c27f-4cdd-4984-bd3b-eace62b14106 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Migration f33be2ae-820f-4d4c-92cb-02ec1f06bdd5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 4fab87e3-2f7c-4db4-9f14-ace1813fe046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3df17188-c87e-49e5-9ca2-5d04632ea9bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:49:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:49:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:49:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:49:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:49:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:49 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e6c9606c-5a27-417d-9042-259ce728e175 is timed out.
Nov 29 01:49:49 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Successfully detached device vdb from instance e6c9606c-5a27-417d-9042-259ce728e175 from the live domain config.
Nov 29 01:49:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'grKylMHm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:49:49 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:49:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db35b50-db5b-4efe-a20d-942b3138345d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:49:49 user nova-compute[75210]: No targets found.
Nov 29 01:49:49 user nova-compute[75210]: iSNS:
Nov 29 01:49:49 user nova-compute[75210]: No targets found.
Nov 29 01:49:49 user nova-compute[75210]: STATIC:
Nov 29 01:49:49 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866
Nov 29 01:49:49 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:49 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:49 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:49:49 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:49 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:49 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23
Nov 29 01:49:49 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:49 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:49 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b
Nov 29 01:49:49 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:49 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:49 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1
Nov 29 01:49:49 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:49:49 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:49:49 user nova-compute[75210]: FIRMWARE:
Nov 29 01:49:49 user nova-compute[75210]: No targets found.
Nov 29 01:49:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:49:49 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:49:49 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35e9e09-c392-478b-929e-a26bdef436da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8b37a4-cc46-49a3-afd3-c25f6c4fa211]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:49 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:49 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:49 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:49:49 user nova-compute[75210]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 (non-flash)
Nov 29 01:49:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:49:49 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:49:49 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:49:49 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:49:49 user nova-compute[75210]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 (non-flash)
Nov 29 01:49:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2408428820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1'): ({'sdf'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Removing single pathed devices sdf {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:49:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba57f220-283c-4a7e-b034-0c3f8bb11913]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad54bcfa-4d61-4150-a49e-eee0c6261c0e]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Flushing IO for device /dev/sdf {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15c725d-902a-48dd-809f-cf2c6cad707a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.032s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af374d2-403b-4699-bf3c-fab2308f93a8]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] SCSI volumes sdf have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd12caa7-1890-4263-96d2-9eac5be72e41]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4eb69b-330b-4eaa-a853-82187faebb8b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1, portal: 172.16.0.220,3260]
Nov 29 01:49:50 user nova-compute[75210]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1, portal: 172.16.0.220,3260] successful.
Nov 29 01:49:50 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eff19ecd-f0ea-4dba-883c-bd5d637916e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2f232e-3707-4710-baf1-003a217f8f26]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] <== disconnect_volume: return (304ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:49:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:49:51 user nova-compute[75210]: DEBUG nova.objects.instance [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'flavor' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:49:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-15c04f59-277f-4e0b-8728-f7de47a552e2 tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.761s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:52 user nova-compute[75210]: INFO nova.compute.manager [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Terminating instance
Nov 29 01:49:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-139bc3b9-008e-45de-ad0f-aa6ebb180232 req-37fe9567-247a-46cb-b480-89b58a0e8073 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Received event network-vif-unplugged-1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-139bc3b9-008e-45de-ad0f-aa6ebb180232 req-37fe9567-247a-46cb-b480-89b58a0e8073 service nova] Acquiring lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-139bc3b9-008e-45de-ad0f-aa6ebb180232 req-37fe9567-247a-46cb-b480-89b58a0e8073 service nova] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-139bc3b9-008e-45de-ad0f-aa6ebb180232 req-37fe9567-247a-46cb-b480-89b58a0e8073 service nova] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-139bc3b9-008e-45de-ad0f-aa6ebb180232 req-37fe9567-247a-46cb-b480-89b58a0e8073 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] No waiting events found dispatching network-vif-unplugged-1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-139bc3b9-008e-45de-ad0f-aa6ebb180232 req-37fe9567-247a-46cb-b480-89b58a0e8073 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Received event network-vif-unplugged-1117eeaf-d531-47b1-848a-26b672999bd4 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:49:52 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Instance destroyed successfully.
Nov 29 01:49:52 user nova-compute[75210]: DEBUG nova.objects.instance [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lazy-loading 'resources' on Instance uuid c754f3a2-db8d-4619-aa14-462c6b7fc94c {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:46:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-101343481',display_name='tempest-AttachVolumeNegativeTest-server-101343481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-101343481',id=29,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSd4g+Jxpb5yNT3Eye7G0+L1scoDjeZdB3cNXc+m/jk9m0gPJNNI5oAp+pIZst1K3MUPMux4uwI4b4xNMW3yCLnyn0qUtkM7chsYX5AiRpXEk4eUCCqcBgtH4+GQalzjw==',key_name='tempest-keypair-856703655',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:47:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18f1a3d6f5994f6eb15e0ab2294efd53',ramdisk_id='',reservation_id='r-2n0t29r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-648523364',owner_user_name='tempest-AttachVolumeNegativeTest-648523364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:47:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd39b87d15084d84983873b59f36a211',uuid=c754f3a2-db8d-4619-aa14-462c6b7fc94c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1117eeaf-d531-47b1-848a-26b672999bd4", "address": "fa:16:3e:c9:cc:87", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1117eeaf-d5", "ovs_interfaceid": "1117eeaf-d531-47b1-848a-26b672999bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converting VIF {"id": "1117eeaf-d531-47b1-848a-26b672999bd4", "address": "fa:16:3e:c9:cc:87", "network": {"id": "6e7f3c2e-a0de-4435-9244-91588de93ba2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2116034448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f1a3d6f5994f6eb15e0ab2294efd53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1117eeaf-d5", "ovs_interfaceid": "1117eeaf-d531-47b1-848a-26b672999bd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=1117eeaf-d531-47b1-848a-26b672999bd4,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1117eeaf-d5') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG os_vif [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=1117eeaf-d531-47b1-848a-26b672999bd4,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1117eeaf-d5') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1117eeaf-d5, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=301d6b83-2c89-429c-852a-0e99fa0af887) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:52 user nova-compute[75210]: INFO os_vif [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:cc:87,bridge_name='br-int',has_traffic_filtering=True,id=1117eeaf-d531-47b1-848a-26b672999bd4,network=Network(6e7f3c2e-a0de-4435-9244-91588de93ba2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1117eeaf-d5')
Nov 29 01:49:52 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Deleting instance files /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c_del
Nov 29 01:49:52 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Deletion of /opt/stack/data/nova/instances/c754f3a2-db8d-4619-aa14-462c6b7fc94c_del complete
Nov 29 01:49:53 user nova-compute[75210]: INFO nova.compute.manager [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 01:49:53 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:49:53 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:49:53 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:49:53 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:49:53 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Took 0.68 seconds to deallocate network for instance.
Nov 29 01:49:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:54 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:49:54 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:49:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:54 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Deleted allocations for instance c754f3a2-db8d-4619-aa14-462c6b7fc94c
Nov 29 01:49:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-775d37b4-5958-4fd3-bf14-c1b01d558c14 tempest-AttachVolumeNegativeTest-648523364 tempest-AttachVolumeNegativeTest-648523364-project-member] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.096s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-fe9879ef-72a2-4add-8e25-335a16696241 req-471522b6-0ae2-4e15-8a76-f4a4aee876c5 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Received event network-vif-plugged-1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:49:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fe9879ef-72a2-4add-8e25-335a16696241 req-471522b6-0ae2-4e15-8a76-f4a4aee876c5 service nova] Acquiring lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:49:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fe9879ef-72a2-4add-8e25-335a16696241 req-471522b6-0ae2-4e15-8a76-f4a4aee876c5 service nova] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:49:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fe9879ef-72a2-4add-8e25-335a16696241 req-471522b6-0ae2-4e15-8a76-f4a4aee876c5 service nova] Lock "c754f3a2-db8d-4619-aa14-462c6b7fc94c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:49:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-fe9879ef-72a2-4add-8e25-335a16696241 req-471522b6-0ae2-4e15-8a76-f4a4aee876c5 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] No waiting events found dispatching network-vif-plugged-1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:49:54 user nova-compute[75210]: WARNING nova.compute.manager [req-fe9879ef-72a2-4add-8e25-335a16696241 req-471522b6-0ae2-4e15-8a76-f4a4aee876c5 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Received unexpected event network-vif-plugged-1117eeaf-d531-47b1-848a-26b672999bd4 for instance with vm_state deleted and task_state None.
Nov 29 01:49:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-fe9879ef-72a2-4add-8e25-335a16696241 req-471522b6-0ae2-4e15-8a76-f4a4aee876c5 service nova] [instance: c754f3a2-db8d-4619-aa14-462c6b7fc94c] Received event network-vif-deleted-1117eeaf-d531-47b1-848a-26b672999bd4 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:49:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:49:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:50:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 01:50:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:50:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:50:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:50:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 01:50:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:50:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:50:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-93bc01c4-fe6f-4877-8797-8d7ed54acd42 req-77430350-5400-4c8d-8482-0fa87074f497 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-changed-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:50:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-93bc01c4-fe6f-4877-8797-8d7ed54acd42 req-77430350-5400-4c8d-8482-0fa87074f497 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Refreshing instance network info cache due to event network-changed-87448b14-8dd8-439b-ae2f-7c2e5a0cf813. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:50:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-93bc01c4-fe6f-4877-8797-8d7ed54acd42 req-77430350-5400-4c8d-8482-0fa87074f497 service nova] Acquiring lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:50:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-93bc01c4-fe6f-4877-8797-8d7ed54acd42 req-77430350-5400-4c8d-8482-0fa87074f497 service nova] Acquired lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:50:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-93bc01c4-fe6f-4877-8797-8d7ed54acd42 req-77430350-5400-4c8d-8482-0fa87074f497 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Refreshing network info cache for port 87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:50:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-93bc01c4-fe6f-4877-8797-8d7ed54acd42 req-77430350-5400-4c8d-8482-0fa87074f497 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updated VIF entry in instance network info cache for port 87448b14-8dd8-439b-ae2f-7c2e5a0cf813. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:50:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-93bc01c4-fe6f-4877-8797-8d7ed54acd42 req-77430350-5400-4c8d-8482-0fa87074f497 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updating instance_info_cache with network_info: [{"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:50:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-93bc01c4-fe6f-4877-8797-8d7ed54acd42 req-77430350-5400-4c8d-8482-0fa87074f497 service nova] Releasing lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:50:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:50:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:18 user nova-compute[75210]: INFO nova.compute.manager [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Shelve offloading
Nov 29 01:50:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-06563ba9-b550-460b-bd68-8aaca2aebb79 req-7fd13fc1-8d0e-4932-b3fd-7c16ed5ae1f8 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-vif-unplugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:50:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-06563ba9-b550-460b-bd68-8aaca2aebb79 req-7fd13fc1-8d0e-4932-b3fd-7c16ed5ae1f8 service nova] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-06563ba9-b550-460b-bd68-8aaca2aebb79 req-7fd13fc1-8d0e-4932-b3fd-7c16ed5ae1f8 service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-06563ba9-b550-460b-bd68-8aaca2aebb79 req-7fd13fc1-8d0e-4932-b3fd-7c16ed5ae1f8 service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-06563ba9-b550-460b-bd68-8aaca2aebb79 req-7fd13fc1-8d0e-4932-b3fd-7c16ed5ae1f8 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] No waiting events found dispatching network-vif-unplugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:50:18 user nova-compute[75210]: WARNING nova.compute.manager [req-06563ba9-b550-460b-bd68-8aaca2aebb79 req-7fd13fc1-8d0e-4932-b3fd-7c16ed5ae1f8 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received unexpected event network-vif-unplugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 for instance with vm_state active and task_state shelving.
Nov 29 01:50:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:19 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Instance destroyed successfully.
Nov 29 01:50:19 user nova-compute[75210]: DEBUG nova.compute.manager [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:50:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:50:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquired lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:50:19 user nova-compute[75210]: DEBUG nova.network.neutron [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:50:19 user nova-compute[75210]: DEBUG nova.network.neutron [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updating instance_info_cache with network_info: [{"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:50:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Releasing lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:50:19 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Instance destroyed successfully.
Nov 29 01:50:19 user nova-compute[75210]: DEBUG nova.objects.instance [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lazy-loading 'resources' on Instance uuid 0a239b54-6717-4f3c-b455-3326a8f0bdc2 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-243949346',display_name='tempest-TestShelveInstance-server-243949346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-243949346',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4LjG3IxpsBiQB9Qf7TjHQ7xubkfSfT2Y2dVPvS9ktTV/GSTtT/jspevE88d67HvvQ4SnunUkS0tgiRglqXBUBVtnsF9YzJyyu8vYLLd8WblCCvlG4YEXAmyTXpLTjMhQ==',key_name='tempest-TestShelveInstance-1194317885',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3bf4d56ff4eb43269de28f4acb4578b5',ramdisk_id='',reservation_id='r-713d5ykr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1973174297',owner_user_name='tempest-TestShelveInstance-1973174297-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:48:41Z,user_data=None,user_id='cd46d52d26394d0190fb0060bc2311f1',uuid=0a239b54-6717-4f3c-b455-3326a8f0bdc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Converting VIF {"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_vif [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87448b14-8d, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=346d36b7-f931-47a1-86f2-7101b5525a46) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG nova.compute.manager [req-0beab2ec-6158-4382-b498-86c0633d61a4 req-af8bc06b-5db7-4cbd-b666-d51cdef71c93 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-changed-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG nova.compute.manager [req-0beab2ec-6158-4382-b498-86c0633d61a4 req-af8bc06b-5db7-4cbd-b666-d51cdef71c93 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Refreshing instance network info cache due to event network-changed-87448b14-8dd8-439b-ae2f-7c2e5a0cf813. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0beab2ec-6158-4382-b498-86c0633d61a4 req-af8bc06b-5db7-4cbd-b666-d51cdef71c93 service nova] Acquiring lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0beab2ec-6158-4382-b498-86c0633d61a4 req-af8bc06b-5db7-4cbd-b666-d51cdef71c93 service nova] Acquired lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG nova.network.neutron [req-0beab2ec-6158-4382-b498-86c0633d61a4 req-af8bc06b-5db7-4cbd-b666-d51cdef71c93 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Refreshing network info cache for port 87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:50:20 user nova-compute[75210]: INFO os_vif [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d')
Nov 29 01:50:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTOXPUgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:50:20 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5f3802-f7f0-4d0b-a84c-28fab1c56f7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:50:20 user nova-compute[75210]: No targets found.
Nov 29 01:50:20 user nova-compute[75210]: iSNS:
Nov 29 01:50:20 user nova-compute[75210]: No targets found.
Nov 29 01:50:20 user nova-compute[75210]: STATIC:
Nov 29 01:50:20 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866
Nov 29 01:50:20 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:50:20 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:50:20 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:50:20 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:50:20 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:50:20 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23
Nov 29 01:50:20 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:50:20 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:50:20 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b
Nov 29 01:50:20 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:50:20 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:50:20 user nova-compute[75210]: FIRMWARE:
Nov 29 01:50:20 user nova-compute[75210]: No targets found.
Nov 29 01:50:20 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:50:20 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:50:20 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4b6c4f-6415-4081-b736-e56c310759bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c8c24b-f5d2-4718-a868-772c98aeae33]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:50:20 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:50:20 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:50:20 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:50:20 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:50:20 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:50:20 user nova-compute[75210]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:50:20 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:50:20 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4e0d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23'): ({'sde'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Removing single pathed devices sde {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[470cd907-6a96-4a9d-9af5-cc207ce6f138]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[122c708b-c63a-4668-8637-ddabc0308439]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Flushing IO for device /dev/sde {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[980dedec-cec4-4201-af11-f4bba972eec1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3548507-e80e-41d6-ba2a-fb0f1c57ec19]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f511cda3-9c52-497e-88f5-4bf0627f42ad]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[192c50d0-087d-4ebf-ba72-7a8131b5f147]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260]
Nov 29 01:50:20 user nova-compute[75210]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260] successful.
Nov 29 01:50:20 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5976e8-2a60-4617-821f-b8505252cfaf]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] <== disconnect_volume: return (316ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:50:20 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Deleting instance files /opt/stack/data/nova/instances/0a239b54-6717-4f3c-b455-3326a8f0bdc2_del
Nov 29 01:50:20 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Deletion of /opt/stack/data/nova/instances/0a239b54-6717-4f3c-b455-3326a8f0bdc2_del complete
Nov 29 01:50:20 user nova-compute[75210]: DEBUG nova.network.neutron [req-0beab2ec-6158-4382-b498-86c0633d61a4 req-af8bc06b-5db7-4cbd-b666-d51cdef71c93 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updated VIF entry in instance network info cache for port 87448b14-8dd8-439b-ae2f-7c2e5a0cf813. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG nova.network.neutron [req-0beab2ec-6158-4382-b498-86c0633d61a4 req-af8bc06b-5db7-4cbd-b666-d51cdef71c93 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updating instance_info_cache with network_info: [{"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": null, "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap87448b14-8d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0beab2ec-6158-4382-b498-86c0633d61a4 req-af8bc06b-5db7-4cbd-b666-d51cdef71c93 service nova] Releasing lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG nova.compute.manager [req-8f8a8dc6-012a-4fc7-b566-64862524d7be req-c9ce0a2e-e5c8-4d35-959f-90f08b911425 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8f8a8dc6-012a-4fc7-b566-64862524d7be req-c9ce0a2e-e5c8-4d35-959f-90f08b911425 service nova] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8f8a8dc6-012a-4fc7-b566-64862524d7be req-c9ce0a2e-e5c8-4d35-959f-90f08b911425 service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8f8a8dc6-012a-4fc7-b566-64862524d7be req-c9ce0a2e-e5c8-4d35-959f-90f08b911425 service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:20 user nova-compute[75210]: DEBUG nova.compute.manager [req-8f8a8dc6-012a-4fc7-b566-64862524d7be req-c9ce0a2e-e5c8-4d35-959f-90f08b911425 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] No waiting events found dispatching network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:50:20 user nova-compute[75210]: WARNING nova.compute.manager [req-8f8a8dc6-012a-4fc7-b566-64862524d7be req-c9ce0a2e-e5c8-4d35-959f-90f08b911425 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received unexpected event network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 for instance with vm_state active and task_state shelving.
Nov 29 01:50:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:21 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Deleted allocations for instance 0a239b54-6717-4f3c-b455-3326a8f0bdc2
Nov 29 01:50:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:21 user nova-compute[75210]: DEBUG nova.objects.instance [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lazy-loading 'numa_topology' on Instance uuid 0a239b54-6717-4f3c-b455-3326a8f0bdc2 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:50:21 user nova-compute[75210]: DEBUG nova.objects.base [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Object Instance<0a239b54-6717-4f3c-b455-3326a8f0bdc2> lazy-loaded attributes: resources,numa_topology {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:50:21 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:50:21 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:50:21 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:50:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-335e856d-21ce-46f7-8c7f-610612beabbc tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.546s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:25 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:50:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:26 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:50:26 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:50:27 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:50:27 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:50:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:50:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:50:27 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:50:27 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Updating instance_info_cache with network_info: [{"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:50:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:50:27 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:50:29 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:50:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:50:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:50:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:30 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:50:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:50:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:50:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:35 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:50:35 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7602MB free_disk=25.11499786376953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Applying migration context for instance 4fab87e3-2f7c-4db4-9f14-ace1813fe046 as it has an incoming, in-progress migration f33be2ae-820f-4d4c-92cb-02ec1f06bdd5. Migration status is finished {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 01:50:35 user nova-compute[75210]: INFO nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating resource usage from migration f33be2ae-820f-4d4c-92cb-02ec1f06bdd5
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance e6c9606c-5a27-417d-9042-259ce728e175 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c163c27f-4cdd-4984-bd3b-eace62b14106 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Migration f33be2ae-820f-4d4c-92cb-02ec1f06bdd5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 4fab87e3-2f7c-4db4-9f14-ace1813fe046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3df17188-c87e-49e5-9ca2-5d04632ea9bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "c320d76b-58e8-4032-bef3-3aead513231e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:35 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:50:36 user nova-compute[75210]: INFO nova.compute.claims [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Claim successful on node user
Nov 29 01:50:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-dcddc7c0-2a89-4bcd-baef-a5677c7169da req-b9e4bbef-cfa5-4830-a5e2-90ef01a311f6 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Received event network-changed-fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-dcddc7c0-2a89-4bcd-baef-a5677c7169da req-b9e4bbef-cfa5-4830-a5e2-90ef01a311f6 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Refreshing instance network info cache due to event network-changed-fbe23d5a-6995-423e-b74f-bcf005dfe21a. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dcddc7c0-2a89-4bcd-baef-a5677c7169da req-b9e4bbef-cfa5-4830-a5e2-90ef01a311f6 service nova] Acquiring lock "refresh_cache-c163c27f-4cdd-4984-bd3b-eace62b14106" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dcddc7c0-2a89-4bcd-baef-a5677c7169da req-b9e4bbef-cfa5-4830-a5e2-90ef01a311f6 service nova] Acquired lock "refresh_cache-c163c27f-4cdd-4984-bd3b-eace62b14106" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.network.neutron [req-dcddc7c0-2a89-4bcd-baef-a5677c7169da req-b9e4bbef-cfa5-4830-a5e2-90ef01a311f6 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Refreshing network info cache for port fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.network.neutron [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:50:36 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:50:36 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Creating image(s)
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "/opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "/opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "/opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG nova.policy [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '339a0127c78144a989498320081f2c15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea74c32e3354c9bb76465b39f437026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "c163c27f-4cdd-4984-bd3b-eace62b14106" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk 1073741824" returned: 0 in 0.058s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG nova.network.neutron [req-dcddc7c0-2a89-4bcd-baef-a5677c7169da req-b9e4bbef-cfa5-4830-a5e2-90ef01a311f6 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Updated VIF entry in instance network info cache for port fbe23d5a-6995-423e-b74f-bcf005dfe21a. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG nova.network.neutron [req-dcddc7c0-2a89-4bcd-baef-a5677c7169da req-b9e4bbef-cfa5-4830-a5e2-90ef01a311f6 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Updating instance_info_cache with network_info: [{"id": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "address": "fa:16:3e:c9:c0:98", "network": {"id": "0b0059b2-e0a1-4d16-beee-c6fdf4a04431", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518067088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ed239b27cbd47a0a1ce5246177a992e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe23d5a-69", "ovs_interfaceid": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG nova.objects.instance [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lazy-loading 'flavor' on Instance uuid c163c27f-4cdd-4984-bd3b-eace62b14106 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dcddc7c0-2a89-4bcd-baef-a5677c7169da req-b9e4bbef-cfa5-4830-a5e2-90ef01a311f6 service nova] Releasing lock "refresh_cache-c163c27f-4cdd-4984-bd3b-eace62b14106" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "c163c27f-4cdd-4984-bd3b-eace62b14106" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:37 user nova-compute[75210]: INFO nova.compute.manager [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Attaching volume 75cae315-af7b-4d9d-9e6a-de12e9f897e2 to /dev/vdb
Nov 29 01:50:37 user nova-compute[75210]: DEBUG os_brick.utils [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e30ba3f-f350-4b1a-9afd-3b864af1d32b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Cannot resize image /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Ensure instance console log exists: /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd42193-d6a4-451a-a50d-7a50740ea475]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4aaee9-3daf-4855-90ae-ec2b5821b8af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bbc6a4-f79a-4c1b-a4e3-cdbd202cfd46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:50:37 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:50:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[655c8954-a146-4167-bd25-7e6830c5298d]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG os_brick.utils [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Updating existing volume attachment record: 2fb51bc9-6d76-497f-9044-76f8a0ba7ae4 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:50:37 user nova-compute[75210]: DEBUG nova.network.neutron [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Successfully created port: 312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.network.neutron [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Successfully updated port: 312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquired lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.network.neutron [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-f598cdf1-73a9-42c4-a584-f1a895910870 req-55737e8c-4a03-4ee9-95c0-a06492fcba27 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-changed-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-f598cdf1-73a9-42c4-a584-f1a895910870 req-55737e8c-4a03-4ee9-95c0-a06492fcba27 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Refreshing instance network info cache due to event network-changed-312421b0-0d55-4735-9810-310e70a30881. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f598cdf1-73a9-42c4-a584-f1a895910870 req-55737e8c-4a03-4ee9-95c0-a06492fcba27 service nova] Acquiring lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.network.neutron [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.network.neutron [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Updating instance_info_cache with network_info: [{"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Releasing lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Instance network_info: |[{"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f598cdf1-73a9-42c4-a584-f1a895910870 req-55737e8c-4a03-4ee9-95c0-a06492fcba27 service nova] Acquired lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.network.neutron [req-f598cdf1-73a9-42c4-a584-f1a895910870 req-55737e8c-4a03-4ee9-95c0-a06492fcba27 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Refreshing network info cache for port 312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Start _get_guest_xml network_info=[{"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:50:38 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:50:38 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:50:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-849162623',display_name='tempest-ServerRescueNegativeTestJSON-server-849162623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-849162623',id=33,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJg8slG8367U75ZSuTZzcgZW/XtJwbbU3K3GG0kWtPdNOpehMl9ysb0/U5N2JjcTlVneKBPkybYoSEOg0i9hlNe1spmrLC+aGK+IZC9PmV/YWkG+JGEWRilkYLgKZ0O2A==',key_name='tempest-keypair-780592974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea74c32e3354c9bb76465b39f437026',ramdisk_id='',reservation_id='r-pvgqd49k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-948038897',owner_user_name='tempest-ServerRescueNegativeTestJSON-948038897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='339a0127c78144a989498320081f2c15',uuid=c320d76b-58e8-4032-bef3-3aead513231e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converting VIF {"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:49:51,bridge_name='br-int',has_traffic_filtering=True,id=312421b0-0d55-4735-9810-310e70a30881,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312421b0-0d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.objects.instance [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'pci_devices' on Instance uuid c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:50:38 user nova-compute[75210]:   <uuid>c320d76b-58e8-4032-bef3-3aead513231e</uuid>
Nov 29 01:50:38 user nova-compute[75210]:   <name>instance-00000021</name>
Nov 29 01:50:38 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:50:38 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:50:38 user nova-compute[75210]:   <metadata>
Nov 29 01:50:38 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:50:38 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:50:38 user nova-compute[75210]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-849162623</nova:name>
Nov 29 01:50:38 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:50:38</nova:creationTime>
Nov 29 01:50:38 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:50:38 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:50:38 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:50:38 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:50:38 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:50:38 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:50:38 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:50:38 user nova-compute[75210]:       <nova:owner>
Nov 29 01:50:38 user nova-compute[75210]:         <nova:user uuid="339a0127c78144a989498320081f2c15">tempest-ServerRescueNegativeTestJSON-948038897-project-member</nova:user>
Nov 29 01:50:38 user nova-compute[75210]:         <nova:project uuid="9ea74c32e3354c9bb76465b39f437026">tempest-ServerRescueNegativeTestJSON-948038897</nova:project>
Nov 29 01:50:38 user nova-compute[75210]:       </nova:owner>
Nov 29 01:50:38 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:50:38 user nova-compute[75210]:       <nova:ports>
Nov 29 01:50:38 user nova-compute[75210]:         <nova:port uuid="312421b0-0d55-4735-9810-310e70a30881">
Nov 29 01:50:38 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 01:50:38 user nova-compute[75210]:         </nova:port>
Nov 29 01:50:38 user nova-compute[75210]:       </nova:ports>
Nov 29 01:50:38 user nova-compute[75210]:     </nova:instance>
Nov 29 01:50:38 user nova-compute[75210]:   </metadata>
Nov 29 01:50:38 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:50:38 user nova-compute[75210]:     <system>
Nov 29 01:50:38 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:50:38 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:50:38 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:50:38 user nova-compute[75210]:       <entry name="serial">c320d76b-58e8-4032-bef3-3aead513231e</entry>
Nov 29 01:50:38 user nova-compute[75210]:       <entry name="uuid">c320d76b-58e8-4032-bef3-3aead513231e</entry>
Nov 29 01:50:38 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:50:38 user nova-compute[75210]:     </system>
Nov 29 01:50:38 user nova-compute[75210]:   </sysinfo>
Nov 29 01:50:38 user nova-compute[75210]:   <os>
Nov 29 01:50:38 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:50:38 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:50:38 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:50:38 user nova-compute[75210]:   </os>
Nov 29 01:50:38 user nova-compute[75210]:   <features>
Nov 29 01:50:38 user nova-compute[75210]:     <acpi/>
Nov 29 01:50:38 user nova-compute[75210]:     <apic/>
Nov 29 01:50:38 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:50:38 user nova-compute[75210]:   </features>
Nov 29 01:50:38 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:50:38 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:50:38 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:50:38 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:50:38 user nova-compute[75210]:   </clock>
Nov 29 01:50:38 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:50:38 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:50:38 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:50:38 user nova-compute[75210]:   </cpu>
Nov 29 01:50:38 user nova-compute[75210]:   <devices>
Nov 29 01:50:38 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:50:38 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:50:38 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk"/>
Nov 29 01:50:38 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:50:38 user nova-compute[75210]:     </disk>
Nov 29 01:50:38 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:50:38 user nova-compute[75210]:       <mac address="fa:16:3e:f3:49:51"/>
Nov 29 01:50:38 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:50:38 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:50:38 user nova-compute[75210]:       <target dev="tap312421b0-0d"/>
Nov 29 01:50:38 user nova-compute[75210]:     </interface>
Nov 29 01:50:38 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:50:38 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/console.log" append="off"/>
Nov 29 01:50:38 user nova-compute[75210]:     </serial>
Nov 29 01:50:38 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:50:38 user nova-compute[75210]:     <video>
Nov 29 01:50:38 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:50:38 user nova-compute[75210]:     </video>
Nov 29 01:50:38 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:50:38 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:50:38 user nova-compute[75210]:     </rng>
Nov 29 01:50:38 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:50:38 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:50:38 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:50:38 user nova-compute[75210]:     </memballoon>
Nov 29 01:50:38 user nova-compute[75210]:   </devices>
Nov 29 01:50:38 user nova-compute[75210]: </domain>
Nov 29 01:50:38 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:50:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-849162623',display_name='tempest-ServerRescueNegativeTestJSON-server-849162623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-849162623',id=33,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJg8slG8367U75ZSuTZzcgZW/XtJwbbU3K3GG0kWtPdNOpehMl9ysb0/U5N2JjcTlVneKBPkybYoSEOg0i9hlNe1spmrLC+aGK+IZC9PmV/YWkG+JGEWRilkYLgKZ0O2A==',key_name='tempest-keypair-780592974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ea74c32e3354c9bb76465b39f437026',ramdisk_id='',reservation_id='r-pvgqd49k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-948038897',owner_user_name='tempest-ServerRescueNegativeTestJSON-948038897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='339a0127c78144a989498320081f2c15',uuid=c320d76b-58e8-4032-bef3-3aead513231e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converting VIF {"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:49:51,bridge_name='br-int',has_traffic_filtering=True,id=312421b0-0d55-4735-9810-310e70a30881,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312421b0-0d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG os_vif [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:49:51,bridge_name='br-int',has_traffic_filtering=True,id=312421b0-0d55-4735-9810-310e70a30881,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312421b0-0d') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c241d7c6-6623-5c54-9f23-a9d50173d89c', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap312421b0-0d, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap312421b0-0d, col_values=(('qos', UUID('507b9707-f7ce-47b4-8f1d-e578e84458d5')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap312421b0-0d, col_values=(('external_ids', {'iface-id': '312421b0-0d55-4735-9810-310e70a30881', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:49:51', 'vm-uuid': 'c320d76b-58e8-4032-bef3-3aead513231e'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:38 user nova-compute[75210]: INFO os_vif [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:49:51,bridge_name='br-int',has_traffic_filtering=True,id=312421b0-0d55-4735-9810-310e70a30881,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312421b0-0d')
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:50:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No VIF found with MAC fa:16:3e:f3:49:51, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:50:39 user nova-compute[75210]: DEBUG nova.network.neutron [req-f598cdf1-73a9-42c4-a584-f1a895910870 req-55737e8c-4a03-4ee9-95c0-a06492fcba27 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Updated VIF entry in instance network info cache for port 312421b0-0d55-4735-9810-310e70a30881. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:50:39 user nova-compute[75210]: DEBUG nova.network.neutron [req-f598cdf1-73a9-42c4-a584-f1a895910870 req-55737e8c-4a03-4ee9-95c0-a06492fcba27 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Updating instance_info_cache with network_info: [{"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:50:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f598cdf1-73a9-42c4-a584-f1a895910870 req-55737e8c-4a03-4ee9-95c0-a06492fcba27 service nova] Releasing lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:50:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-a8c956f9-ce0a-49b1-8666-bbc5f33eda03 req-0ec6cef5-b5cd-4d2a-ac32-0ad4be72290b service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:50:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a8c956f9-ce0a-49b1-8666-bbc5f33eda03 req-0ec6cef5-b5cd-4d2a-ac32-0ad4be72290b service nova] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a8c956f9-ce0a-49b1-8666-bbc5f33eda03 req-0ec6cef5-b5cd-4d2a-ac32-0ad4be72290b service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a8c956f9-ce0a-49b1-8666-bbc5f33eda03 req-0ec6cef5-b5cd-4d2a-ac32-0ad4be72290b service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-a8c956f9-ce0a-49b1-8666-bbc5f33eda03 req-0ec6cef5-b5cd-4d2a-ac32-0ad4be72290b service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] No waiting events found dispatching network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:50:40 user nova-compute[75210]: WARNING nova.compute.manager [req-a8c956f9-ce0a-49b1-8666-bbc5f33eda03 req-0ec6cef5-b5cd-4d2a-ac32-0ad4be72290b service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received unexpected event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 for instance with vm_state building and task_state spawning.
Nov 29 01:50:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:41 user nova-compute[75210]: INFO nova.compute.manager [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Detaching volume 12057d3a-a4d5-4feb-a093-4dcc0dd5858b
Nov 29 01:50:41 user nova-compute[75210]: INFO nova.virt.block_device [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Attempting to driver detach volume 12057d3a-a4d5-4feb-a093-4dcc0dd5858b from mountpoint /dev/vdb
Nov 29 01:50:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Attempting to detach device vdb from instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:50:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:50:41 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:50:41 user nova-compute[75210]:   <source dev="/dev/sdd"/>
Nov 29 01:50:41 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:50:41 user nova-compute[75210]:   <serial>12057d3a-a4d5-4feb-a093-4dcc0dd5858b</serial>
Nov 29 01:50:41 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 01:50:41 user nova-compute[75210]: </disk>
Nov 29 01:50:41 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:50:41 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Successfully detached device vdb from instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 from the persistent domain config.
Nov 29 01:50:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:50:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:50:41 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:50:41 user nova-compute[75210]:   <source dev="/dev/sdd"/>
Nov 29 01:50:41 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:50:41 user nova-compute[75210]:   <serial>12057d3a-a4d5-4feb-a093-4dcc0dd5858b</serial>
Nov 29 01:50:41 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 01:50:41 user nova-compute[75210]: </disk>
Nov 29 01:50:41 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:50:42 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Instance spawned successfully.
Nov 29 01:50:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:50:42 user nova-compute[75210]: INFO nova.compute.manager [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 29 01:50:42 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-1a70eb2d-56a7-4f23-b2f0-54d928e739c8 req-1a398eea-ce95-4b14-b0ac-f55372198567 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a70eb2d-56a7-4f23-b2f0-54d928e739c8 req-1a398eea-ce95-4b14-b0ac-f55372198567 service nova] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a70eb2d-56a7-4f23-b2f0-54d928e739c8 req-1a398eea-ce95-4b14-b0ac-f55372198567 service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a70eb2d-56a7-4f23-b2f0-54d928e739c8 req-1a398eea-ce95-4b14-b0ac-f55372198567 service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-1a70eb2d-56a7-4f23-b2f0-54d928e739c8 req-1a398eea-ce95-4b14-b0ac-f55372198567 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] No waiting events found dispatching network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:50:42 user nova-compute[75210]: WARNING nova.compute.manager [req-1a70eb2d-56a7-4f23-b2f0-54d928e739c8 req-1a398eea-ce95-4b14-b0ac-f55372198567 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received unexpected event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 for instance with vm_state building and task_state spawning.
Nov 29 01:50:42 user nova-compute[75210]: INFO nova.compute.manager [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Took 6.59 seconds to build instance.
Nov 29 01:50:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aab5a847-7ab2-4c25-a137-4dd1eb8796e0 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "c320d76b-58e8-4032-bef3-3aead513231e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.694s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:52 user nova-compute[75210]: INFO nova.compute.manager [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Terminating instance
Nov 29 01:50:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-2bc66e97-b6d4-4382-b59e-ef4dffce2aa0 req-93aae9cd-673a-43a8-a722-35d70b9ba69c service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Received event network-vif-unplugged-8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2bc66e97-b6d4-4382-b59e-ef4dffce2aa0 req-93aae9cd-673a-43a8-a722-35d70b9ba69c service nova] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2bc66e97-b6d4-4382-b59e-ef4dffce2aa0 req-93aae9cd-673a-43a8-a722-35d70b9ba69c service nova] Lock "e6c9606c-5a27-417d-9042-259ce728e175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2bc66e97-b6d4-4382-b59e-ef4dffce2aa0 req-93aae9cd-673a-43a8-a722-35d70b9ba69c service nova] Lock "e6c9606c-5a27-417d-9042-259ce728e175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-2bc66e97-b6d4-4382-b59e-ef4dffce2aa0 req-93aae9cd-673a-43a8-a722-35d70b9ba69c service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] No waiting events found dispatching network-vif-unplugged-8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:50:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-2bc66e97-b6d4-4382-b59e-ef4dffce2aa0 req-93aae9cd-673a-43a8-a722-35d70b9ba69c service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Received event network-vif-unplugged-8e683807-4401-4160-a0b1-ae1ca4cc8090 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:50:53 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Instance destroyed successfully.
Nov 29 01:50:53 user nova-compute[75210]: DEBUG nova.objects.instance [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lazy-loading 'resources' on Instance uuid e6c9606c-5a27-417d-9042-259ce728e175 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-914681952',display_name='tempest-SnapshotDataIntegrityTests-server-914681952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-914681952',id=25,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ6wB3gArsZkZF2e8kKsKi8a9Er8TCCCw6nlqeyt8tHH5hnAoAalRHJjcn8/zPVTHhudbv0KYwal2GvI1cPgFCUrJlm8uJngy+awxHg5/ksZL3DZ1sDEvdhR+W0sEd+5A==',key_name='tempest-keypair-1960420796',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:43:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f125ec37cd94d9eb54cd9ecc2343331',ramdisk_id='',reservation_id='r-0neusz4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2070297232',owner_user_name='tempest-SnapshotDataIntegrityTests-2070297232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b06e3329c840ee909d50b211f975d1',uuid=e6c9606c-5a27-417d-9042-259ce728e175,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "address": "fa:16:3e:e2:b3:10", "network": {"id": "0cf68b22-09b9-450b-9c93-c653686008ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1379362399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f125ec37cd94d9eb54cd9ecc2343331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e683807-44", "ovs_interfaceid": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Converting VIF {"id": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "address": "fa:16:3e:e2:b3:10", "network": {"id": "0cf68b22-09b9-450b-9c93-c653686008ac", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1379362399-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f125ec37cd94d9eb54cd9ecc2343331", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e683807-44", "ovs_interfaceid": "8e683807-4401-4160-a0b1-ae1ca4cc8090", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:b3:10,bridge_name='br-int',has_traffic_filtering=True,id=8e683807-4401-4160-a0b1-ae1ca4cc8090,network=Network(0cf68b22-09b9-450b-9c93-c653686008ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e683807-44') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG os_vif [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:b3:10,bridge_name='br-int',has_traffic_filtering=True,id=8e683807-4401-4160-a0b1-ae1ca4cc8090,network=Network(0cf68b22-09b9-450b-9c93-c653686008ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e683807-44') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e683807-44, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10485f25-3fef-43d4-a680-965aa2c748c4) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:53 user nova-compute[75210]: INFO os_vif [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:b3:10,bridge_name='br-int',has_traffic_filtering=True,id=8e683807-4401-4160-a0b1-ae1ca4cc8090,network=Network(0cf68b22-09b9-450b-9c93-c653686008ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e683807-44')
Nov 29 01:50:53 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Deleting instance files /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175_del
Nov 29 01:50:53 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Deletion of /opt/stack/data/nova/instances/e6c9606c-5a27-417d-9042-259ce728e175_del complete
Nov 29 01:50:53 user nova-compute[75210]: INFO nova.compute.manager [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 01:50:53 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:50:53 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: e6c9606c-5a27-417d-9042-259ce728e175] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:50:54 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:50:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-b6c3d632-5ef2-49ea-8630-c8602e37db39 req-f6a32689-b29e-4735-a51b-a93b2c54f006 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Received event network-vif-deleted-8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:50:54 user nova-compute[75210]: INFO nova.compute.manager [req-b6c3d632-5ef2-49ea-8630-c8602e37db39 req-f6a32689-b29e-4735-a51b-a93b2c54f006 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Neutron deleted interface 8e683807-4401-4160-a0b1-ae1ca4cc8090; detaching it from the instance and deleting it from the info cache
Nov 29 01:50:54 user nova-compute[75210]: DEBUG nova.network.neutron [req-b6c3d632-5ef2-49ea-8630-c8602e37db39 req-f6a32689-b29e-4735-a51b-a93b2c54f006 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:50:54 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Took 1.09 seconds to deallocate network for instance.
Nov 29 01:50:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-b6c3d632-5ef2-49ea-8630-c8602e37db39 req-f6a32689-b29e-4735-a51b-a93b2c54f006 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Detach interface failed, port_id=8e683807-4401-4160-a0b1-ae1ca4cc8090, reason: Instance e6c9606c-5a27-417d-9042-259ce728e175 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:50:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:54 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:50:54 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:50:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-b247d460-c2ed-420c-8ef9-66f0c5bff00f req-c9ade8ef-a403-48d7-9c47-7b6ebf34e2c5 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Received event network-vif-plugged-8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:50:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b247d460-c2ed-420c-8ef9-66f0c5bff00f req-c9ade8ef-a403-48d7-9c47-7b6ebf34e2c5 service nova] Acquiring lock "e6c9606c-5a27-417d-9042-259ce728e175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:50:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b247d460-c2ed-420c-8ef9-66f0c5bff00f req-c9ade8ef-a403-48d7-9c47-7b6ebf34e2c5 service nova] Lock "e6c9606c-5a27-417d-9042-259ce728e175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:50:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b247d460-c2ed-420c-8ef9-66f0c5bff00f req-c9ade8ef-a403-48d7-9c47-7b6ebf34e2c5 service nova] Lock "e6c9606c-5a27-417d-9042-259ce728e175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-b247d460-c2ed-420c-8ef9-66f0c5bff00f req-c9ade8ef-a403-48d7-9c47-7b6ebf34e2c5 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] No waiting events found dispatching network-vif-plugged-8e683807-4401-4160-a0b1-ae1ca4cc8090 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:50:54 user nova-compute[75210]: WARNING nova.compute.manager [req-b247d460-c2ed-420c-8ef9-66f0c5bff00f req-c9ade8ef-a403-48d7-9c47-7b6ebf34e2c5 service nova] [instance: e6c9606c-5a27-417d-9042-259ce728e175] Received unexpected event network-vif-plugged-8e683807-4401-4160-a0b1-ae1ca4cc8090 for instance with vm_state deleted and task_state None.
Nov 29 01:50:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:54 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Deleted allocations for instance e6c9606c-5a27-417d-9042-259ce728e175
Nov 29 01:50:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4838d1a8-e661-4e73-acf7-4cbba374ec3c tempest-SnapshotDataIntegrityTests-2070297232 tempest-SnapshotDataIntegrityTests-2070297232-project-member] Lock "e6c9606c-5a27-417d-9042-259ce728e175" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.574s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVlrTwxW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:50:55 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:50:55 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:50:55 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c47f1f-359e-408f-94b5-fd8e5df4be85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:50:55 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c3a33e-6a06-42c7-9434-1878dd403cf6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2] added
Nov 29 01:50:55 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[07402d86-4cbe-4375-a2fe-e232a47e6f38]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[439b4ac9-308c-4676-8b3d-d081e8098b9d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVlrTwxW {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVlrTwxW" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9e5b7b-7390-43dc-a94f-341563b96273]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iVlrTwxW'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[668dd92e-bef6-4cdd-9c3f-126a6ca19b33]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[03336516-c07e-4b15-bc49-6e0a1d7dd5c7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:50:55 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:50:55 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:50:55 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:50:55 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:50:55 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:50:55 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30f76b6-c3eb-4e8a-8038-2a5e0347861a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2, portal: 172.16.0.220,3260]
Nov 29 01:50:55 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2, portal: 172.16.0.220,3260] successful.
Nov 29 01:50:55 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd41047e-ab69-425a-a730-617be14a4097]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e3290e-70e1-4760-b16a-98a0be52d920]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:50:55 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:50:55 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:50:55 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:50:55 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:50:55 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:50:55 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:50:55 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:50:55 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b30b06-dc90-4e1a-8004-22adf46abb06]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:50:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVlrTwxW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:50:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:50:56 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23165336462343062', 'path': '/dev/sde'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:50:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165336462343062', 'path': '/dev/sde'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:50:56 user nova-compute[75210]: DEBUG nova.objects.instance [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lazy-loading 'flavor' on Instance uuid c163c27f-4cdd-4984-bd3b-eace62b14106 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:50:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:50:56 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:50:56 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 01:50:56 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:50:56 user nova-compute[75210]:   <serial>75cae315-af7b-4d9d-9e6a-de12e9f897e2</serial>
Nov 29 01:50:56 user nova-compute[75210]: </disk>
Nov 29 01:50:56 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:50:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:50:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:50:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] No VIF found with MAC fa:16:3e:c9:c0:98, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:50:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f14b2f18-80ca-4d21-964c-5008804e0325 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.059s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:50:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:59 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Port 60309b43-09f2-4bc7-81a2-9c764df78b5d binding to destination host user is already ACTIVE {{(pid=75210) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 01:50:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:50:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquired lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:50:59 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:50:59 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating instance_info_cache with network_info: [{"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:50:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Releasing lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:50:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Creating tmpfile /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/tmp0vnbowzd to verify with other compute node that the instance is on the same shared storage. {{(pid=75210) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 29 01:50:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:50:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-9efba51a-7fbd-4ef1-aa0c-b47124b40830 req-cf1bd140-62b4-43da-a4a3-a02aab59a244 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-unplugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9efba51a-7fbd-4ef1-aa0c-b47124b40830 req-cf1bd140-62b4-43da-a4a3-a02aab59a244 service nova] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9efba51a-7fbd-4ef1-aa0c-b47124b40830 req-cf1bd140-62b4-43da-a4a3-a02aab59a244 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9efba51a-7fbd-4ef1-aa0c-b47124b40830 req-cf1bd140-62b4-43da-a4a3-a02aab59a244 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-9efba51a-7fbd-4ef1-aa0c-b47124b40830 req-cf1bd140-62b4-43da-a4a3-a02aab59a244 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] No waiting events found dispatching network-vif-unplugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:51:00 user nova-compute[75210]: WARNING nova.compute.manager [req-9efba51a-7fbd-4ef1-aa0c-b47124b40830 req-cf1bd140-62b4-43da-a4a3-a02aab59a244 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received unexpected event network-vif-unplugged-60309b43-09f2-4bc7-81a2-9c764df78b5d for instance with vm_state resized and task_state resize_reverting.
Nov 29 01:51:00 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Instance destroyed successfully.
Nov 29 01:51:00 user nova-compute[75210]: DEBUG nova.objects.instance [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lazy-loading 'resources' on Instance uuid 4fab87e3-2f7c-4db4-9f14-ace1813fe046 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1920078035',display_name='tempest-ServerActionsTestOtherB-server-1920078035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1920078035',id=27,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHTMCtMfKAyfL3sA07wByFhm2FHh83CKtTVWERl3aWtDAO+UO8rfcAbJD3gRH9oGCeL5Ksot/CKwepAmL20m57Zzo2MLfsvimSlewZEfHZ4/WEV9jR4p6/EvJ11L0KWcA==',key_name='tempest-keypair-53471645',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:49:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7b24c627ca143e49731c22a555eacd1',ramdisk_id='',reservation_id='r-08i4j8ht',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-573973984',owner_user_name='tempest-ServerActionsTestOtherB-573973984-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:49:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b16390ddb64b9f8925f3e156bbe8d0',uuid=4fab87e3-2f7c-4db4-9f14-ace1813fe046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converting VIF {"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_vif [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60309b43-09, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2736126d-886a-40b4-bae9-f0e437822a61) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:51:00 user nova-compute[75210]: INFO os_vif [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09')
Nov 29 01:51:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzbKkiSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:51:00 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ccd1d9-6d4d-4ef0-9315-fad7b5f2aae6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:51:00 user nova-compute[75210]: No targets found.
Nov 29 01:51:00 user nova-compute[75210]: iSNS:
Nov 29 01:51:00 user nova-compute[75210]: No targets found.
Nov 29 01:51:00 user nova-compute[75210]: STATIC:
Nov 29 01:51:00 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866
Nov 29 01:51:00 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:51:00 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:51:00 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:51:00 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:51:00 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:51:00 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b
Nov 29 01:51:00 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:51:00 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:51:00 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2
Nov 29 01:51:00 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:51:00 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:51:00 user nova-compute[75210]: FIRMWARE:
Nov 29 01:51:00 user nova-compute[75210]: No targets found.
Nov 29 01:51:00 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:51:00 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:51:00 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3204f30-0b20-456b-90a5-b51a098c6488]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df52d98-f195-4fda-b3fa-a299f0cb8039]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:00 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:51:00 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:51:00 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:00 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:00 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:51:00 user nova-compute[75210]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:51:00 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:00 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2408447eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4259f5ae-32ab-41cc-b57d-e8fa4093a8c0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a708800c-c548-451a-9cd6-2ee2ff847cec]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d79c42c-b356-4222-8e45-c9655d1657c7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad20808f-b1ae-436b-a12f-7d5202ff0857]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f60c44-f009-41bf-915d-1a8479b8b10b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d688a6bd-0828-4a27-8501-b1f5878117a3]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260]
Nov 29 01:51:01 user nova-compute[75210]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260] successful.
Nov 29 01:51:01 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7742b95a-dcb8-4c4f-abcc-daec1ebdfdf8]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] <== disconnect_volume: return (329ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "c163c27f-4cdd-4984-bd3b-eace62b14106" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG nova.objects.instance [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lazy-loading 'flavor' on Instance uuid c163c27f-4cdd-4984-bd3b-eace62b14106 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "c163c27f-4cdd-4984-bd3b-eace62b14106" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:01 user nova-compute[75210]: INFO nova.compute.manager [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Attaching volume 3284f81b-a0d2-471a-9196-74e273a07751 to /dev/vdc
Nov 29 01:51:01 user nova-compute[75210]: DEBUG os_brick.utils [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a12f68a-ebc5-4d68-9ce5-5ba5c2b6a57e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ede0e6-852e-4896-b001-57f722a4569a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8227bda0-7805-4493-8600-daa2f9c1abc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[054331ac-ea63-457c-8955-d429afd45620]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:51:01 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:51:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9515bee-de3a-475f-9b03-796e098e8a8d]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG os_brick.utils [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:51:01 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Updating existing volume attachment record: 17bef3ea-b3e1-4e59-8814-ae3a819d15e7 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:51:02 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 is timed out.
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Successfully detached device vdb from instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 from the live domain config.
Nov 29 01:51:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AtGLrIbR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:51:02 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG nova.objects.instance [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lazy-loading 'migration_context' on Instance uuid 4fab87e3-2f7c-4db4-9f14-ace1813fe046 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG nova.objects.base [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Object Instance<4fab87e3-2f7c-4db4-9f14-ace1813fe046> lazy-loaded attributes: resources,migration_context {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf7a03b-3420-405a-96b3-6b882f495f7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:51:02 user nova-compute[75210]: No targets found.
Nov 29 01:51:02 user nova-compute[75210]: iSNS:
Nov 29 01:51:02 user nova-compute[75210]: No targets found.
Nov 29 01:51:02 user nova-compute[75210]: STATIC:
Nov 29 01:51:02 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:51:02 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:51:02 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:51:02 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b
Nov 29 01:51:02 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:51:02 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:51:02 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2
Nov 29 01:51:02 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:51:02 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:51:02 user nova-compute[75210]: FIRMWARE:
Nov 29 01:51:02 user nova-compute[75210]: No targets found.
Nov 29 01:51:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:51:02 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:51:02 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3dcd0d-9dbe-4274-8c04-1ec4fc00aebe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad343983-32b1-485f-a94b-4c512f24a8d6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:02 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:51:02 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:02 user nova-compute[75210]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b (non-flash)
Nov 29 01:51:02 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24081197e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b'): ({'sdd'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Removing single pathed devices sdd {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-0098a889-7dd6-481f-bec9-1cca2b4150a9 req-1e7d5ecd-d91d-485d-b76c-fa9d65c7fbe9 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0098a889-7dd6-481f-bec9-1cca2b4150a9 req-1e7d5ecd-d91d-485d-b76c-fa9d65c7fbe9 service nova] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0098a889-7dd6-481f-bec9-1cca2b4150a9 req-1e7d5ecd-d91d-485d-b76c-fa9d65c7fbe9 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0098a889-7dd6-481f-bec9-1cca2b4150a9 req-1e7d5ecd-d91d-485d-b76c-fa9d65c7fbe9 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-0098a889-7dd6-481f-bec9-1cca2b4150a9 req-1e7d5ecd-d91d-485d-b76c-fa9d65c7fbe9 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] No waiting events found dispatching network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:51:02 user nova-compute[75210]: WARNING nova.compute.manager [req-0098a889-7dd6-481f-bec9-1cca2b4150a9 req-1e7d5ecd-d91d-485d-b76c-fa9d65c7fbe9 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received unexpected event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d for instance with vm_state resized and task_state resize_reverting.
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[156ee1d4-88c8-44eb-a49c-956424cfd3d6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8910158-7250-475b-b03f-3a031dded053]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flushing IO for device /dev/sdd {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9cc446-32ab-4807-bfe7-aab7b41f3dd1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d7046e-f03f-4160-ac9d-d90f5a7ed29c]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[73024f5b-3168-493e-aff4-063eb47b3d4b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[277835d5-ab4e-436d-8462-2d562db4d118]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260]
Nov 29 01:51:02 user nova-compute[75210]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b, portal: 172.16.0.220,3260] successful.
Nov 29 01:51:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12057d3a-a4d5-4feb-a093-4dcc0dd5858b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[643cb546-dc98-4207-8c97-2f5a0239a58a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] <== disconnect_volume: return (368ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:51:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.481s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:02 user nova-compute[75210]: INFO nova.compute.manager [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Swapping old allocation on dict_keys(['28871a06-d5c8-43d0-87af-3689cd143011']) held by migration f33be2ae-820f-4d4c-92cb-02ec1f06bdd5 for instance
Nov 29 01:51:02 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Overwriting current allocation {'allocations': {'28871a06-d5c8-43d0-87af-3689cd143011': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 37}}, 'project_id': 'e7b24c627ca143e49731c22a555eacd1', 'user_id': 'b9b16390ddb64b9f8925f3e156bbe8d0', 'consumer_generation': 1} on consumer 4fab87e3-2f7c-4db4-9f14-ace1813fe046 {{(pid=75210) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquired lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG nova.objects.instance [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lazy-loading 'flavor' on Instance uuid 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating instance_info_cache with network_info: [{"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5d6a0792-c7fd-4a2b-8eeb-e90250055851 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.863s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Releasing lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG os_brick.utils [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[69534b17-9fd8-488a-9742-6107ce84c7dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f29e6f-d0cd-4a00-9e7b-17d128291e6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9854098a-aac8-4b75-a136-0f7ed589828b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df03ed3-9f7a-4839-a4ee-b48704ee9d6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:51:03 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:51:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e7f76d-264d-46c7-85db-19b1d112defa]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:51:03 user nova-compute[75210]: DEBUG os_brick.utils [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:51:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHVstWGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:51:09 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:51:09 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:51:09 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a36b35-b734-4970-9a4b-805ccb64ffca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:51:09 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b01ef0-8f0d-42dd-b13a-0f0419eae564]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751] added
Nov 29 01:51:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91b5e6e-e64a-4dcc-913e-143a547fdbbc]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[be92cb01-1ea9-4475-94f2-4681acbca096]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHVstWGI {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHVstWGI" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[77246cb5-0c79-49dd-8f2c-4b064e4888a5]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHVstWGI'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[752cf0fa-0492-4bc6-a7cc-84bf7a879606]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b7bf5c-0cde-4dac-980b-4174b0eeb869]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:09 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:09 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1402f8fa-e88a-4628-9879-99dbd88f5273]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751, portal: 172.16.0.220,3260]
Nov 29 01:51:09 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751, portal: 172.16.0.220,3260] successful.
Nov 29 01:51:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dc308a-1b43-45ba-863c-6bc5a842e400]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b34a249-786a-4d24-9e27-067563fd80e7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:09 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:09 user nova-compute[75210]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 (non-flash)
Nov 29 01:51:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:09 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:09 user nova-compute[75210]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 (non-flash)
Nov 29 01:51:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dd87ad-bcc7-43ac-9605-d867651ddc39]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:51:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHVstWGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:51:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:51:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23338613464633565', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:51:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338613464633565', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:51:10 user nova-compute[75210]: DEBUG nova.objects.instance [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lazy-loading 'flavor' on Instance uuid c163c27f-4cdd-4984-bd3b-eace62b14106 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:51:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:51:10 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:51:10 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:51:10 user nova-compute[75210]:   <target dev="vdc" bus="virtio"/>
Nov 29 01:51:10 user nova-compute[75210]:   <serial>3284f81b-a0d2-471a-9196-74e273a07751</serial>
Nov 29 01:51:10 user nova-compute[75210]: </disk>
Nov 29 01:51:10 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:51:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] No VIF found with MAC fa:16:3e:c9:c0:98, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbdc4e47-9769-4c9a-9f49-901da9cedbde tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.710s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Starting finish_revert_migration {{(pid=75210) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Start _get_guest_xml network_info=[{"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'da3f2c04-2ce6-4cc3-8833-e7563308507b', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzbKkiSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4fab87e3-2f7c-4db4-9f14-ace1813fe046', 'attached_at': '2023-11-29T01:51:11.000000', 'detached_at': '', 'volume_id': '0701e0ea-4b69-4215-9da7-7a684d683866', 'serial': '0701e0ea-4b69-4215-9da7-7a684d683866'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:51:11 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:51:11 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.objects.instance [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4fab87e3-2f7c-4db4-9f14-ace1813fe046 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzbKkiSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:51:11 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:51:11 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:51:11 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[93816da7-5dba-4959-b339-7c6d552ec61c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:51:11 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[024b3d97-4fbf-4875-8061-a2af014c1f4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866] added
Nov 29 01:51:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b6c3c3-8863-4efe-a6fc-2f99d7a86273]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.107s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab87b63-4920-47df-8ef4-3554e0d2bd9d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzbKkiSH {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzbKkiSH" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82bd833-ea19-4d77-85b1-93489151aa4d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BzbKkiSH'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a7a43e-b757-4fdd-a415-2346d204031c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[138c9488-7188-442c-900e-5b4939f285de]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:11 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:11 user nova-compute[75210]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 (non-flash)
Nov 29 01:51:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:11 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:11 user nova-compute[75210]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 (non-flash)
Nov 29 01:51:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[126506da-35d5-4872-b1c1-e0dce5c581fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260]
Nov 29 01:51:11 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260] successful.
Nov 29 01:51:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b134f0a3-fd1b-4e18-955d-4e116d2b9c46]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:12 user nova-compute[75210]: INFO nova.compute.manager [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] instance snapshotting
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7407756f-0f71-44bc-a32e-212d14b83529]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:12 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:12 user nova-compute[75210]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 (non-flash)
Nov 29 01:51:12 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:51:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:12 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:12 user nova-compute[75210]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 (non-flash)
Nov 29 01:51:12 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:51:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[561fe99e-2d89-4943-b33e-d4e7585b24d8]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:51:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Beginning live snapshot process
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json -f qcow2 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json -f qcow2 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "c163c27f-4cdd-4984-bd3b-eace62b14106" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:12 user nova-compute[75210]: INFO nova.compute.manager [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Detaching volume 3284f81b-a0d2-471a-9196-74e273a07751
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:12 user nova-compute[75210]: INFO nova.virt.block_device [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Attempting to driver detach volume 3284f81b-a0d2-471a-9196-74e273a07751 from mountpoint /dev/vdc
Nov 29 01:51:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Attempting to detach device vdc from instance c163c27f-4cdd-4984-bd3b-eace62b14106 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:51:12 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:51:12 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:51:12 user nova-compute[75210]:   <target dev="vdc" bus="virtio"/>
Nov 29 01:51:12 user nova-compute[75210]:   <serial>3284f81b-a0d2-471a-9196-74e273a07751</serial>
Nov 29 01:51:12 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 01:51:12 user nova-compute[75210]: </disk>
Nov 29 01:51:12 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:51:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Successfully detached device vdc from instance c163c27f-4cdd-4984-bd3b-eace62b14106 from the persistent domain config.
Nov 29 01:51:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c163c27f-4cdd-4984-bd3b-eace62b14106 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:51:12 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:51:12 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 01:51:12 user nova-compute[75210]:   <target dev="vdc" bus="virtio"/>
Nov 29 01:51:12 user nova-compute[75210]:   <serial>3284f81b-a0d2-471a-9196-74e273a07751</serial>
Nov 29 01:51:12 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 01:51:12 user nova-compute[75210]: </disk>
Nov 29 01:51:12 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgpzw6cx8/abac7cbe1fd84f45b9cda681b27f3946.delta 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgpzw6cx8/abac7cbe1fd84f45b9cda681b27f3946.delta 1073741824" returned: 0 in 0.047s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 01:51:13 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzbKkiSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26435376431616662', 'path': '/dev/sdd'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435376431616662', 'path': '/dev/sdd'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1920078035',display_name='tempest-ServerActionsTestOtherB-server-1920078035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1920078035',id=27,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHTMCtMfKAyfL3sA07wByFhm2FHh83CKtTVWERl3aWtDAO+UO8rfcAbJD3gRH9oGCeL5Ksot/CKwepAmL20m57Zzo2MLfsvimSlewZEfHZ4/WEV9jR4p6/EvJ11L0KWcA==',key_name='tempest-keypair-53471645',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:49:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e7b24c627ca143e49731c22a555eacd1',ramdisk_id='',reservation_id='r-08i4j8ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-573973984',owner_user_name='tempest-ServerActionsTestOtherB-573973984-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:50:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b16390ddb64b9f8925f3e156bbe8d0',uuid=4fab87e3-2f7c-4db4-9f14-ace1813fe046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converting VIF {"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:51:13 user nova-compute[75210]:   <uuid>4fab87e3-2f7c-4db4-9f14-ace1813fe046</uuid>
Nov 29 01:51:13 user nova-compute[75210]:   <name>instance-0000001b</name>
Nov 29 01:51:13 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:51:13 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:51:13 user nova-compute[75210]:   <metadata>
Nov 29 01:51:13 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:51:13 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:51:13 user nova-compute[75210]:       <nova:name>tempest-ServerActionsTestOtherB-server-1920078035</nova:name>
Nov 29 01:51:13 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:51:11</nova:creationTime>
Nov 29 01:51:13 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:51:13 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:51:13 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:51:13 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:51:13 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:51:13 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:51:13 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:51:13 user nova-compute[75210]:       <nova:owner>
Nov 29 01:51:13 user nova-compute[75210]:         <nova:user uuid="b9b16390ddb64b9f8925f3e156bbe8d0">tempest-ServerActionsTestOtherB-573973984-project-member</nova:user>
Nov 29 01:51:13 user nova-compute[75210]:         <nova:project uuid="e7b24c627ca143e49731c22a555eacd1">tempest-ServerActionsTestOtherB-573973984</nova:project>
Nov 29 01:51:13 user nova-compute[75210]:       </nova:owner>
Nov 29 01:51:13 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:51:13 user nova-compute[75210]:       <nova:ports>
Nov 29 01:51:13 user nova-compute[75210]:         <nova:port uuid="60309b43-09f2-4bc7-81a2-9c764df78b5d">
Nov 29 01:51:13 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 01:51:13 user nova-compute[75210]:         </nova:port>
Nov 29 01:51:13 user nova-compute[75210]:       </nova:ports>
Nov 29 01:51:13 user nova-compute[75210]:     </nova:instance>
Nov 29 01:51:13 user nova-compute[75210]:   </metadata>
Nov 29 01:51:13 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:51:13 user nova-compute[75210]:     <system>
Nov 29 01:51:13 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:51:13 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:51:13 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:51:13 user nova-compute[75210]:       <entry name="serial">4fab87e3-2f7c-4db4-9f14-ace1813fe046</entry>
Nov 29 01:51:13 user nova-compute[75210]:       <entry name="uuid">4fab87e3-2f7c-4db4-9f14-ace1813fe046</entry>
Nov 29 01:51:13 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:51:13 user nova-compute[75210]:     </system>
Nov 29 01:51:13 user nova-compute[75210]:   </sysinfo>
Nov 29 01:51:13 user nova-compute[75210]:   <os>
Nov 29 01:51:13 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:51:13 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:51:13 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:51:13 user nova-compute[75210]:   </os>
Nov 29 01:51:13 user nova-compute[75210]:   <features>
Nov 29 01:51:13 user nova-compute[75210]:     <acpi/>
Nov 29 01:51:13 user nova-compute[75210]:     <apic/>
Nov 29 01:51:13 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:51:13 user nova-compute[75210]:   </features>
Nov 29 01:51:13 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:51:13 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:51:13 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:51:13 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:51:13 user nova-compute[75210]:   </clock>
Nov 29 01:51:13 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:51:13 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:51:13 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:51:13 user nova-compute[75210]:   </cpu>
Nov 29 01:51:13 user nova-compute[75210]:   <devices>
Nov 29 01:51:13 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:51:13 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:51:13 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk"/>
Nov 29 01:51:13 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:51:13 user nova-compute[75210]:     </disk>
Nov 29 01:51:13 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:51:13 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:51:13 user nova-compute[75210]:       <source dev="/dev/sdd"/>
Nov 29 01:51:13 user nova-compute[75210]:       <target dev="vdb" bus="virtio"/>
Nov 29 01:51:13 user nova-compute[75210]:       <serial>0701e0ea-4b69-4215-9da7-7a684d683866</serial>
Nov 29 01:51:13 user nova-compute[75210]:     </disk>
Nov 29 01:51:13 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:51:13 user nova-compute[75210]:       <mac address="fa:16:3e:95:cc:d2"/>
Nov 29 01:51:13 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:51:13 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:51:13 user nova-compute[75210]:       <target dev="tap60309b43-09"/>
Nov 29 01:51:13 user nova-compute[75210]:     </interface>
Nov 29 01:51:13 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:51:13 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/console.log" append="off"/>
Nov 29 01:51:13 user nova-compute[75210]:     </serial>
Nov 29 01:51:13 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:51:13 user nova-compute[75210]:     <video>
Nov 29 01:51:13 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:51:13 user nova-compute[75210]:     </video>
Nov 29 01:51:13 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:51:13 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:51:13 user nova-compute[75210]:     </rng>
Nov 29 01:51:13 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:51:13 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:51:13 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:51:13 user nova-compute[75210]:     </memballoon>
Nov 29 01:51:13 user nova-compute[75210]:   </devices>
Nov 29 01:51:13 user nova-compute[75210]: </domain>
Nov 29 01:51:13 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1920078035',display_name='tempest-ServerActionsTestOtherB-server-1920078035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1920078035',id=27,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHTMCtMfKAyfL3sA07wByFhm2FHh83CKtTVWERl3aWtDAO+UO8rfcAbJD3gRH9oGCeL5Ksot/CKwepAmL20m57Zzo2MLfsvimSlewZEfHZ4/WEV9jR4p6/EvJ11L0KWcA==',key_name='tempest-keypair-53471645',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:49:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e7b24c627ca143e49731c22a555eacd1',ramdisk_id='',reservation_id='r-08i4j8ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-573973984',owner_user_name='tempest-ServerActionsTestOtherB-573973984-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:50:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b16390ddb64b9f8925f3e156bbe8d0',uuid=4fab87e3-2f7c-4db4-9f14-ace1813fe046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converting VIF {"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG os_vif [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8244a618-66e3-59f1-a9ad-ad44e1a57c8d', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60309b43-09, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60309b43-09, col_values=(('qos', UUID('2b0dcefb-6b8e-4649-9e34-3c5410d09c44')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60309b43-09, col_values=(('external_ids', {'iface-id': '60309b43-09f2-4bc7-81a2-9c764df78b5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:cc:d2', 'vm-uuid': '4fab87e3-2f7c-4db4-9f14-ace1813fe046'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:51:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:13 user nova-compute[75210]: INFO os_vif [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09')
Nov 29 01:51:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c163c27f-4cdd-4984-bd3b-eace62b14106 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:51:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:51:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 01:51:14 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 01:51:14 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 01:51:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgpzw6cx8/abac7cbe1fd84f45b9cda681b27f3946.delta /opt/stack/data/nova/instances/snapshots/tmpgpzw6cx8/abac7cbe1fd84f45b9cda681b27f3946 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:15 user nova-compute[75210]: DEBUG nova.compute.manager [req-a18d01e3-a09c-43eb-a251-fbf9ab7bf64e req-b16fad93-00ec-45d7-b69a-c14f81ef4c61 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:51:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a18d01e3-a09c-43eb-a251-fbf9ab7bf64e req-b16fad93-00ec-45d7-b69a-c14f81ef4c61 service nova] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a18d01e3-a09c-43eb-a251-fbf9ab7bf64e req-b16fad93-00ec-45d7-b69a-c14f81ef4c61 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a18d01e3-a09c-43eb-a251-fbf9ab7bf64e req-b16fad93-00ec-45d7-b69a-c14f81ef4c61 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:15 user nova-compute[75210]: DEBUG nova.compute.manager [req-a18d01e3-a09c-43eb-a251-fbf9ab7bf64e req-b16fad93-00ec-45d7-b69a-c14f81ef4c61 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] No waiting events found dispatching network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:51:15 user nova-compute[75210]: WARNING nova.compute.manager [req-a18d01e3-a09c-43eb-a251-fbf9ab7bf64e req-b16fad93-00ec-45d7-b69a-c14f81ef4c61 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received unexpected event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d for instance with vm_state resized and task_state resize_reverting.
Nov 29 01:51:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgpzw6cx8/abac7cbe1fd84f45b9cda681b27f3946.delta /opt/stack/data/nova/instances/snapshots/tmpgpzw6cx8/abac7cbe1fd84f45b9cda681b27f3946" returned: 0 in 0.770s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:15 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Snapshot extracted, beginning image upload
Nov 29 01:51:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-9687ba33-10f2-4de3-9de5-2d3772295cac req-c02f8935-02a2-4740-87f6-4502b5196f2d service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:51:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9687ba33-10f2-4de3-9de5-2d3772295cac req-c02f8935-02a2-4740-87f6-4502b5196f2d service nova] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9687ba33-10f2-4de3-9de5-2d3772295cac req-c02f8935-02a2-4740-87f6-4502b5196f2d service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9687ba33-10f2-4de3-9de5-2d3772295cac req-c02f8935-02a2-4740-87f6-4502b5196f2d service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-9687ba33-10f2-4de3-9de5-2d3772295cac req-c02f8935-02a2-4740-87f6-4502b5196f2d service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] No waiting events found dispatching network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:51:17 user nova-compute[75210]: WARNING nova.compute.manager [req-9687ba33-10f2-4de3-9de5-2d3772295cac req-c02f8935-02a2-4740-87f6-4502b5196f2d service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received unexpected event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d for instance with vm_state resized and task_state resize_reverting.
Nov 29 01:51:17 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:51:17 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Instance running successfully.
Nov 29 01:51:17 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] finish_revert_migration finished successfully. {{(pid=75210) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 29 01:51:18 user nova-compute[75210]: INFO nova.compute.manager [None req-b6c6a147-b28d-47ef-b1d0-24fa2d468d44 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating instance to original state: 'active'
Nov 29 01:51:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:18 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Snapshot image upload complete
Nov 29 01:51:18 user nova-compute[75210]: INFO nova.compute.manager [None req-ad93c82f-9d0f-4f1f-8420-0dd3c9174a6d tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Took 6.52 seconds to snapshot the instance on the hypervisor.
Nov 29 01:51:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:22 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:51:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:27 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:51:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:51:28 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:51:29 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:51:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:51:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:51:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:51:29 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:51:29 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Updating instance_info_cache with network_info: [{"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:51:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-fa020b7e-c088-4c40-878d-27e43dca4ad0" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:51:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:51:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:51:31 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:51:31 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:51:31 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:51:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:31 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:51:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:32 user nova-compute[75210]: INFO nova.compute.manager [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Terminating instance
Nov 29 01:51:32 user nova-compute[75210]: DEBUG nova.compute.manager [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-d223798f-5f7c-466a-a727-18a8244d9be2 req-9b92e85b-51e6-40ea-9112-c8e0fef6ae3b service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received event network-vif-unplugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d223798f-5f7c-466a-a727-18a8244d9be2 req-9b92e85b-51e6-40ea-9112-c8e0fef6ae3b service nova] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d223798f-5f7c-466a-a727-18a8244d9be2 req-9b92e85b-51e6-40ea-9112-c8e0fef6ae3b service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d223798f-5f7c-466a-a727-18a8244d9be2 req-9b92e85b-51e6-40ea-9112-c8e0fef6ae3b service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-d223798f-5f7c-466a-a727-18a8244d9be2 req-9b92e85b-51e6-40ea-9112-c8e0fef6ae3b service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] No waiting events found dispatching network-vif-unplugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-d223798f-5f7c-466a-a727-18a8244d9be2 req-9b92e85b-51e6-40ea-9112-c8e0fef6ae3b service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received event network-vif-unplugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:32 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Instance destroyed successfully.
Nov 29 01:51:32 user nova-compute[75210]: DEBUG nova.objects.instance [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lazy-loading 'resources' on Instance uuid 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T01:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1671026619',display_name='tempest-ServerActionsTestOtherA-server-523310911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1671026619',id=28,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrAlkYCYFiG8HsPQ0MfXXz1CYvZvlSHO1nMa3YfzgL7Z5ZuVG5QkHtT6bn5NIQcIY/LXA39c0x9WLdrksniaIEuzEu31JLX8B5Z0tDXbGHkL+U+PKd9kCVGtrOpM+5bKg==',key_name='tempest-keypair-982499079',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:48:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-86osubk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:48:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "address": "fa:16:3e:c6:54:7a", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d168686-67", "ovs_interfaceid": "2d168686-6764-45e3-85bd-a8dff60fa4f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG os_vif [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d168686-67, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9ee633a-0a17-499b-b50a-c3b8057f90ed) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:32 user nova-compute[75210]: INFO os_vif [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:54:7a,bridge_name='br-int',has_traffic_filtering=True,id=2d168686-6764-45e3-85bd-a8dff60fa4f0,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d168686-67')
Nov 29 01:51:32 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Deleting instance files /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03_del
Nov 29 01:51:32 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Deletion of /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03_del complete
Nov 29 01:51:33 user nova-compute[75210]: INFO nova.compute.manager [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json" returned: 1 in 0.265s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk --force-share --output=json' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:51:33 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001c, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03/disk
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:33 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c163c27f-4cdd-4984-bd3b-eace62b14106 is timed out.
Nov 29 01:51:33 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Successfully detached device vdc from instance c163c27f-4cdd-4984-bd3b-eace62b14106 from the live domain config.
Nov 29 01:51:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHVstWGI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:51:33 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ccaa10-a972-40a6-88a3-7fc609b6f1ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:51:33 user nova-compute[75210]: No targets found.
Nov 29 01:51:33 user nova-compute[75210]: iSNS:
Nov 29 01:51:33 user nova-compute[75210]: No targets found.
Nov 29 01:51:33 user nova-compute[75210]: STATIC:
Nov 29 01:51:33 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866
Nov 29 01:51:33 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:51:33 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:51:33 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:51:33 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:51:33 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:51:33 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2
Nov 29 01:51:33 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:51:33 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:51:33 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751
Nov 29 01:51:33 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:51:33 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:51:33 user nova-compute[75210]: FIRMWARE:
Nov 29 01:51:33 user nova-compute[75210]: No targets found.
Nov 29 01:51:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:51:33 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:51:33 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a244782-7043-4fd0-a2ec-7c43865753cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c168bfc4-300f-4ca4-99e1-2241db86e3de]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:33 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:33 user nova-compute[75210]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 (non-flash)
Nov 29 01:51:33 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:51:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:51:33 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:51:33 user nova-compute[75210]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 (non-flash)
Nov 29 01:51:33 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:51:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f240813dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[721621a2-0227-4be5-ab30-32893dbd1b76]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1f767d-7b24-48fd-9a56-7473cb96da2f]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de33204-45a9-4e87-956c-af6cc5a494dc]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb97f04-1e5e-4491-9a28-0a160b941766]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d9a7a0-9179-489e-9a4b-38a9488c680a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bfb739-2688-473e-bdf5-b51f13b09108]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751, portal: 172.16.0.220,3260]
Nov 29 01:51:33 user nova-compute[75210]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751, portal: 172.16.0.220,3260] successful.
Nov 29 01:51:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3284f81b-a0d2-471a-9196-74e273a07751 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[24becdf7-a53b-4b5d-a1ee-21003bbbc79e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] <== disconnect_volume: return (451ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-871e3fc6-cd06-4dad-93e8-05948c857a6b req-6c50501e-a4b4-4e49-ada4-9d941dd36386 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received event network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-871e3fc6-cd06-4dad-93e8-05948c857a6b req-6c50501e-a4b4-4e49-ada4-9d941dd36386 service nova] Acquiring lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-871e3fc6-cd06-4dad-93e8-05948c857a6b req-6c50501e-a4b4-4e49-ada4-9d941dd36386 service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-871e3fc6-cd06-4dad-93e8-05948c857a6b req-6c50501e-a4b4-4e49-ada4-9d941dd36386 service nova] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-871e3fc6-cd06-4dad-93e8-05948c857a6b req-6c50501e-a4b4-4e49-ada4-9d941dd36386 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] No waiting events found dispatching network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:51:34 user nova-compute[75210]: WARNING nova.compute.manager [req-871e3fc6-cd06-4dad-93e8-05948c857a6b req-6c50501e-a4b4-4e49-ada4-9d941dd36386 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received unexpected event network-vif-plugged-2d168686-6764-45e3-85bd-a8dff60fa4f0 for instance with vm_state active and task_state deleting.
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG nova.objects.instance [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lazy-loading 'flavor' on Instance uuid c163c27f-4cdd-4984-bd3b-eace62b14106 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:51:34 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Took 1.60 seconds to deallocate network for instance.
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-93ca3adb-fcaa-487f-a7bb-884275e4f3d8 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.006s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-32945eee-b96e-4cfa-848e-c7e61188a3b8 req-970e0d53-7a58-4d85-8e85-c174e0acafb2 service nova] [instance: 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03] Received event network-vif-deleted-2d168686-6764-45e3-85bd-a8dff60fa4f0 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:35 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:51:35 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:51:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:35 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Deleted allocations for instance 3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03
Nov 29 01:51:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fda9e65e-feea-4798-bbf6-23350967a8a4 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3e5f8e14-3e91-4dc9-9a05-2c9f5f2a0c03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.415s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:51:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:51:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:36 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:51:36 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7723MB free_disk=25.081138610839844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c163c27f-4cdd-4984-bd3b-eace62b14106 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 4fab87e3-2f7c-4db4-9f14-ace1813fe046 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3df17188-c87e-49e5-9ca2-5d04632ea9bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c320d76b-58e8-4032-bef3-3aead513231e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:51:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:51:37 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:51:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:51:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:51:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:52:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:52:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "c163c27f-4cdd-4984-bd3b-eace62b14106" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:03 user nova-compute[75210]: INFO nova.compute.manager [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Detaching volume 75cae315-af7b-4d9d-9e6a-de12e9f897e2
Nov 29 01:52:03 user nova-compute[75210]: INFO nova.virt.block_device [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Attempting to driver detach volume 75cae315-af7b-4d9d-9e6a-de12e9f897e2 from mountpoint /dev/vdb
Nov 29 01:52:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Attempting to detach device vdb from instance c163c27f-4cdd-4984-bd3b-eace62b14106 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:52:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:52:03 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:52:03 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 01:52:03 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:52:03 user nova-compute[75210]:   <serial>75cae315-af7b-4d9d-9e6a-de12e9f897e2</serial>
Nov 29 01:52:03 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:52:03 user nova-compute[75210]: </disk>
Nov 29 01:52:03 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:52:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Successfully detached device vdb from instance c163c27f-4cdd-4984-bd3b-eace62b14106 from the persistent domain config.
Nov 29 01:52:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c163c27f-4cdd-4984-bd3b-eace62b14106 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:52:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:52:03 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:52:03 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 01:52:03 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:52:03 user nova-compute[75210]:   <serial>75cae315-af7b-4d9d-9e6a-de12e9f897e2</serial>
Nov 29 01:52:03 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:52:03 user nova-compute[75210]: </disk>
Nov 29 01:52:03 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:52:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c163c27f-4cdd-4984-bd3b-eace62b14106 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:52:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:09 user nova-compute[75210]: INFO nova.compute.manager [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Unshelving
Nov 29 01:52:10 user nova-compute[75210]: INFO nova.virt.block_device [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Booting with volume c462ff66-874b-4d31-bf54-0a25b733af23 at /dev/vda
Nov 29 01:52:10 user nova-compute[75210]: DEBUG os_brick.utils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca3674a-077a-4b47-bb66-e261adc9621c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5665401b-33fe-4352-b8e0-d977baf190bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81a1378-0ec1-44ad-819f-2abb27bb4b41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7176a70-4b49-441e-85c4-f75cd8b2d0e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:52:10 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:52:10 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5492227c-0128-4e85-a156-828b44b9327e]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG os_brick.utils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:52:10 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updating existing volume attachment record: 30e4bdbe-3f82-4bb2-aed4-062b0813349d {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:52:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:17 user nova-compute[75210]: DEBUG nova.objects.instance [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lazy-loading 'pci_requests' on Instance uuid 0a239b54-6717-4f3c-b455-3326a8f0bdc2 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:17 user nova-compute[75210]: DEBUG nova.objects.instance [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lazy-loading 'numa_topology' on Instance uuid 0a239b54-6717-4f3c-b455-3326a8f0bdc2 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:17 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:52:17 user nova-compute[75210]: INFO nova.compute.claims [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Claim successful on node user
Nov 29 01:52:17 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:52:17 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:52:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:17 user nova-compute[75210]: INFO nova.network.neutron [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updating port 87448b14-8dd8-439b-ae2f-7c2e5a0cf813 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 01:52:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:52:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 01:52:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:52:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:52:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquired lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.network.neutron [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-fffbcbfe-73c3-40e8-8d00-500fd81f0b15 req-3b18ed49-ee9e-4d2b-ad07-0e59ca8e7448 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-changed-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-fffbcbfe-73c3-40e8-8d00-500fd81f0b15 req-3b18ed49-ee9e-4d2b-ad07-0e59ca8e7448 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Refreshing instance network info cache due to event network-changed-87448b14-8dd8-439b-ae2f-7c2e5a0cf813. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fffbcbfe-73c3-40e8-8d00-500fd81f0b15 req-3b18ed49-ee9e-4d2b-ad07-0e59ca8e7448 service nova] Acquiring lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.network.neutron [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updating instance_info_cache with network_info: [{"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Releasing lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:52:18 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Creating image(s)
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Ensure instance console log exists: /opt/stack/data/nova/instances/0a239b54-6717-4f3c-b455-3326a8f0bdc2/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Start _get_guest_xml network_info=[{"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': '30e4bdbe-3f82-4bb2-aed4-062b0813349d', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTOXPUgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a239b54-6717-4f3c-b455-3326a8f0bdc2', 'attached_at': '', 'detached_at': '', 'volume_id': 'c462ff66-874b-4d31-bf54-0a25b733af23', 'serial': 'c462ff66-874b-4d31-bf54-0a25b733af23'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fffbcbfe-73c3-40e8-8d00-500fd81f0b15 req-3b18ed49-ee9e-4d2b-ad07-0e59ca8e7448 service nova] Acquired lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.network.neutron [req-fffbcbfe-73c3-40e8-8d00-500fd81f0b15 req-3b18ed49-ee9e-4d2b-ad07-0e59ca8e7448 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Refreshing network info cache for port 87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:52:18 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:52:18 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.objects.instance [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a239b54-6717-4f3c-b455-3326a8f0bdc2 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.objects.base [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Object Instance<0a239b54-6717-4f3c-b455-3326a8f0bdc2> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTOXPUgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:52:18 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:52:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:52:18 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:52:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:52:18 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea8cc77-6d13-42a4-aecd-198b57c4d5c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:52:18 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[766b58de-a667-4962-86ba-d6dbd0873553]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23] added
Nov 29 01:52:18 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ed0f10-07ef-4bd1-b1b5-8e46b212256e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[32003bbb-84b9-4bb7-a869-c56585677567]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FTOXPUgS {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FTOXPUgS" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b1cb63-0209-4a71-9b50-cde9a3c803b2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FTOXPUgS'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ecbfeb-862a-42af-96ec-113380e20ebc]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b332c2-02b4-40cf-a347-22846ac95b37]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3db92dd-b591-417b-8e72-bd39a26c3407]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260]
Nov 29 01:52:19 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260] successful.
Nov 29 01:52:19 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3e4ab3-49ee-4fc3-9e5e-9c23e7f110fb]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[43faffaf-339f-4344-a7b1-bec49df303c5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:52:19 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3280b5ff-740a-4d8a-8d54-7830e0674b9a]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTOXPUgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG nova.network.neutron [req-fffbcbfe-73c3-40e8-8d00-500fd81f0b15 req-3b18ed49-ee9e-4d2b-ad07-0e59ca8e7448 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updated VIF entry in instance network info cache for port 87448b14-8dd8-439b-ae2f-7c2e5a0cf813. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG nova.network.neutron [req-fffbcbfe-73c3-40e8-8d00-500fd81f0b15 req-3b18ed49-ee9e-4d2b-ad07-0e59ca8e7448 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updating instance_info_cache with network_info: [{"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:52:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fffbcbfe-73c3-40e8-8d00-500fd81f0b15 req-3b18ed49-ee9e-4d2b-ad07-0e59ca8e7448 service nova] Releasing lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23435333362303232', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435333362303232', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T01:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-243949346',display_name='tempest-TestShelveInstance-server-243949346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-243949346',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1194317885',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3bf4d56ff4eb43269de28f4acb4578b5',ramdisk_id='',reservation_id='r-713d5ykr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1973174297',owner_user_name='tempest-TestShelveInstance-1973174297-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:52:10Z,user_data=None,user_id='cd46d52d26394d0190fb0060bc2311f1',uuid=0a239b54-6717-4f3c-b455-3326a8f0bdc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Converting VIF {"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.objects.instance [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a239b54-6717-4f3c-b455-3326a8f0bdc2 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.objects.base [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Object Instance<0a239b54-6717-4f3c-b455-3326a8f0bdc2> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:52:20 user nova-compute[75210]:   <uuid>0a239b54-6717-4f3c-b455-3326a8f0bdc2</uuid>
Nov 29 01:52:20 user nova-compute[75210]:   <name>instance-0000001e</name>
Nov 29 01:52:20 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:52:20 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:52:20 user nova-compute[75210]:   <metadata>
Nov 29 01:52:20 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:52:20 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:52:20 user nova-compute[75210]:       <nova:name>tempest-TestShelveInstance-server-243949346</nova:name>
Nov 29 01:52:20 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:52:18</nova:creationTime>
Nov 29 01:52:20 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:52:20 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:52:20 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:52:20 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:52:20 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:52:20 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:52:20 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:52:20 user nova-compute[75210]:       <nova:owner>
Nov 29 01:52:20 user nova-compute[75210]:         <nova:user uuid="cd46d52d26394d0190fb0060bc2311f1">tempest-TestShelveInstance-1973174297-project-member</nova:user>
Nov 29 01:52:20 user nova-compute[75210]:         <nova:project uuid="3bf4d56ff4eb43269de28f4acb4578b5">tempest-TestShelveInstance-1973174297</nova:project>
Nov 29 01:52:20 user nova-compute[75210]:       </nova:owner>
Nov 29 01:52:20 user nova-compute[75210]:       <nova:ports>
Nov 29 01:52:20 user nova-compute[75210]:         <nova:port uuid="87448b14-8dd8-439b-ae2f-7c2e5a0cf813">
Nov 29 01:52:20 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 01:52:20 user nova-compute[75210]:         </nova:port>
Nov 29 01:52:20 user nova-compute[75210]:       </nova:ports>
Nov 29 01:52:20 user nova-compute[75210]:     </nova:instance>
Nov 29 01:52:20 user nova-compute[75210]:   </metadata>
Nov 29 01:52:20 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:52:20 user nova-compute[75210]:     <system>
Nov 29 01:52:20 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:52:20 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:52:20 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:52:20 user nova-compute[75210]:       <entry name="serial">0a239b54-6717-4f3c-b455-3326a8f0bdc2</entry>
Nov 29 01:52:20 user nova-compute[75210]:       <entry name="uuid">0a239b54-6717-4f3c-b455-3326a8f0bdc2</entry>
Nov 29 01:52:20 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:52:20 user nova-compute[75210]:     </system>
Nov 29 01:52:20 user nova-compute[75210]:   </sysinfo>
Nov 29 01:52:20 user nova-compute[75210]:   <os>
Nov 29 01:52:20 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:52:20 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:52:20 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:52:20 user nova-compute[75210]:   </os>
Nov 29 01:52:20 user nova-compute[75210]:   <features>
Nov 29 01:52:20 user nova-compute[75210]:     <acpi/>
Nov 29 01:52:20 user nova-compute[75210]:     <apic/>
Nov 29 01:52:20 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:52:20 user nova-compute[75210]:   </features>
Nov 29 01:52:20 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:52:20 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:52:20 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:52:20 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:52:20 user nova-compute[75210]:   </clock>
Nov 29 01:52:20 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:52:20 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:52:20 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:52:20 user nova-compute[75210]:   </cpu>
Nov 29 01:52:20 user nova-compute[75210]:   <devices>
Nov 29 01:52:20 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:52:20 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:52:20 user nova-compute[75210]:       <source dev="/dev/sdc"/>
Nov 29 01:52:20 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:52:20 user nova-compute[75210]:       <serial>c462ff66-874b-4d31-bf54-0a25b733af23</serial>
Nov 29 01:52:20 user nova-compute[75210]:     </disk>
Nov 29 01:52:20 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:52:20 user nova-compute[75210]:       <mac address="fa:16:3e:89:56:4f"/>
Nov 29 01:52:20 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:52:20 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:52:20 user nova-compute[75210]:       <target dev="tap87448b14-8d"/>
Nov 29 01:52:20 user nova-compute[75210]:     </interface>
Nov 29 01:52:20 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:52:20 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/0a239b54-6717-4f3c-b455-3326a8f0bdc2/console.log" append="off"/>
Nov 29 01:52:20 user nova-compute[75210]:     </serial>
Nov 29 01:52:20 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:52:20 user nova-compute[75210]:     <video>
Nov 29 01:52:20 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:52:20 user nova-compute[75210]:     </video>
Nov 29 01:52:20 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:52:20 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:52:20 user nova-compute[75210]:     </rng>
Nov 29 01:52:20 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:52:20 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:52:20 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:52:20 user nova-compute[75210]:     </memballoon>
Nov 29 01:52:20 user nova-compute[75210]:   </devices>
Nov 29 01:52:20 user nova-compute[75210]: </domain>
Nov 29 01:52:20 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T01:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-243949346',display_name='tempest-TestShelveInstance-server-243949346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-243949346',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1194317885',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:48:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3bf4d56ff4eb43269de28f4acb4578b5',ramdisk_id='',reservation_id='r-713d5ykr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1973174297',owner_user_name='tempest-TestShelveInstance-1973174297-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:52:10Z,user_data=None,user_id='cd46d52d26394d0190fb0060bc2311f1',uuid=0a239b54-6717-4f3c-b455-3326a8f0bdc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Converting VIF {"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG os_vif [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fbfe60d6-e96e-5fa9-8a07-400a5fc77e2d', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87448b14-8d, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87448b14-8d, col_values=(('qos', UUID('197db8d9-05ff-4073-8a77-a7a03ed7136b')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87448b14-8d, col_values=(('external_ids', {'iface-id': '87448b14-8dd8-439b-ae2f-7c2e5a0cf813', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:56:4f', 'vm-uuid': '0a239b54-6717-4f3c-b455-3326a8f0bdc2'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:20 user nova-compute[75210]: INFO os_vif [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d')
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] No VIF found with MAC fa:16:3e:89:56:4f, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:20 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:52:20 user nova-compute[75210]: INFO nova.compute.claims [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Claim successful on node user
Nov 29 01:52:21 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:52:21 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:52:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:21 user nova-compute[75210]: DEBUG nova.compute.manager [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:52:21 user nova-compute[75210]: DEBUG nova.compute.manager [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:52:21 user nova-compute[75210]: DEBUG nova.network.neutron [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:52:21 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:52:21 user nova-compute[75210]: DEBUG nova.compute.manager [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:52:21 user nova-compute[75210]: DEBUG nova.policy [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28fd6f01158e4dd7a7df3e04e815a9d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34af8bfc0e1b4cbbb803c3bf6a8f7715', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:52:21 user nova-compute[75210]: INFO nova.virt.block_device [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Booting with volume-backed-image 7071ee05-5aa5-4613-b78b-8f17b0ec59bc at /dev/vda
Nov 29 01:52:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-65f4a24d-1083-4a56-b1da-aa3248c27592 req-4604e0c9-d9d8-438f-9a26-1bf09f65d234 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-65f4a24d-1083-4a56-b1da-aa3248c27592 req-4604e0c9-d9d8-438f-9a26-1bf09f65d234 service nova] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-65f4a24d-1083-4a56-b1da-aa3248c27592 req-4604e0c9-d9d8-438f-9a26-1bf09f65d234 service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-65f4a24d-1083-4a56-b1da-aa3248c27592 req-4604e0c9-d9d8-438f-9a26-1bf09f65d234 service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-65f4a24d-1083-4a56-b1da-aa3248c27592 req-4604e0c9-d9d8-438f-9a26-1bf09f65d234 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] No waiting events found dispatching network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:52:22 user nova-compute[75210]: WARNING nova.compute.manager [req-65f4a24d-1083-4a56-b1da-aa3248c27592 req-4604e0c9-d9d8-438f-9a26-1bf09f65d234 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received unexpected event network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 01:52:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Successfully created port: 9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Successfully updated port: 9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "refresh_cache-5ea4ce52-dd69-4b51-b066-bec88d069151" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquired lock "refresh_cache-5ea4ce52-dd69-4b51-b066-bec88d069151" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-bf7aedea-2800-4857-92b3-2bf4f2415c4d req-3ffa3f89-adee-4d9e-9aca-381ac4bbcde5 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-changed-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-bf7aedea-2800-4857-92b3-2bf4f2415c4d req-3ffa3f89-adee-4d9e-9aca-381ac4bbcde5 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Refreshing instance network info cache due to event network-changed-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bf7aedea-2800-4857-92b3-2bf4f2415c4d req-3ffa3f89-adee-4d9e-9aca-381ac4bbcde5 service nova] Acquiring lock "refresh_cache-5ea4ce52-dd69-4b51-b066-bec88d069151" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:52:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:52:23 user nova-compute[75210]: DEBUG nova.network.neutron [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Updating instance_info_cache with network_info: [{"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:52:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Releasing lock "refresh_cache-5ea4ce52-dd69-4b51-b066-bec88d069151" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:52:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Instance network_info: |[{"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:52:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bf7aedea-2800-4857-92b3-2bf4f2415c4d req-3ffa3f89-adee-4d9e-9aca-381ac4bbcde5 service nova] Acquired lock "refresh_cache-5ea4ce52-dd69-4b51-b066-bec88d069151" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:52:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-bf7aedea-2800-4857-92b3-2bf4f2415c4d req-3ffa3f89-adee-4d9e-9aca-381ac4bbcde5 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Refreshing network info cache for port 9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:52:23 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:52:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:52:23 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Instance spawned successfully.
Nov 29 01:52:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-99e01c98-5dfe-4681-8e0e-bf38c7f5ae59 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 14.113s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:24 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c163c27f-4cdd-4984-bd3b-eace62b14106 is timed out.
Nov 29 01:52:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Successfully detached device vdb from instance c163c27f-4cdd-4984-bd3b-eace62b14106 from the live domain config.
Nov 29 01:52:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVlrTwxW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:52:24 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG nova.network.neutron [req-bf7aedea-2800-4857-92b3-2bf4f2415c4d req-3ffa3f89-adee-4d9e-9aca-381ac4bbcde5 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Updated VIF entry in instance network info cache for port 9aeb9e13-ef8d-49e6-a98d-75e3fd783cea. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG nova.network.neutron [req-bf7aedea-2800-4857-92b3-2bf4f2415c4d req-3ffa3f89-adee-4d9e-9aca-381ac4bbcde5 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Updating instance_info_cache with network_info: [{"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3738caf1-0c2f-4b98-8e4f-8d780544a349]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:52:24 user nova-compute[75210]: No targets found.
Nov 29 01:52:24 user nova-compute[75210]: iSNS:
Nov 29 01:52:24 user nova-compute[75210]: No targets found.
Nov 29 01:52:24 user nova-compute[75210]: STATIC:
Nov 29 01:52:24 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866
Nov 29 01:52:24 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:52:24 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:52:24 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:52:24 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:52:24 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:52:24 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23
Nov 29 01:52:24 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:52:24 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:52:24 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2
Nov 29 01:52:24 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:52:24 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:52:24 user nova-compute[75210]: FIRMWARE:
Nov 29 01:52:24 user nova-compute[75210]: No targets found.
Nov 29 01:52:24 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:52:24 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:52:24 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-fcac8976-d348-4a14-a932-a3b65c77b098 req-4ca2effb-53ae-47f6-bd5d-ac5a46a7220c service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fcac8976-d348-4a14-a932-a3b65c77b098 req-4ca2effb-53ae-47f6-bd5d-ac5a46a7220c service nova] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fcac8976-d348-4a14-a932-a3b65c77b098 req-4ca2effb-53ae-47f6-bd5d-ac5a46a7220c service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fcac8976-d348-4a14-a932-a3b65c77b098 req-4ca2effb-53ae-47f6-bd5d-ac5a46a7220c service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-fcac8976-d348-4a14-a932-a3b65c77b098 req-4ca2effb-53ae-47f6-bd5d-ac5a46a7220c service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] No waiting events found dispatching network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:52:24 user nova-compute[75210]: WARNING nova.compute.manager [req-fcac8976-d348-4a14-a932-a3b65c77b098 req-4ca2effb-53ae-47f6-bd5d-ac5a46a7220c service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received unexpected event network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 for instance with vm_state active and task_state None.
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bf7aedea-2800-4857-92b3-2bf4f2415c4d req-3ffa3f89-adee-4d9e-9aca-381ac4bbcde5 service nova] Releasing lock "refresh_cache-5ea4ce52-dd69-4b51-b066-bec88d069151" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae93125f-3897-41e0-acf6-041fdabfed8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9532e4-ce94-41f7-a65d-b0bf60b8b9c8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:24 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:52:24 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:24 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:52:24 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:24 user nova-compute[75210]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 (non-flash)
Nov 29 01:52:24 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:24 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:52:24 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f240813e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2'): ({'sde'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Removing single pathed devices sde {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[55256709-13fd-41d1-a69f-ab20b68887e5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f54e3e8-6889-4f73-a63e-6025834d9354]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Flushing IO for device /dev/sde {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6126be2e-635c-45ce-81b9-b06fc7183d04]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[903b8123-196d-4f56-b572-bfd7aac1517f]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b1f6e2-eecb-495d-a76e-52a7c7cc20d2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bb389f-b372-4573-8397-cb26b2ba4b03]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2, portal: 172.16.0.220,3260]
Nov 29 01:52:24 user nova-compute[75210]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2, portal: 172.16.0.220,3260] successful.
Nov 29 01:52:24 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cae315-af7b-4d9d-9e6a-de12e9f897e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3c8133-b3e8-442a-83ff-dd2d1c94345d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] <== disconnect_volume: return (351ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:52:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:52:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:25 user nova-compute[75210]: DEBUG nova.objects.instance [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lazy-loading 'flavor' on Instance uuid c163c27f-4cdd-4984-bd3b-eace62b14106 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9f0a17fd-006b-4bbf-83c8-22c7e68fb8b2 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.861s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:26 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:26 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-0baa7687-c666-4956-b207-8620e1c8e862 req-71e76b4b-d650-48e2-9be4-435ed4e153cc service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-changed-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-0baa7687-c666-4956-b207-8620e1c8e862 req-71e76b4b-d650-48e2-9be4-435ed4e153cc service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Refreshing instance network info cache due to event network-changed-312421b0-0d55-4735-9810-310e70a30881. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:52:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0baa7687-c666-4956-b207-8620e1c8e862 req-71e76b4b-d650-48e2-9be4-435ed4e153cc service nova] Acquiring lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:52:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0baa7687-c666-4956-b207-8620e1c8e862 req-71e76b4b-d650-48e2-9be4-435ed4e153cc service nova] Acquired lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:52:26 user nova-compute[75210]: DEBUG nova.network.neutron [req-0baa7687-c666-4956-b207-8620e1c8e862 req-71e76b4b-d650-48e2-9be4-435ed4e153cc service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Refreshing network info cache for port 312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "c320d76b-58e8-4032-bef3-3aead513231e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG nova.objects.instance [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'flavor' on Instance uuid c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "c320d76b-58e8-4032-bef3-3aead513231e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG nova.network.neutron [req-0baa7687-c666-4956-b207-8620e1c8e862 req-71e76b4b-d650-48e2-9be4-435ed4e153cc service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Updated VIF entry in instance network info cache for port 312421b0-0d55-4735-9810-310e70a30881. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG nova.network.neutron [req-0baa7687-c666-4956-b207-8620e1c8e862 req-71e76b4b-d650-48e2-9be4-435ed4e153cc service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Updating instance_info_cache with network_info: [{"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0baa7687-c666-4956-b207-8620e1c8e862 req-71e76b4b-d650-48e2-9be4-435ed4e153cc service nova] Releasing lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG os_brick.utils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c032e7bc-a1c0-40a7-9a4e-0f8905cf583e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0426ceb7-b1ec-493e-96e5-7f64c69cc804]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "c320d76b-58e8-4032-bef3-3aead513231e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:27 user nova-compute[75210]: INFO nova.compute.manager [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Attaching volume 77e6b650-cec4-4c0e-9f51-b8c3f22c1823 to /dev/vdb
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b53426a-560e-49b1-a8ba-cc22c5c64faf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d655646c-2fb1-4b1e-bd81-aeed092a2093]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG os_brick.utils [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:52:27 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7647fc67-ff89-42fc-9f37-377d8cae0533]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG os_brick.utils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Updating existing volume attachment record: 447d2e41-3e61-43ce-b46f-8eb57b882666 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f481b2-b014-4fa2-b436-a62dd888726e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27f76d3-246b-4a57-bbae-2aa04013c49b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94eda6e-1a62-4e99-80bc-f20bf062c1b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0d3609-5274-4357-8cb3-62245fafb37f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:52:27 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:52:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[74706bad-8614-4d1c-aad8-9de228c36e6c]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG os_brick.utils [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:52:27 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Updating existing volume attachment record: 294b33ff-2bdd-476f-b438-7684d34c6b0c {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:52:28 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:52:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:52:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:52:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:52:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Updating instance_info_cache with network_info: [{"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:52:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:52:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:52:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:31 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:32 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:32 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:33 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:33 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:52:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKvplVYM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:52:35 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:52:35 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:52:35 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[45591ecb-2453-49c5-bd1e-6086ea78d6b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:52:35 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f541347-7308-4b31-829d-c2892bd003dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823] added
Nov 29 01:52:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2ee688-0ebe-49d4-adc2-6233a449ed59]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e30902-ba2b-46c9-b0a8-40bf2b7f70c3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKvplVYM {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKvplVYM" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d71b85-6e83-45a2-9052-434a2d8f2959]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UKvplVYM'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a57d7a-9a8e-47a8-87a7-bbb14de78b0f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[639c89df-baff-45ca-832f-75c84e43aff7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea80a81d-e7ad-4755-8ff4-e410ee3460db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823, portal: 172.16.0.220,3260]
Nov 29 01:52:35 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823, portal: 172.16.0.220,3260] successful.
Nov 29 01:52:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a5de14-51b1-46ac-a21c-70ba1b96031e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ad5227-bed5-41c6-a6d5-ee7fe4eaf0d4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:52:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.compute.manager [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:52:35 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Creating image(s)
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Ensure instance console log exists: /opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Start _get_guest_xml network_info=[{"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '447d2e41-3e61-43ce-b46f-8eb57b882666', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoGMuFnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ea4ce52-dd69-4b51-b066-bec88d069151', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7ee48ba-8fc7-46c6-a549-ec71825f29fc', 'serial': 'c7ee48ba-8fc7-46c6-a549-ec71825f29fc'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a277c0-15f9-4993-8a7e-d2dcce9fba45]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKvplVYM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:52:35 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:52:35 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoGMuFnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:52:35 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:52:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23835653264306439', 'path': '/dev/sde'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835653264306439', 'path': '/dev/sde'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.957s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:52:36 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:52:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:52:36 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5e874f-ed1e-4208-910c-12b119a6221f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:52:36 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG nova.objects.instance [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'flavor' on Instance uuid c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5028951-dd1a-4bd7-a72f-74ba60738c9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc] added
Nov 29 01:52:36 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4ef7c4-98ca-456f-b1c5-25fc6531a2cf]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:52:36 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:52:36 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 01:52:36 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:52:36 user nova-compute[75210]:   <serial>77e6b650-cec4-4c0e-9f51-b8c3f22c1823</serial>
Nov 29 01:52:36 user nova-compute[75210]: </disk>
Nov 29 01:52:36 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b25e1c-a220-4e75-b043-f83540fa864b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoGMuFnY {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoGMuFnY" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0ed1a7-dd66-4db2-a9a5-1bd6ba534d88]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WoGMuFnY'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e47a19c-2161-4498-b320-9cc32290d2d7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f15e7d4-e001-4213-83ed-5bbe1457e67d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:36 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:36 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:52:36 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:52:36 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:52:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:36 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:36 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:52:36 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:52:36 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b892488d-6d88-4a4d-a750-d6fc5efacda2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc, portal: 172.16.0.220,3260]
Nov 29 01:52:37 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc, portal: 172.16.0.220,3260] successful.
Nov 29 01:52:37 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:37 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:52:37 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7916MB free_disk=25.104278564453125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4115c88-0ecb-44ed-b0e0-a69320d3bed3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No VIF found with MAC fa:16:3e:f3:49:51, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce907bea-0324-4d76-b053-e4ed72b5dbac]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:37 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:37 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:52:37 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:52:37 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:52:37 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:52:37 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:52:37 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:52:37 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:52:37 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:52:37 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.775s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8846c4-d419-4e38-980c-86a0600a39e5]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoGMuFnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-be1be0d8-bab8-43fc-9a75-5980ca4353ab tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "c320d76b-58e8-4032-bef3-3aead513231e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.330s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c163c27f-4cdd-4984-bd3b-eace62b14106 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 4fab87e3-2f7c-4db4-9f14-ace1813fe046 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3df17188-c87e-49e5-9ca2-5d04632ea9bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c320d76b-58e8-4032-bef3-3aead513231e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 0a239b54-6717-4f3c-b455-3326a8f0bdc2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 5ea4ce52-dd69-4b51-b066-bec88d069151 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing inventories for resource provider 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating ProviderTree inventory for provider 28871a06-d5c8-43d0-87af-3689cd143011 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating inventory in ProviderTree for provider 28871a06-d5c8-43d0-87af-3689cd143011 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing aggregate associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, aggregates: None {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 01:52:37 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing trait associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, traits: HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.757s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.835s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] <== connect_volume: return (2793ms) {'type': 'block', 'scsi_wwn': '23931653632623464', 'path': '/dev/sdf'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931653632623464', 'path': '/dev/sdf'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-549585726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-549585726',id=34,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-dd94ph0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:52:21Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=5ea4ce52-dd69-4b51-b066-bec88d069151,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:68:b4,bridge_name='br-int',has_traffic_filtering=True,id=9aeb9e13-ef8d-49e6-a98d-75e3fd783cea,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aeb9e13-ef') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.objects.instance [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ea4ce52-dd69-4b51-b066-bec88d069151 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:38 user nova-compute[75210]: INFO nova.compute.manager [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Rescuing
Nov 29 01:52:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquired lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.network.neutron [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:52:38 user nova-compute[75210]:   <uuid>5ea4ce52-dd69-4b51-b066-bec88d069151</uuid>
Nov 29 01:52:38 user nova-compute[75210]:   <name>instance-00000022</name>
Nov 29 01:52:38 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:52:38 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:52:38 user nova-compute[75210]:   <metadata>
Nov 29 01:52:38 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:52:38 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:52:38 user nova-compute[75210]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-549585726</nova:name>
Nov 29 01:52:38 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:52:35</nova:creationTime>
Nov 29 01:52:38 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:52:38 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:52:38 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:52:38 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:52:38 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:52:38 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:52:38 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:52:38 user nova-compute[75210]:       <nova:owner>
Nov 29 01:52:38 user nova-compute[75210]:         <nova:user uuid="28fd6f01158e4dd7a7df3e04e815a9d0">tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member</nova:user>
Nov 29 01:52:38 user nova-compute[75210]:         <nova:project uuid="34af8bfc0e1b4cbbb803c3bf6a8f7715">tempest-ServerBootFromVolumeStableRescueTest-440893694</nova:project>
Nov 29 01:52:38 user nova-compute[75210]:       </nova:owner>
Nov 29 01:52:38 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:52:38 user nova-compute[75210]:       <nova:ports>
Nov 29 01:52:38 user nova-compute[75210]:         <nova:port uuid="9aeb9e13-ef8d-49e6-a98d-75e3fd783cea">
Nov 29 01:52:38 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 01:52:38 user nova-compute[75210]:         </nova:port>
Nov 29 01:52:38 user nova-compute[75210]:       </nova:ports>
Nov 29 01:52:38 user nova-compute[75210]:     </nova:instance>
Nov 29 01:52:38 user nova-compute[75210]:   </metadata>
Nov 29 01:52:38 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:52:38 user nova-compute[75210]:     <system>
Nov 29 01:52:38 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:52:38 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:52:38 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:52:38 user nova-compute[75210]:       <entry name="serial">5ea4ce52-dd69-4b51-b066-bec88d069151</entry>
Nov 29 01:52:38 user nova-compute[75210]:       <entry name="uuid">5ea4ce52-dd69-4b51-b066-bec88d069151</entry>
Nov 29 01:52:38 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:52:38 user nova-compute[75210]:     </system>
Nov 29 01:52:38 user nova-compute[75210]:   </sysinfo>
Nov 29 01:52:38 user nova-compute[75210]:   <os>
Nov 29 01:52:38 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:52:38 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:52:38 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:52:38 user nova-compute[75210]:   </os>
Nov 29 01:52:38 user nova-compute[75210]:   <features>
Nov 29 01:52:38 user nova-compute[75210]:     <acpi/>
Nov 29 01:52:38 user nova-compute[75210]:     <apic/>
Nov 29 01:52:38 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:52:38 user nova-compute[75210]:   </features>
Nov 29 01:52:38 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:52:38 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:52:38 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:52:38 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:52:38 user nova-compute[75210]:   </clock>
Nov 29 01:52:38 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:52:38 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:52:38 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:52:38 user nova-compute[75210]:   </cpu>
Nov 29 01:52:38 user nova-compute[75210]:   <devices>
Nov 29 01:52:38 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:52:38 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:52:38 user nova-compute[75210]:       <source dev="/dev/sdf"/>
Nov 29 01:52:38 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:52:38 user nova-compute[75210]:       <serial>c7ee48ba-8fc7-46c6-a549-ec71825f29fc</serial>
Nov 29 01:52:38 user nova-compute[75210]:     </disk>
Nov 29 01:52:38 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:52:38 user nova-compute[75210]:       <mac address="fa:16:3e:97:68:b4"/>
Nov 29 01:52:38 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:52:38 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:52:38 user nova-compute[75210]:       <target dev="tap9aeb9e13-ef"/>
Nov 29 01:52:38 user nova-compute[75210]:     </interface>
Nov 29 01:52:38 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:52:38 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/console.log" append="off"/>
Nov 29 01:52:38 user nova-compute[75210]:     </serial>
Nov 29 01:52:38 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:52:38 user nova-compute[75210]:     <video>
Nov 29 01:52:38 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:52:38 user nova-compute[75210]:     </video>
Nov 29 01:52:38 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:52:38 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:52:38 user nova-compute[75210]:     </rng>
Nov 29 01:52:38 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:52:38 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:52:38 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:52:38 user nova-compute[75210]:     </memballoon>
Nov 29 01:52:38 user nova-compute[75210]:   </devices>
Nov 29 01:52:38 user nova-compute[75210]: </domain>
Nov 29 01:52:38 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-549585726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-549585726',id=34,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-dd94ph0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:52:21Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=5ea4ce52-dd69-4b51-b066-bec88d069151,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:68:b4,bridge_name='br-int',has_traffic_filtering=True,id=9aeb9e13-ef8d-49e6-a98d-75e3fd783cea,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aeb9e13-ef') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG os_vif [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:68:b4,bridge_name='br-int',has_traffic_filtering=True,id=9aeb9e13-ef8d-49e6-a98d-75e3fd783cea,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aeb9e13-ef') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02d00a10-9bb9-5b4a-810a-43ac850cdcc0', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9aeb9e13-ef, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9aeb9e13-ef, col_values=(('qos', UUID('60c79dfd-60a6-44ed-963a-74f68b92e1f0')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9aeb9e13-ef, col_values=(('external_ids', {'iface-id': '9aeb9e13-ef8d-49e6-a98d-75e3fd783cea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:68:b4', 'vm-uuid': '5ea4ce52-dd69-4b51-b066-bec88d069151'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:38 user nova-compute[75210]: INFO os_vif [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:68:b4,bridge_name='br-int',has_traffic_filtering=True,id=9aeb9e13-ef8d-49e6-a98d-75e3fd783cea,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aeb9e13-ef')
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:52:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No VIF found with MAC fa:16:3e:97:68:b4, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:52:39 user nova-compute[75210]: DEBUG nova.network.neutron [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Updating instance_info_cache with network_info: [{"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:52:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Releasing lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:52:39 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:39 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:52:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:39 user nova-compute[75210]: DEBUG nova.compute.manager [req-a1e7b36d-1a9e-4b01-bf5a-31fd43b42fb4 req-8ac8063f-b304-4d8b-954b-187e3cce61f5 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-unplugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a1e7b36d-1a9e-4b01-bf5a-31fd43b42fb4 req-8ac8063f-b304-4d8b-954b-187e3cce61f5 service nova] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a1e7b36d-1a9e-4b01-bf5a-31fd43b42fb4 req-8ac8063f-b304-4d8b-954b-187e3cce61f5 service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a1e7b36d-1a9e-4b01-bf5a-31fd43b42fb4 req-8ac8063f-b304-4d8b-954b-187e3cce61f5 service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:39 user nova-compute[75210]: DEBUG nova.compute.manager [req-a1e7b36d-1a9e-4b01-bf5a-31fd43b42fb4 req-8ac8063f-b304-4d8b-954b-187e3cce61f5 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] No waiting events found dispatching network-vif-unplugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:52:39 user nova-compute[75210]: WARNING nova.compute.manager [req-a1e7b36d-1a9e-4b01-bf5a-31fd43b42fb4 req-8ac8063f-b304-4d8b-954b-187e3cce61f5 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received unexpected event network-vif-unplugged-312421b0-0d55-4735-9810-310e70a30881 for instance with vm_state active and task_state rescuing.
Nov 29 01:52:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:40 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Instance destroyed successfully.
Nov 29 01:52:40 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Attempting rescue
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75210) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Instance directory exists: not creating {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 01:52:40 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Creating image(s)
Nov 29 01:52:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "/opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "/opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "/opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.objects.instance [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'trusted_certs' on Instance uuid c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-8f3a4995-5c3b-4311-a786-7137000009e2 req-1e5aeb49-94eb-4720-ad73-d1e22b5c11a8 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8f3a4995-5c3b-4311-a786-7137000009e2 req-1e5aeb49-94eb-4720-ad73-d1e22b5c11a8 service nova] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8f3a4995-5c3b-4311-a786-7137000009e2 req-1e5aeb49-94eb-4720-ad73-d1e22b5c11a8 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8f3a4995-5c3b-4311-a786-7137000009e2 req-1e5aeb49-94eb-4720-ad73-d1e22b5c11a8 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-8f3a4995-5c3b-4311-a786-7137000009e2 req-1e5aeb49-94eb-4720-ad73-d1e22b5c11a8 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] No waiting events found dispatching network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:52:40 user nova-compute[75210]: WARNING nova.compute.manager [req-8f3a4995-5c3b-4311-a786-7137000009e2 req-1e5aeb49-94eb-4720-ad73-d1e22b5c11a8 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received unexpected event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea for instance with vm_state building and task_state spawning.
Nov 29 01:52:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.192s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk.rescue {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk.rescue" returned: 0 in 0.060s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.objects.instance [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'migration_context' on Instance uuid c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.objects.base [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<c320d76b-58e8-4032-bef3-3aead513231e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Start _get_guest_xml network_info=[{"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "vif_mac": "fa:16:3e:f3:49:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.objects.instance [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'resources' on Instance uuid c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.objects.base [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<c320d76b-58e8-4032-bef3-3aead513231e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.objects.instance [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'numa_topology' on Instance uuid c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.objects.base [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<c320d76b-58e8-4032-bef3-3aead513231e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:52:40 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:52:40 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.objects.instance [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'vcpu_model' on Instance uuid c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.objects.base [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<c320d76b-58e8-4032-bef3-3aead513231e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:50:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-849162623',display_name='tempest-ServerRescueNegativeTestJSON-server-849162623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-849162623',id=33,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJg8slG8367U75ZSuTZzcgZW/XtJwbbU3K3GG0kWtPdNOpehMl9ysb0/U5N2JjcTlVneKBPkybYoSEOg0i9hlNe1spmrLC+aGK+IZC9PmV/YWkG+JGEWRilkYLgKZ0O2A==',key_name='tempest-keypair-780592974',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:50:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ea74c32e3354c9bb76465b39f437026',ramdisk_id='',reservation_id='r-pvgqd49k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-948038897',owner_user_name='tempest-ServerRescueNegativeTestJSON-948038897-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:50:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='339a0127c78144a989498320081f2c15',uuid=c320d76b-58e8-4032-bef3-3aead513231e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "vif_mac": "fa:16:3e:f3:49:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converting VIF {"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "vif_mac": "fa:16:3e:f3:49:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:49:51,bridge_name='br-int',has_traffic_filtering=True,id=312421b0-0d55-4735-9810-310e70a30881,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312421b0-0d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.objects.instance [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'pci_devices' on Instance uuid c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.objects.base [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Object Instance<c320d76b-58e8-4032-bef3-3aead513231e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:52:40 user nova-compute[75210]:   <uuid>c320d76b-58e8-4032-bef3-3aead513231e</uuid>
Nov 29 01:52:40 user nova-compute[75210]:   <name>instance-00000021</name>
Nov 29 01:52:40 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:52:40 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:52:40 user nova-compute[75210]:   <metadata>
Nov 29 01:52:40 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:52:40 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:52:40 user nova-compute[75210]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-849162623</nova:name>
Nov 29 01:52:40 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:52:40</nova:creationTime>
Nov 29 01:52:40 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:52:40 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:52:40 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:52:40 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:52:40 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:52:40 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:52:40 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:52:40 user nova-compute[75210]:       <nova:owner>
Nov 29 01:52:40 user nova-compute[75210]:         <nova:user uuid="339a0127c78144a989498320081f2c15">tempest-ServerRescueNegativeTestJSON-948038897-project-member</nova:user>
Nov 29 01:52:40 user nova-compute[75210]:         <nova:project uuid="9ea74c32e3354c9bb76465b39f437026">tempest-ServerRescueNegativeTestJSON-948038897</nova:project>
Nov 29 01:52:40 user nova-compute[75210]:       </nova:owner>
Nov 29 01:52:40 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:52:40 user nova-compute[75210]:       <nova:ports>
Nov 29 01:52:40 user nova-compute[75210]:         <nova:port uuid="312421b0-0d55-4735-9810-310e70a30881">
Nov 29 01:52:40 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 01:52:40 user nova-compute[75210]:         </nova:port>
Nov 29 01:52:40 user nova-compute[75210]:       </nova:ports>
Nov 29 01:52:40 user nova-compute[75210]:     </nova:instance>
Nov 29 01:52:40 user nova-compute[75210]:   </metadata>
Nov 29 01:52:40 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:52:40 user nova-compute[75210]:     <system>
Nov 29 01:52:40 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:52:40 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:52:40 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:52:40 user nova-compute[75210]:       <entry name="serial">c320d76b-58e8-4032-bef3-3aead513231e</entry>
Nov 29 01:52:40 user nova-compute[75210]:       <entry name="uuid">c320d76b-58e8-4032-bef3-3aead513231e</entry>
Nov 29 01:52:40 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:52:40 user nova-compute[75210]:     </system>
Nov 29 01:52:40 user nova-compute[75210]:   </sysinfo>
Nov 29 01:52:40 user nova-compute[75210]:   <os>
Nov 29 01:52:40 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:52:40 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:52:40 user nova-compute[75210]:   </os>
Nov 29 01:52:40 user nova-compute[75210]:   <features>
Nov 29 01:52:40 user nova-compute[75210]:     <acpi/>
Nov 29 01:52:40 user nova-compute[75210]:     <apic/>
Nov 29 01:52:40 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:52:40 user nova-compute[75210]:   </features>
Nov 29 01:52:40 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:52:40 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:52:40 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:52:40 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:52:40 user nova-compute[75210]:   </clock>
Nov 29 01:52:40 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:52:40 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:52:40 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:52:40 user nova-compute[75210]:   </cpu>
Nov 29 01:52:40 user nova-compute[75210]:   <devices>
Nov 29 01:52:40 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:52:40 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:52:40 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk.rescue"/>
Nov 29 01:52:40 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:52:40 user nova-compute[75210]:     </disk>
Nov 29 01:52:40 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:52:40 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:52:40 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk"/>
Nov 29 01:52:40 user nova-compute[75210]:       <target dev="vdb" bus="virtio"/>
Nov 29 01:52:40 user nova-compute[75210]:     </disk>
Nov 29 01:52:40 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:52:40 user nova-compute[75210]:       <mac address="fa:16:3e:f3:49:51"/>
Nov 29 01:52:40 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:52:40 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:52:40 user nova-compute[75210]:       <target dev="tap312421b0-0d"/>
Nov 29 01:52:40 user nova-compute[75210]:     </interface>
Nov 29 01:52:40 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:52:40 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/console.log" append="off"/>
Nov 29 01:52:40 user nova-compute[75210]:     </serial>
Nov 29 01:52:40 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:52:40 user nova-compute[75210]:     <video>
Nov 29 01:52:40 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:52:40 user nova-compute[75210]:     </video>
Nov 29 01:52:40 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:52:40 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:52:40 user nova-compute[75210]:     </rng>
Nov 29 01:52:40 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:52:40 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:52:40 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:52:40 user nova-compute[75210]:     </memballoon>
Nov 29 01:52:40 user nova-compute[75210]:   </devices>
Nov 29 01:52:40 user nova-compute[75210]: </domain>
Nov 29 01:52:40 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:52:40 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Instance destroyed successfully.
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:52:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] No VIF found with MAC fa:16:3e:f3:49:51, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:52:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:41 user nova-compute[75210]: DEBUG nova.compute.manager [req-a83ae7e5-c710-45f1-83ab-bcfbde4f4e1e req-653e2532-b6ff-4495-a1de-f4967bd2b154 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a83ae7e5-c710-45f1-83ab-bcfbde4f4e1e req-653e2532-b6ff-4495-a1de-f4967bd2b154 service nova] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a83ae7e5-c710-45f1-83ab-bcfbde4f4e1e req-653e2532-b6ff-4495-a1de-f4967bd2b154 service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a83ae7e5-c710-45f1-83ab-bcfbde4f4e1e req-653e2532-b6ff-4495-a1de-f4967bd2b154 service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:41 user nova-compute[75210]: DEBUG nova.compute.manager [req-a83ae7e5-c710-45f1-83ab-bcfbde4f4e1e req-653e2532-b6ff-4495-a1de-f4967bd2b154 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] No waiting events found dispatching network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:52:41 user nova-compute[75210]: WARNING nova.compute.manager [req-a83ae7e5-c710-45f1-83ab-bcfbde4f4e1e req-653e2532-b6ff-4495-a1de-f4967bd2b154 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received unexpected event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 for instance with vm_state active and task_state rescuing.
Nov 29 01:52:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG nova.compute.manager [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:52:42 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Instance spawned successfully.
Nov 29 01:52:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:52:42 user nova-compute[75210]: INFO nova.compute.manager [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Took 6.74 seconds to spawn the instance on the hypervisor.
Nov 29 01:52:42 user nova-compute[75210]: DEBUG nova.compute.manager [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-7d9fe42e-6ffe-4ff6-8c53-2605062504e9 req-4dcd41f1-3f3c-4097-a957-082b043654ea service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7d9fe42e-6ffe-4ff6-8c53-2605062504e9 req-4dcd41f1-3f3c-4097-a957-082b043654ea service nova] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7d9fe42e-6ffe-4ff6-8c53-2605062504e9 req-4dcd41f1-3f3c-4097-a957-082b043654ea service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7d9fe42e-6ffe-4ff6-8c53-2605062504e9 req-4dcd41f1-3f3c-4097-a957-082b043654ea service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-7d9fe42e-6ffe-4ff6-8c53-2605062504e9 req-4dcd41f1-3f3c-4097-a957-082b043654ea service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] No waiting events found dispatching network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:52:42 user nova-compute[75210]: WARNING nova.compute.manager [req-7d9fe42e-6ffe-4ff6-8c53-2605062504e9 req-4dcd41f1-3f3c-4097-a957-082b043654ea service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received unexpected event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea for instance with vm_state building and task_state spawning.
Nov 29 01:52:42 user nova-compute[75210]: INFO nova.compute.manager [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Took 22.05 seconds to build instance.
Nov 29 01:52:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-333eb62f-84c4-4b8a-bbad-6c76a9a23922 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.150s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 01:52:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] There are 0 instances to clean {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 01:52:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-58c09e4f-b718-45b7-9f9f-a48e41354064 req-9ea1cd54-455e-4329-b44d-ea7de825627b service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-58c09e4f-b718-45b7-9f9f-a48e41354064 req-9ea1cd54-455e-4329-b44d-ea7de825627b service nova] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-58c09e4f-b718-45b7-9f9f-a48e41354064 req-9ea1cd54-455e-4329-b44d-ea7de825627b service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-58c09e4f-b718-45b7-9f9f-a48e41354064 req-9ea1cd54-455e-4329-b44d-ea7de825627b service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-58c09e4f-b718-45b7-9f9f-a48e41354064 req-9ea1cd54-455e-4329-b44d-ea7de825627b service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] No waiting events found dispatching network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:52:43 user nova-compute[75210]: WARNING nova.compute.manager [req-58c09e4f-b718-45b7-9f9f-a48e41354064 req-9ea1cd54-455e-4329-b44d-ea7de825627b service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received unexpected event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 for instance with vm_state active and task_state rescuing.
Nov 29 01:52:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-58c09e4f-b718-45b7-9f9f-a48e41354064 req-9ea1cd54-455e-4329-b44d-ea7de825627b service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-58c09e4f-b718-45b7-9f9f-a48e41354064 req-9ea1cd54-455e-4329-b44d-ea7de825627b service nova] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-58c09e4f-b718-45b7-9f9f-a48e41354064 req-9ea1cd54-455e-4329-b44d-ea7de825627b service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-58c09e4f-b718-45b7-9f9f-a48e41354064 req-9ea1cd54-455e-4329-b44d-ea7de825627b service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-58c09e4f-b718-45b7-9f9f-a48e41354064 req-9ea1cd54-455e-4329-b44d-ea7de825627b service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] No waiting events found dispatching network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:52:43 user nova-compute[75210]: WARNING nova.compute.manager [req-58c09e4f-b718-45b7-9f9f-a48e41354064 req-9ea1cd54-455e-4329-b44d-ea7de825627b service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received unexpected event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 for instance with vm_state active and task_state rescuing.
Nov 29 01:52:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:44 user nova-compute[75210]: DEBUG nova.compute.manager [None req-7a69e1c6-89a5-44fe-9c75-8db8b61bb29c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:52:45 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances with incomplete migration  {{(pid=75210) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 01:52:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "c163c27f-4cdd-4984-bd3b-eace62b14106" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:53 user nova-compute[75210]: INFO nova.compute.manager [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Terminating instance
Nov 29 01:52:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-819a7a7e-5a78-4247-acf1-8d37651384bf req-f06ac033-733d-42da-bb63-c6ee8024c448 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Received event network-vif-unplugged-fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-819a7a7e-5a78-4247-acf1-8d37651384bf req-f06ac033-733d-42da-bb63-c6ee8024c448 service nova] Acquiring lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-819a7a7e-5a78-4247-acf1-8d37651384bf req-f06ac033-733d-42da-bb63-c6ee8024c448 service nova] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-819a7a7e-5a78-4247-acf1-8d37651384bf req-f06ac033-733d-42da-bb63-c6ee8024c448 service nova] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-819a7a7e-5a78-4247-acf1-8d37651384bf req-f06ac033-733d-42da-bb63-c6ee8024c448 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] No waiting events found dispatching network-vif-unplugged-fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-819a7a7e-5a78-4247-acf1-8d37651384bf req-f06ac033-733d-42da-bb63-c6ee8024c448 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Received event network-vif-unplugged-fbe23d5a-6995-423e-b74f-bcf005dfe21a for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:54 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Instance destroyed successfully.
Nov 29 01:52:54 user nova-compute[75210]: DEBUG nova.objects.instance [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lazy-loading 'resources' on Instance uuid c163c27f-4cdd-4984-bd3b-eace62b14106 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:48:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1169725864',display_name='tempest-TestServerVolumeAttachmentScenario-server-1169725864',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1169725864',id=31,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOquyQcMmb9Q0NUpdfmvEFvGn2//8iMT6Thg7V3dr+m9dTX5PHIqP8TU1rgJxMHAcOl9R+gU/i9YHKHFH80O/WsbZpn+o3geRZ0ztpd+CobL+awUCVefhBWglJOAm/MrRQ==',key_name='tempest-keypair-1750497578',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:48:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ed239b27cbd47a0a1ce5246177a992e',ramdisk_id='',reservation_id='r-jopnajcp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-465000080',owner_user_name='tempest-TestServerVolumeAttachmentScenario-465000080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:48:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8b86193fc42f43c7bfe2183f7edd9964',uuid=c163c27f-4cdd-4984-bd3b-eace62b14106,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "address": "fa:16:3e:c9:c0:98", "network": {"id": "0b0059b2-e0a1-4d16-beee-c6fdf4a04431", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518067088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ed239b27cbd47a0a1ce5246177a992e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe23d5a-69", "ovs_interfaceid": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Converting VIF {"id": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "address": "fa:16:3e:c9:c0:98", "network": {"id": "0b0059b2-e0a1-4d16-beee-c6fdf4a04431", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518067088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ed239b27cbd47a0a1ce5246177a992e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbe23d5a-69", "ovs_interfaceid": "fbe23d5a-6995-423e-b74f-bcf005dfe21a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=fbe23d5a-6995-423e-b74f-bcf005dfe21a,network=Network(0b0059b2-e0a1-4d16-beee-c6fdf4a04431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe23d5a-69') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG os_vif [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=fbe23d5a-6995-423e-b74f-bcf005dfe21a,network=Network(0b0059b2-e0a1-4d16-beee-c6fdf4a04431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe23d5a-69') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbe23d5a-69, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3718d4fa-6e50-4e13-929d-2d692d05abca) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:52:54 user nova-compute[75210]: INFO os_vif [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:c0:98,bridge_name='br-int',has_traffic_filtering=True,id=fbe23d5a-6995-423e-b74f-bcf005dfe21a,network=Network(0b0059b2-e0a1-4d16-beee-c6fdf4a04431),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbe23d5a-69')
Nov 29 01:52:54 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Deleting instance files /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106_del
Nov 29 01:52:54 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Deletion of /opt/stack/data/nova/instances/c163c27f-4cdd-4984-bd3b-eace62b14106_del complete
Nov 29 01:52:54 user nova-compute[75210]: INFO nova.compute.manager [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 01:52:54 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:52:54 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:52:55 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:52:55 user nova-compute[75210]: DEBUG nova.compute.manager [req-e0d547a6-159a-407a-9de9-416d2864f1de req-86f128cb-d951-49a1-ac32-2cb6f0308c09 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Received event network-vif-deleted-fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:55 user nova-compute[75210]: INFO nova.compute.manager [req-e0d547a6-159a-407a-9de9-416d2864f1de req-86f128cb-d951-49a1-ac32-2cb6f0308c09 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Neutron deleted interface fbe23d5a-6995-423e-b74f-bcf005dfe21a; detaching it from the instance and deleting it from the info cache
Nov 29 01:52:55 user nova-compute[75210]: DEBUG nova.network.neutron [req-e0d547a6-159a-407a-9de9-416d2864f1de req-86f128cb-d951-49a1-ac32-2cb6f0308c09 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:52:55 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Took 0.72 seconds to deallocate network for instance.
Nov 29 01:52:55 user nova-compute[75210]: DEBUG nova.compute.manager [req-e0d547a6-159a-407a-9de9-416d2864f1de req-86f128cb-d951-49a1-ac32-2cb6f0308c09 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Detach interface failed, port_id=fbe23d5a-6995-423e-b74f-bcf005dfe21a, reason: Instance c163c27f-4cdd-4984-bd3b-eace62b14106 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:52:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.494s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:56 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Deleted allocations for instance c163c27f-4cdd-4984-bd3b-eace62b14106
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-97f56a4b-b6ac-4db1-9f9a-1e90cd596637 tempest-TestServerVolumeAttachmentScenario-465000080 tempest-TestServerVolumeAttachmentScenario-465000080-project-member] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.392s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-2e3e0960-d670-4703-9054-db4b8d4f73a4 req-4657363f-58e6-4552-bf63-5c8a45f5f960 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Received event network-vif-plugged-fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2e3e0960-d670-4703-9054-db4b8d4f73a4 req-4657363f-58e6-4552-bf63-5c8a45f5f960 service nova] Acquiring lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2e3e0960-d670-4703-9054-db4b8d4f73a4 req-4657363f-58e6-4552-bf63-5c8a45f5f960 service nova] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2e3e0960-d670-4703-9054-db4b8d4f73a4 req-4657363f-58e6-4552-bf63-5c8a45f5f960 service nova] Lock "c163c27f-4cdd-4984-bd3b-eace62b14106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-2e3e0960-d670-4703-9054-db4b8d4f73a4 req-4657363f-58e6-4552-bf63-5c8a45f5f960 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] No waiting events found dispatching network-vif-plugged-fbe23d5a-6995-423e-b74f-bcf005dfe21a {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:52:56 user nova-compute[75210]: WARNING nova.compute.manager [req-2e3e0960-d670-4703-9054-db4b8d4f73a4 req-4657363f-58e6-4552-bf63-5c8a45f5f960 service nova] [instance: c163c27f-4cdd-4984-bd3b-eace62b14106] Received unexpected event network-vif-plugged-fbe23d5a-6995-423e-b74f-bcf005dfe21a for instance with vm_state deleted and task_state None.
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_power_states {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 996b4364-9920-4b91-8a06-0b6f2c138aab {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 391642f0-2293-46bf-a93a-c6f2e61698f6 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid fa020b7e-c088-4c40-878d-27e43dca4ad0 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 13274e43-2984-4aa6-ad9b-23e3bbe7c959 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 4fab87e3-2f7c-4db4-9f14-ace1813fe046 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 3df17188-c87e-49e5-9ca2-5d04632ea9bb {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 5ea4ce52-dd69-4b51-b066-bec88d069151 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 0a239b54-6717-4f3c-b455-3326a8f0bdc2 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "996b4364-9920-4b91-8a06-0b6f2c138aab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "fa020b7e-c088-4c40-878d-27e43dca4ad0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "c320d76b-58e8-4032-bef3-3aead513231e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "c320d76b-58e8-4032-bef3-3aead513231e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:52:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:24 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:53:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:53:27 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:53:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:53:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 01:53:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:53:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:53:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "1ea93b31-f7c3-456f-aa99-113160704256" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:53:30 user nova-compute[75210]: INFO nova.compute.claims [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Claim successful on node user
Nov 29 01:53:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating instance_info_cache with network_info: [{"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-4fab87e3-2f7c-4db4-9f14-ace1813fe046" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:53:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:53:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:53:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG nova.policy [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d98e0c98f554dd5b8a84f9b3933cf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30940563d2c94d87b2e350faf4d0c5b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:53:31 user nova-compute[75210]: INFO nova.virt.block_device [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Booting with volume e623ee5d-9e4f-4444-af26-0fc9dd480256 at /dev/vda
Nov 29 01:53:31 user nova-compute[75210]: DEBUG os_brick.utils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[01151648-d538-42c1-9c53-14926e42668b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ab0c3c-15fc-4597-9d6e-2dcd6e3ee6ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0befab09-a6bb-4119-a128-ca42103bdfea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5064738a-2df3-4f75-af13-17a5b5d785c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:53:31 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:53:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df96052-6b68-4431-a7ac-7cc902fca95c]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG os_brick.utils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updating existing volume attachment record: 027ec0d0-875e-47d0-976d-c0cc6afbfb62 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:53:31 user nova-compute[75210]: DEBUG nova.network.neutron [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Successfully created port: 09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG nova.network.neutron [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Successfully updated port: 09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquired lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG nova.network.neutron [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-5539c0aa-7da9-479e-aab8-99c8223e2e31 req-9605d6a6-2531-48be-9447-e11d5ec05aeb service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-changed-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-5539c0aa-7da9-479e-aab8-99c8223e2e31 req-9605d6a6-2531-48be-9447-e11d5ec05aeb service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Refreshing instance network info cache due to event network-changed-09497c00-460e-40af-942c-0c6f727dc0d8. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5539c0aa-7da9-479e-aab8-99c8223e2e31 req-9605d6a6-2531-48be-9447-e11d5ec05aeb service nova] Acquiring lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG nova.network.neutron [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG nova.network.neutron [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updating instance_info_cache with network_info: [{"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Releasing lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG nova.compute.manager [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Instance network_info: |[{"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5539c0aa-7da9-479e-aab8-99c8223e2e31 req-9605d6a6-2531-48be-9447-e11d5ec05aeb service nova] Acquired lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:53:32 user nova-compute[75210]: DEBUG nova.network.neutron [req-5539c0aa-7da9-479e-aab8-99c8223e2e31 req-9605d6a6-2531-48be-9447-e11d5ec05aeb service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Refreshing network info cache for port 09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:53:33 user nova-compute[75210]: DEBUG nova.network.neutron [req-5539c0aa-7da9-479e-aab8-99c8223e2e31 req-9605d6a6-2531-48be-9447-e11d5ec05aeb service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updated VIF entry in instance network info cache for port 09497c00-460e-40af-942c-0c6f727dc0d8. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:53:33 user nova-compute[75210]: DEBUG nova.network.neutron [req-5539c0aa-7da9-479e-aab8-99c8223e2e31 req-9605d6a6-2531-48be-9447-e11d5ec05aeb service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updating instance_info_cache with network_info: [{"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:53:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5539c0aa-7da9-479e-aab8-99c8223e2e31 req-9605d6a6-2531-48be-9447-e11d5ec05aeb service nova] Releasing lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:53:33 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:53:33 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:53:34 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:53:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:53:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:53:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:53:34 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:53:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:34 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:53:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:53:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:53:38 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:53:38 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7853MB free_disk=25.120967864990234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 4fab87e3-2f7c-4db4-9f14-ace1813fe046 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3df17188-c87e-49e5-9ca2-5d04632ea9bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c320d76b-58e8-4032-bef3-3aead513231e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 0a239b54-6717-4f3c-b455-3326a8f0bdc2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 5ea4ce52-dd69-4b51-b066-bec88d069151 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 1ea93b31-f7c3-456f-aa99-113160704256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.compute.manager [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:53:38 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Creating image(s)
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Ensure instance console log exists: /opt/stack/data/nova/instances/1ea93b31-f7c3-456f-aa99-113160704256/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Start _get_guest_xml network_info=[{"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': '027ec0d0-875e-47d0-976d-c0cc6afbfb62', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoewKfcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ea93b31-f7c3-456f-aa99-113160704256', 'attached_at': '', 'detached_at': '', 'volume_id': 'e623ee5d-9e4f-4444-af26-0fc9dd480256', 'serial': 'e623ee5d-9e4f-4444-af26-0fc9dd480256'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:53:38 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:53:38 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoewKfcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:53:38 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:53:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:53:38 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:53:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:53:38 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efd4480-78a9-4d4a-9bde-ac743637f457]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:53:38 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2543f8e-10b2-4e41-b7a6-50544d533d72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256] added
Nov 29 01:53:38 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff93a973-3aaf-4667-8963-2c9187c0dd1f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8050c965-795c-4da0-8c74-e519f26a3847]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoewKfcm {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoewKfcm" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c0e06e-d290-404d-852b-8e14c47926e6]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JoewKfcm'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:53:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63d7a24-c62d-4554-a8d7-9122caf07932]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f32759-cad2-4638-a7bd-f464cbc2038c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:53:39 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:53:39 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0ec349-640c-4b6c-b5f4-00a01bd50bb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260]
Nov 29 01:53:39 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260] successful.
Nov 29 01:53:39 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[870f7792-303c-48e3-9902-b6248bf12bc1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3437c381-e5c0-434e-88d4-fab8311ecf26]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:53:39 user nova-compute[75210]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:53:39 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] HCTL ('38', '-', '-', 0) found on session 43 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[711a5b8f-c072-499d-b753-bec56b433648]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching for a device in session 43 and hctl ['38', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:53:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching for a device in session 43 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoewKfcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26137353830346236', 'path': '/dev/sdg'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137353830346236', 'path': '/dev/sdg'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1869106097',display_name='tempest-ServerActionsTestOtherA-server-1869106097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1869106097',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0ZPcsrrZ0p77iZVF3hXrlbitPxsOMUk6lEgPtIOZB1sypvzBAvVGb9BhgWOjWjr7Z8pdmqoU3sXtItuyafViUIU/dnioTrc/zJIESKhxOMP7SI+ZANtu7hU2Hj6RuPWQ==',key_name='tempest-keypair-192951479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-f9ddzge5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=1ea93b31-f7c3-456f-aa99-113160704256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG nova.objects.instance [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ea93b31-f7c3-456f-aa99-113160704256 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:53:40 user nova-compute[75210]:   <uuid>1ea93b31-f7c3-456f-aa99-113160704256</uuid>
Nov 29 01:53:40 user nova-compute[75210]:   <name>instance-00000023</name>
Nov 29 01:53:40 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:53:40 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:53:40 user nova-compute[75210]:   <metadata>
Nov 29 01:53:40 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:53:40 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:53:40 user nova-compute[75210]:       <nova:name>tempest-ServerActionsTestOtherA-server-1869106097</nova:name>
Nov 29 01:53:40 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:53:38</nova:creationTime>
Nov 29 01:53:40 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:53:40 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:53:40 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:53:40 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:53:40 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:53:40 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:53:40 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:53:40 user nova-compute[75210]:       <nova:owner>
Nov 29 01:53:40 user nova-compute[75210]:         <nova:user uuid="2d98e0c98f554dd5b8a84f9b3933cf1a">tempest-ServerActionsTestOtherA-1921082789-project-member</nova:user>
Nov 29 01:53:40 user nova-compute[75210]:         <nova:project uuid="30940563d2c94d87b2e350faf4d0c5b0">tempest-ServerActionsTestOtherA-1921082789</nova:project>
Nov 29 01:53:40 user nova-compute[75210]:       </nova:owner>
Nov 29 01:53:40 user nova-compute[75210]:       <nova:ports>
Nov 29 01:53:40 user nova-compute[75210]:         <nova:port uuid="09497c00-460e-40af-942c-0c6f727dc0d8">
Nov 29 01:53:40 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 01:53:40 user nova-compute[75210]:         </nova:port>
Nov 29 01:53:40 user nova-compute[75210]:       </nova:ports>
Nov 29 01:53:40 user nova-compute[75210]:     </nova:instance>
Nov 29 01:53:40 user nova-compute[75210]:   </metadata>
Nov 29 01:53:40 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:53:40 user nova-compute[75210]:     <system>
Nov 29 01:53:40 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:53:40 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:53:40 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:53:40 user nova-compute[75210]:       <entry name="serial">1ea93b31-f7c3-456f-aa99-113160704256</entry>
Nov 29 01:53:40 user nova-compute[75210]:       <entry name="uuid">1ea93b31-f7c3-456f-aa99-113160704256</entry>
Nov 29 01:53:40 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:53:40 user nova-compute[75210]:     </system>
Nov 29 01:53:40 user nova-compute[75210]:   </sysinfo>
Nov 29 01:53:40 user nova-compute[75210]:   <os>
Nov 29 01:53:40 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:53:40 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:53:40 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:53:40 user nova-compute[75210]:   </os>
Nov 29 01:53:40 user nova-compute[75210]:   <features>
Nov 29 01:53:40 user nova-compute[75210]:     <acpi/>
Nov 29 01:53:40 user nova-compute[75210]:     <apic/>
Nov 29 01:53:40 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:53:40 user nova-compute[75210]:   </features>
Nov 29 01:53:40 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:53:40 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:53:40 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:53:40 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:53:40 user nova-compute[75210]:   </clock>
Nov 29 01:53:40 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:53:40 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:53:40 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:53:40 user nova-compute[75210]:   </cpu>
Nov 29 01:53:40 user nova-compute[75210]:   <devices>
Nov 29 01:53:40 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:53:40 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:53:40 user nova-compute[75210]:       <source dev="/dev/sdg"/>
Nov 29 01:53:40 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:53:40 user nova-compute[75210]:       <serial>e623ee5d-9e4f-4444-af26-0fc9dd480256</serial>
Nov 29 01:53:40 user nova-compute[75210]:     </disk>
Nov 29 01:53:40 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:53:40 user nova-compute[75210]:       <mac address="fa:16:3e:3c:1d:c3"/>
Nov 29 01:53:40 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:53:40 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:53:40 user nova-compute[75210]:       <target dev="tap09497c00-46"/>
Nov 29 01:53:40 user nova-compute[75210]:     </interface>
Nov 29 01:53:40 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:53:40 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/1ea93b31-f7c3-456f-aa99-113160704256/console.log" append="off"/>
Nov 29 01:53:40 user nova-compute[75210]:     </serial>
Nov 29 01:53:40 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:53:40 user nova-compute[75210]:     <video>
Nov 29 01:53:40 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:53:40 user nova-compute[75210]:     </video>
Nov 29 01:53:40 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:53:40 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:53:40 user nova-compute[75210]:     </rng>
Nov 29 01:53:40 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:53:40 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:53:40 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:53:40 user nova-compute[75210]:     </memballoon>
Nov 29 01:53:40 user nova-compute[75210]:   </devices>
Nov 29 01:53:40 user nova-compute[75210]: </domain>
Nov 29 01:53:40 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1869106097',display_name='tempest-ServerActionsTestOtherA-server-1869106097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1869106097',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0ZPcsrrZ0p77iZVF3hXrlbitPxsOMUk6lEgPtIOZB1sypvzBAvVGb9BhgWOjWjr7Z8pdmqoU3sXtItuyafViUIU/dnioTrc/zJIESKhxOMP7SI+ZANtu7hU2Hj6RuPWQ==',key_name='tempest-keypair-192951479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-f9ddzge5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=1ea93b31-f7c3-456f-aa99-113160704256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG os_vif [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c00db980-e301-5e65-8d2d-acbc42778067', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09497c00-46, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09497c00-46, col_values=(('qos', UUID('d8572b60-8207-4ebe-97c1-803c0d30ca21')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09497c00-46, col_values=(('external_ids', {'iface-id': '09497c00-460e-40af-942c-0c6f727dc0d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:1d:c3', 'vm-uuid': '1ea93b31-f7c3-456f-aa99-113160704256'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:40 user nova-compute[75210]: INFO os_vif [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46')
Nov 29 01:53:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No VIF found with MAC fa:16:3e:3c:1d:c3, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:53:40 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:53:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:41 user nova-compute[75210]: DEBUG nova.compute.manager [req-5dd788b9-c7de-413d-b469-e50e1a30061e req-6c976171-e460-4775-8d85-b0cd07e45ec9 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:53:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5dd788b9-c7de-413d-b469-e50e1a30061e req-6c976171-e460-4775-8d85-b0cd07e45ec9 service nova] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:53:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5dd788b9-c7de-413d-b469-e50e1a30061e req-6c976171-e460-4775-8d85-b0cd07e45ec9 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:53:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5dd788b9-c7de-413d-b469-e50e1a30061e req-6c976171-e460-4775-8d85-b0cd07e45ec9 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:53:41 user nova-compute[75210]: DEBUG nova.compute.manager [req-5dd788b9-c7de-413d-b469-e50e1a30061e req-6c976171-e460-4775-8d85-b0cd07e45ec9 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] No waiting events found dispatching network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:53:41 user nova-compute[75210]: WARNING nova.compute.manager [req-5dd788b9-c7de-413d-b469-e50e1a30061e req-6c976171-e460-4775-8d85-b0cd07e45ec9 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received unexpected event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 for instance with vm_state building and task_state spawning.
Nov 29 01:53:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:53:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:53:43 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Instance spawned successfully.
Nov 29 01:53:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:53:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:53:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:53:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:53:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:53:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:53:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:53:43 user nova-compute[75210]: INFO nova.compute.manager [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 29 01:53:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:53:43 user nova-compute[75210]: INFO nova.compute.manager [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Took 13.36 seconds to build instance.
Nov 29 01:53:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-22b6f64a-6b3d-4581-940b-5eb0b89a7021 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "1ea93b31-f7c3-456f-aa99-113160704256" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.518s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:53:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-19714ff4-97fe-4a91-8ad2-21dd7e48bf51 req-5630a342-e69f-4f29-aca6-bfdff6f5911d service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:53:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-19714ff4-97fe-4a91-8ad2-21dd7e48bf51 req-5630a342-e69f-4f29-aca6-bfdff6f5911d service nova] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:53:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-19714ff4-97fe-4a91-8ad2-21dd7e48bf51 req-5630a342-e69f-4f29-aca6-bfdff6f5911d service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:53:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-19714ff4-97fe-4a91-8ad2-21dd7e48bf51 req-5630a342-e69f-4f29-aca6-bfdff6f5911d service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:53:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-19714ff4-97fe-4a91-8ad2-21dd7e48bf51 req-5630a342-e69f-4f29-aca6-bfdff6f5911d service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] No waiting events found dispatching network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:53:43 user nova-compute[75210]: WARNING nova.compute.manager [req-19714ff4-97fe-4a91-8ad2-21dd7e48bf51 req-5630a342-e69f-4f29-aca6-bfdff6f5911d service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received unexpected event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 for instance with vm_state active and task_state None.
Nov 29 01:53:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:53:50 user nova-compute[75210]: INFO nova.compute.manager [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Terminating instance
Nov 29 01:53:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d69ef63-5ef3-4420-b071-670003e427b3 req-865df17f-f176-4108-891b-ae84a40ba6a5 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-unplugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d69ef63-5ef3-4420-b071-670003e427b3 req-865df17f-f176-4108-891b-ae84a40ba6a5 service nova] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d69ef63-5ef3-4420-b071-670003e427b3 req-865df17f-f176-4108-891b-ae84a40ba6a5 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d69ef63-5ef3-4420-b071-670003e427b3 req-865df17f-f176-4108-891b-ae84a40ba6a5 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d69ef63-5ef3-4420-b071-670003e427b3 req-865df17f-f176-4108-891b-ae84a40ba6a5 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] No waiting events found dispatching network-vif-unplugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:53:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d69ef63-5ef3-4420-b071-670003e427b3 req-865df17f-f176-4108-891b-ae84a40ba6a5 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-unplugged-60309b43-09f2-4bc7-81a2-9c764df78b5d for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:53:51 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Instance destroyed successfully.
Nov 29 01:53:51 user nova-compute[75210]: DEBUG nova.objects.instance [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lazy-loading 'resources' on Instance uuid 4fab87e3-2f7c-4db4-9f14-ace1813fe046 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1920078035',display_name='tempest-ServerActionsTestOtherB-server-1920078035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1920078035',id=27,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHTMCtMfKAyfL3sA07wByFhm2FHh83CKtTVWERl3aWtDAO+UO8rfcAbJD3gRH9oGCeL5Ksot/CKwepAmL20m57Zzo2MLfsvimSlewZEfHZ4/WEV9jR4p6/EvJ11L0KWcA==',key_name='tempest-keypair-53471645',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:51:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e7b24c627ca143e49731c22a555eacd1',ramdisk_id='',reservation_id='r-08i4j8ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-573973984',owner_user_name='tempest-ServerActionsTestOtherB-573973984-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:51:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9b16390ddb64b9f8925f3e156bbe8d0',uuid=4fab87e3-2f7c-4db4-9f14-ace1813fe046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converting VIF {"id": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "address": "fa:16:3e:95:cc:d2", "network": {"id": "6c529fa1-011c-4daf-b226-c8854fdc5968", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1522934833-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e7b24c627ca143e49731c22a555eacd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60309b43-09", "ovs_interfaceid": "60309b43-09f2-4bc7-81a2-9c764df78b5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_vif [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60309b43-09, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b0dcefb-6b8e-4649-9e34-3c5410d09c44) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:53:51 user nova-compute[75210]: INFO os_vif [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:cc:d2,bridge_name='br-int',has_traffic_filtering=True,id=60309b43-09f2-4bc7-81a2-9c764df78b5d,network=Network(6c529fa1-011c-4daf-b226-c8854fdc5968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60309b43-09')
Nov 29 01:53:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzbKkiSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:53:51 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd9a05d-1af4-43b7-b0bb-d33826d9cdda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:53:51 user nova-compute[75210]: No targets found.
Nov 29 01:53:51 user nova-compute[75210]: iSNS:
Nov 29 01:53:51 user nova-compute[75210]: No targets found.
Nov 29 01:53:51 user nova-compute[75210]: STATIC:
Nov 29 01:53:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc
Nov 29 01:53:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:53:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:53:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256
Nov 29 01:53:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:53:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:53:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866
Nov 29 01:53:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:53:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:53:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:53:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:53:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:53:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23
Nov 29 01:53:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:53:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:53:51 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823
Nov 29 01:53:51 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:53:51 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:53:51 user nova-compute[75210]: FIRMWARE:
Nov 29 01:53:51 user nova-compute[75210]: No targets found.
Nov 29 01:53:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:53:51 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:53:51 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b695783-2bc3-478c-a763-3535539082e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d30c64-c795-4547-ad96-a66cd512e2ee]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:53:51 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:53:51 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:53:51 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:53:51 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:53:51 user nova-compute[75210]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:53:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:53:51 user nova-compute[75210]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 (non-flash)
Nov 29 01:53:51 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:53:51 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:53:51 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:53:51 user nova-compute[75210]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:53:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f240813d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866'): ({'sdd'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Removing single pathed devices sdd {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f29cc0-8242-4c11-aa24-0e5d747b3a2b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[079ea03b-f521-4772-bed4-7cb57adae3ef]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Flushing IO for device /dev/sdd {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d037a50-9489-41b9-bc0f-c153ae955f20]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f7dd3e-49f0-4795-8d49-221ce93f2ffa]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40aea2a-2cc3-4a2e-b82a-c75865d71eb2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a6e50c-36f9-4f34-a70b-095787cf9cde]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260]
Nov 29 01:53:51 user nova-compute[75210]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866, portal: 172.16.0.220,3260] successful.
Nov 29 01:53:51 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0701e0ea-4b69-4215-9da7-7a684d683866 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f70bc8-a81f-47f9-a338-239c207dfdd3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] <== disconnect_volume: return (352ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:53:51 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Deleting instance files /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046_del
Nov 29 01:53:51 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Deletion of /opt/stack/data/nova/instances/4fab87e3-2f7c-4db4-9f14-ace1813fe046_del complete
Nov 29 01:53:51 user nova-compute[75210]: INFO nova.compute.manager [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 29 01:53:51 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:53:51 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:53:52 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:53:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-3795dde9-017e-4353-8b66-ccf980b8573c req-3e256e2f-1582-4e73-bdb0-babfd9343d62 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-deleted-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:53:52 user nova-compute[75210]: INFO nova.compute.manager [req-3795dde9-017e-4353-8b66-ccf980b8573c req-3e256e2f-1582-4e73-bdb0-babfd9343d62 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Neutron deleted interface 60309b43-09f2-4bc7-81a2-9c764df78b5d; detaching it from the instance and deleting it from the info cache
Nov 29 01:53:52 user nova-compute[75210]: DEBUG nova.network.neutron [req-3795dde9-017e-4353-8b66-ccf980b8573c req-3e256e2f-1582-4e73-bdb0-babfd9343d62 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:53:52 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Took 0.90 seconds to deallocate network for instance.
Nov 29 01:53:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-3795dde9-017e-4353-8b66-ccf980b8573c req-3e256e2f-1582-4e73-bdb0-babfd9343d62 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Detach interface failed, port_id=60309b43-09f2-4bc7-81a2-9c764df78b5d, reason: Instance 4fab87e3-2f7c-4db4-9f14-ace1813fe046 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:53:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-67dbe293-00a2-4365-94b9-f09afbcd6142 req-1c4ed166-8c75-4181-89cf-30e16ff3f415 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:53:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67dbe293-00a2-4365-94b9-f09afbcd6142 req-1c4ed166-8c75-4181-89cf-30e16ff3f415 service nova] Acquiring lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:53:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67dbe293-00a2-4365-94b9-f09afbcd6142 req-1c4ed166-8c75-4181-89cf-30e16ff3f415 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:53:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67dbe293-00a2-4365-94b9-f09afbcd6142 req-1c4ed166-8c75-4181-89cf-30e16ff3f415 service nova] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:53:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-67dbe293-00a2-4365-94b9-f09afbcd6142 req-1c4ed166-8c75-4181-89cf-30e16ff3f415 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] No waiting events found dispatching network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:53:52 user nova-compute[75210]: WARNING nova.compute.manager [req-67dbe293-00a2-4365-94b9-f09afbcd6142 req-1c4ed166-8c75-4181-89cf-30e16ff3f415 service nova] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Received unexpected event network-vif-plugged-60309b43-09f2-4bc7-81a2-9c764df78b5d for instance with vm_state active and task_state deleting.
Nov 29 01:53:53 user nova-compute[75210]: INFO nova.compute.manager [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] [instance: 4fab87e3-2f7c-4db4-9f14-ace1813fe046] Took 0.78 seconds to detach 1 volumes for instance.
Nov 29 01:53:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:53:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:53:53 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:53:53 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:53:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:53:54 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Deleted allocations for instance 4fab87e3-2f7c-4db4-9f14-ace1813fe046
Nov 29 01:53:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-98f823df-8d39-4cc9-af02-1cf1df1883f4 tempest-ServerActionsTestOtherB-573973984 tempest-ServerActionsTestOtherB-573973984-project-member] Lock "4fab87e3-2f7c-4db4-9f14-ace1813fe046" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.616s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:53:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:53:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-84aff20a-2dd3-44e3-b0ce-6dd77a4aabf2 req-71927279-8435-4138-8a3d-c609f4bea2bc service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-changed-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-84aff20a-2dd3-44e3-b0ce-6dd77a4aabf2 req-71927279-8435-4138-8a3d-c609f4bea2bc service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Refreshing instance network info cache due to event network-changed-87448b14-8dd8-439b-ae2f-7c2e5a0cf813. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-84aff20a-2dd3-44e3-b0ce-6dd77a4aabf2 req-71927279-8435-4138-8a3d-c609f4bea2bc service nova] Acquiring lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-84aff20a-2dd3-44e3-b0ce-6dd77a4aabf2 req-71927279-8435-4138-8a3d-c609f4bea2bc service nova] Acquired lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG nova.network.neutron [req-84aff20a-2dd3-44e3-b0ce-6dd77a4aabf2 req-71927279-8435-4138-8a3d-c609f4bea2bc service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Refreshing network info cache for port 87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:01 user nova-compute[75210]: INFO nova.compute.manager [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Terminating instance
Nov 29 01:54:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG nova.network.neutron [req-84aff20a-2dd3-44e3-b0ce-6dd77a4aabf2 req-71927279-8435-4138-8a3d-c609f4bea2bc service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updated VIF entry in instance network info cache for port 87448b14-8dd8-439b-ae2f-7c2e5a0cf813. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG nova.network.neutron [req-84aff20a-2dd3-44e3-b0ce-6dd77a4aabf2 req-71927279-8435-4138-8a3d-c609f4bea2bc service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updating instance_info_cache with network_info: [{"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:54:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-84aff20a-2dd3-44e3-b0ce-6dd77a4aabf2 req-71927279-8435-4138-8a3d-c609f4bea2bc service nova] Releasing lock "refresh_cache-0a239b54-6717-4f3c-b455-3326a8f0bdc2" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Instance destroyed successfully.
Nov 29 01:54:02 user nova-compute[75210]: DEBUG nova.objects.instance [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lazy-loading 'resources' on Instance uuid 0a239b54-6717-4f3c-b455-3326a8f0bdc2 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T01:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-243949346',display_name='tempest-TestShelveInstance-server-243949346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-243949346',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4LjG3IxpsBiQB9Qf7TjHQ7xubkfSfT2Y2dVPvS9ktTV/GSTtT/jspevE88d67HvvQ4SnunUkS0tgiRglqXBUBVtnsF9YzJyyu8vYLLd8WblCCvlG4YEXAmyTXpLTjMhQ==',key_name='tempest-TestShelveInstance-1194317885',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:52:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3bf4d56ff4eb43269de28f4acb4578b5',ramdisk_id='',reservation_id='r-713d5ykr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1973174297',owner_user_name='tempest-TestShelveInstance-1973174297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:52:24Z,user_data=None,user_id='cd46d52d26394d0190fb0060bc2311f1',uuid=0a239b54-6717-4f3c-b455-3326a8f0bdc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Converting VIF {"id": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "address": "fa:16:3e:89:56:4f", "network": {"id": "a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1546461404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3bf4d56ff4eb43269de28f4acb4578b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87448b14-8d", "ovs_interfaceid": "87448b14-8dd8-439b-ae2f-7c2e5a0cf813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_vif [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87448b14-8d, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=197db8d9-05ff-4073-8a77-a7a03ed7136b) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:02 user nova-compute[75210]: INFO os_vif [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:56:4f,bridge_name='br-int',has_traffic_filtering=True,id=87448b14-8dd8-439b-ae2f-7c2e5a0cf813,network=Network(a96ce400-b7e8-4e3d-90a3-f7ccbd8e31a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87448b14-8d')
Nov 29 01:54:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FTOXPUgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:54:02 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[531ea6e6-51c9-4c20-95e3-3f9b4f1255fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:54:02 user nova-compute[75210]: No targets found.
Nov 29 01:54:02 user nova-compute[75210]: iSNS:
Nov 29 01:54:02 user nova-compute[75210]: No targets found.
Nov 29 01:54:02 user nova-compute[75210]: STATIC:
Nov 29 01:54:02 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc
Nov 29 01:54:02 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:54:02 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:54:02 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256
Nov 29 01:54:02 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:54:02 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:54:02 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:54:02 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:54:02 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:54:02 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23
Nov 29 01:54:02 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:54:02 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:54:02 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823
Nov 29 01:54:02 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:54:02 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:54:02 user nova-compute[75210]: FIRMWARE:
Nov 29 01:54:02 user nova-compute[75210]: No targets found.
Nov 29 01:54:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:54:02 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:54:02 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b768a4-9a9a-4f64-8c08-cacc428a27a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fb2527-2910-47a1-a8ce-f7ac2998e3b4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:54:02 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:54:02 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:54:02 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:54:02 user nova-compute[75210]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:54:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:54:02 user nova-compute[75210]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 (non-flash)
Nov 29 01:54:02 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:54:02 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:54:02 user nova-compute[75210]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:54:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e84aa7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1988aa1c-0fca-4bcd-91ea-f9512e9c6be2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb2a77d-b9a4-4a0f-804b-fb6455ba7bbb]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89b923b-2703-412e-bb69-e6c8d982021c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef21a71-395a-48e5-b3ac-12d25d6e6547]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5594c3e-c9b8-4919-a6d2-13a1b12bbcd7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2366987e-d96f-4901-ab0e-ceb290a1a347]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260]
Nov 29 01:54:02 user nova-compute[75210]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23, portal: 172.16.0.220,3260] successful.
Nov 29 01:54:02 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c462ff66-874b-4d31-bf54-0a25b733af23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5004a88a-6e48-42cd-9517-29724c316de1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] <== disconnect_volume: return (323ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:54:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Deleting instance files /opt/stack/data/nova/instances/0a239b54-6717-4f3c-b455-3326a8f0bdc2_del
Nov 29 01:54:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Deletion of /opt/stack/data/nova/instances/0a239b54-6717-4f3c-b455-3326a8f0bdc2_del complete
Nov 29 01:54:02 user nova-compute[75210]: INFO nova.compute.manager [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 29 01:54:02 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:54:02 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:54:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-faa0c2d5-1265-4409-9ee4-877dfeda5912 req-8d761a8b-bcd1-4325-abc8-9850afaa1802 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-vif-unplugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:54:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-faa0c2d5-1265-4409-9ee4-877dfeda5912 req-8d761a8b-bcd1-4325-abc8-9850afaa1802 service nova] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-faa0c2d5-1265-4409-9ee4-877dfeda5912 req-8d761a8b-bcd1-4325-abc8-9850afaa1802 service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-faa0c2d5-1265-4409-9ee4-877dfeda5912 req-8d761a8b-bcd1-4325-abc8-9850afaa1802 service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-faa0c2d5-1265-4409-9ee4-877dfeda5912 req-8d761a8b-bcd1-4325-abc8-9850afaa1802 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] No waiting events found dispatching network-vif-unplugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:54:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-faa0c2d5-1265-4409-9ee4-877dfeda5912 req-8d761a8b-bcd1-4325-abc8-9850afaa1802 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-vif-unplugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:54:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-faa0c2d5-1265-4409-9ee4-877dfeda5912 req-8d761a8b-bcd1-4325-abc8-9850afaa1802 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:54:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-faa0c2d5-1265-4409-9ee4-877dfeda5912 req-8d761a8b-bcd1-4325-abc8-9850afaa1802 service nova] Acquiring lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-faa0c2d5-1265-4409-9ee4-877dfeda5912 req-8d761a8b-bcd1-4325-abc8-9850afaa1802 service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-faa0c2d5-1265-4409-9ee4-877dfeda5912 req-8d761a8b-bcd1-4325-abc8-9850afaa1802 service nova] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-faa0c2d5-1265-4409-9ee4-877dfeda5912 req-8d761a8b-bcd1-4325-abc8-9850afaa1802 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] No waiting events found dispatching network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:54:03 user nova-compute[75210]: WARNING nova.compute.manager [req-faa0c2d5-1265-4409-9ee4-877dfeda5912 req-8d761a8b-bcd1-4325-abc8-9850afaa1802 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received unexpected event network-vif-plugged-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 for instance with vm_state active and task_state deleting.
Nov 29 01:54:03 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:54:03 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Took 0.42 seconds to deallocate network for instance.
Nov 29 01:54:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-c30159f6-ebe9-4d08-ae55-2f368f906e58 req-d044ecb0-8b2d-4939-8e05-28ce13ae8b91 service nova] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Received event network-vif-deleted-87448b14-8dd8-439b-ae2f-7c2e5a0cf813 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:54:03 user nova-compute[75210]: INFO nova.compute.manager [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Took 0.77 seconds to detach 1 volumes for instance.
Nov 29 01:54:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] [instance: 0a239b54-6717-4f3c-b455-3326a8f0bdc2] Deleting volume: c462ff66-874b-4d31-bf54-0a25b733af23 {{(pid=75210) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 01:54:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:04 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:54:04 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:54:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:04 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Deleted allocations for instance 0a239b54-6717-4f3c-b455-3326a8f0bdc2
Nov 29 01:54:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e9f85de8-1ac6-40a4-815e-d54f321e20e0 tempest-TestShelveInstance-1973174297 tempest-TestShelveInstance-1973174297-project-member] Lock "0a239b54-6717-4f3c-b455-3326a8f0bdc2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.951s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:11 user nova-compute[75210]: INFO nova.compute.manager [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Rescuing
Nov 29 01:54:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "refresh_cache-5ea4ce52-dd69-4b51-b066-bec88d069151" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:54:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquired lock "refresh_cache-5ea4ce52-dd69-4b51-b066-bec88d069151" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:54:11 user nova-compute[75210]: DEBUG nova.network.neutron [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG nova.network.neutron [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Updating instance_info_cache with network_info: [{"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Releasing lock "refresh_cache-5ea4ce52-dd69-4b51-b066-bec88d069151" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-347545cc-2a3a-408f-9d72-265486d7ee5f req-43cd71dd-c2e4-4bf5-9a82-5a347370433e service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-unplugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-347545cc-2a3a-408f-9d72-265486d7ee5f req-43cd71dd-c2e4-4bf5-9a82-5a347370433e service nova] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-347545cc-2a3a-408f-9d72-265486d7ee5f req-43cd71dd-c2e4-4bf5-9a82-5a347370433e service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-347545cc-2a3a-408f-9d72-265486d7ee5f req-43cd71dd-c2e4-4bf5-9a82-5a347370433e service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-347545cc-2a3a-408f-9d72-265486d7ee5f req-43cd71dd-c2e4-4bf5-9a82-5a347370433e service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] No waiting events found dispatching network-vif-unplugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:54:12 user nova-compute[75210]: WARNING nova.compute.manager [req-347545cc-2a3a-408f-9d72-265486d7ee5f req-43cd71dd-c2e4-4bf5-9a82-5a347370433e service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received unexpected event network-vif-unplugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea for instance with vm_state active and task_state rescuing.
Nov 29 01:54:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Instance destroyed successfully.
Nov 29 01:54:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Attempting a stable device rescue
Nov 29 01:54:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75210) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Instance directory exists: not creating {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 01:54:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Creating image(s)
Nov 29 01:54:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "/opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "/opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG nova.objects.instance [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5ea4ce52-dd69-4b51-b066-bec88d069151 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "e1fa1ab8112b2634631d09050abc90d04a72b8b2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "e1fa1ab8112b2634631d09050abc90d04a72b8b2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2.part --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG nova.virt.images [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] 0d406fce-f85d-47d8-809b-d452ab37f884 was qcow2, converting to raw {{(pid=75210) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2.part /opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2.converted {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-8b861f9f-57fe-43c9-90af-6e8042051ada req-dc924390-e548-4b6c-8dbc-b1cc9816c8c1 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8b861f9f-57fe-43c9-90af-6e8042051ada req-dc924390-e548-4b6c-8dbc-b1cc9816c8c1 service nova] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8b861f9f-57fe-43c9-90af-6e8042051ada req-dc924390-e548-4b6c-8dbc-b1cc9816c8c1 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8b861f9f-57fe-43c9-90af-6e8042051ada req-dc924390-e548-4b6c-8dbc-b1cc9816c8c1 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-8b861f9f-57fe-43c9-90af-6e8042051ada req-dc924390-e548-4b6c-8dbc-b1cc9816c8c1 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] No waiting events found dispatching network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:54:14 user nova-compute[75210]: WARNING nova.compute.manager [req-8b861f9f-57fe-43c9-90af-6e8042051ada req-dc924390-e548-4b6c-8dbc-b1cc9816c8c1 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received unexpected event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea for instance with vm_state active and task_state rescuing.
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2.part /opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2.converted" returned: 0 in 0.451s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2.converted --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "e1fa1ab8112b2634631d09050abc90d04a72b8b2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.827s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "e1fa1ab8112b2634631d09050abc90d04a72b8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "e1fa1ab8112b2634631d09050abc90d04a72b8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2 --force-share --output=json" returned: 0 in 0.170s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2,backing_fmt=raw /opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.rescue {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2,backing_fmt=raw /opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.rescue" returned: 0 in 0.055s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "e1fa1ab8112b2634631d09050abc90d04a72b8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG nova.objects.instance [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'migration_context' on Instance uuid 5ea4ce52-dd69-4b51-b066-bec88d069151 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG nova.objects.base [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Object Instance<5ea4ce52-dd69-4b51-b066-bec88d069151> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Start _get_guest_xml network_info=[{"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "vif_mac": "fa:16:3e:97:68:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0d406fce-f85d-47d8-809b-d452ab37f884', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '447d2e41-3e61-43ce-b46f-8eb57b882666', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoGMuFnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '5ea4ce52-dd69-4b51-b066-bec88d069151', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7ee48ba-8fc7-46c6-a549-ec71825f29fc', 'serial': 'c7ee48ba-8fc7-46c6-a549-ec71825f29fc'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG nova.objects.instance [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'resources' on Instance uuid 5ea4ce52-dd69-4b51-b066-bec88d069151 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG nova.objects.base [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Object Instance<5ea4ce52-dd69-4b51-b066-bec88d069151> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG nova.objects.instance [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'numa_topology' on Instance uuid 5ea4ce52-dd69-4b51-b066-bec88d069151 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:54:14 user nova-compute[75210]: DEBUG nova.objects.base [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Object Instance<5ea4ce52-dd69-4b51-b066-bec88d069151> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:54:15 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:54:15 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.objects.instance [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5ea4ce52-dd69-4b51-b066-bec88d069151 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.objects.base [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Object Instance<5ea4ce52-dd69-4b51-b066-bec88d069151> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoGMuFnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:54:15 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:54:15 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:54:15 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f30cbb-2d53-4ec4-a066-29016cec16f0]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WoGMuFnY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 01:54:15 user nova-compute[75210]: node.name = iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc
Nov 29 01:54:15 user nova-compute[75210]: node.tpgt = -1
Nov 29 01:54:15 user nova-compute[75210]: node.startup = automatic
Nov 29 01:54:15 user nova-compute[75210]: node.leading_login = No
Nov 29 01:54:15 user nova-compute[75210]: iface.iscsi_ifacename = default
Nov 29 01:54:15 user nova-compute[75210]: iface.net_ifacename = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.ipaddress = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.prefix_len = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.hwaddress = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.transport_name = tcp
Nov 29 01:54:15 user nova-compute[75210]: iface.initiatorname = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.state = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.vlan_id = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.vlan_priority = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.vlan_state = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.iface_num = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.mtu = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.port = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.bootproto = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.subnet_mask = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.gateway = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.dhcp_alt_client_id = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.dhcp_dns = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.dhcp_learn_iqn = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.dhcp_vendor_id_state = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.dhcp_vendor_id = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.dhcp_slp_da = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.fragmentation = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.gratuitous_arp = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.incoming_forwarding = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.tos_state = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.tos = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.ttl = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.delayed_ack = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.tcp_nagle = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.tcp_wsf_state = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.tcp_wsf = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.tcp_timer_scale = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.tcp_timestamp = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.redirect = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.def_task_mgmt_timeout = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.header_digest = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.data_digest = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.immediate_data = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.initial_r2t = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.data_seq_inorder = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.data_pdu_inorder = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.erl = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.max_receive_data_len = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.first_burst_len = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.max_outstanding_r2t = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.max_burst_len = 0
Nov 29 01:54:15 user nova-compute[75210]: iface.chap_auth = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.bidi_chap = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.strict_login_compliance = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.discovery_auth = <empty>
Nov 29 01:54:15 user nova-compute[75210]: iface.discovery_logout = <empty>
Nov 29 01:54:15 user nova-compute[75210]: node.discovery_address = <empty>
Nov 29 01:54:15 user nova-compute[75210]: node.discovery_port = 0
Nov 29 01:54:15 user nova-compute[75210]: node.discovery_type = static
Nov 29 01:54:15 user nova-compute[75210]: node.session.initial_cmdsn = 0
Nov 29 01:54:15 user nova-compute[75210]: node.session.initial_login_retry_max = 8
Nov 29 01:54:15 user nova-compute[75210]: node.session.xmit_thread_priority = -20
Nov 29 01:54:15 user nova-compute[75210]: node.session.cmds_max = 128
Nov 29 01:54:15 user nova-compute[75210]: node.session.queue_depth = 32
Nov 29 01:54:15 user nova-compute[75210]: node.session.nr_sessions = 1
Nov 29 01:54:15 user nova-compute[75210]: node.session.auth.authmethod = CHAP
Nov 29 01:54:15 user nova-compute[75210]: node.session.auth.username = WoGMuFnY
Nov 29 01:54:15 user nova-compute[75210]: node.session.auth.password = ***
Nov 29 01:54:15 user nova-compute[75210]: node.session.auth.username_in = <empty>
Nov 29 01:54:15 user nova-compute[75210]: node.session.auth.password_in = <empty>
Nov 29 01:54:15 user nova-compute[75210]: node.session.auth.chap_algs = MD5
Nov 29 01:54:15 user nova-compute[75210]: node.session.timeo.replacement_timeout = 120
Nov 29 01:54:15 user nova-compute[75210]: node.session.err_timeo.abort_timeout = 15
Nov 29 01:54:15 user nova-compute[75210]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 01:54:15 user nova-compute[75210]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 01:54:15 user nova-compute[75210]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 01:54:15 user nova-compute[75210]: node.session.iscsi.FastAbort = Yes
Nov 29 01:54:15 user nova-compute[75210]: node.session.iscsi.InitialR2T = No
Nov 29 01:54:15 user nova-compute[75210]: node.session.iscsi.ImmediateData = Yes
Nov 29 01:54:15 user nova-compute[75210]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 01:54:15 user nova-compute[75210]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 01:54:15 user nova-compute[75210]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 01:54:15 user nova-compute[75210]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 01:54:15 user nova-compute[75210]: node.session.iscsi.MaxConnections = 1
Nov 29 01:54:15 user nova-compute[75210]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 01:54:15 user nova-compute[75210]: node.session.iscsi.ERL = 0
Nov 29 01:54:15 user nova-compute[75210]: node.session.scan = manual
Nov 29 01:54:15 user nova-compute[75210]: node.session.reopen_max = 0
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].address = 172.16.0.220
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].port = 3260
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].startup = manual
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].tcp.window_size = 524288
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].tcp.type_of_service = 0
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].timeo.logout_timeout = 15
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].timeo.login_timeout = 15
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].timeo.auth_timeout = 45
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].iscsi.DataDigest = None
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].iscsi.IFMarker = No
Nov 29 01:54:15 user nova-compute[75210]: node.conn[0].iscsi.OFMarker = No
Nov 29 01:54:15 user nova-compute[75210]: # END RECORD
Nov 29 01:54:15 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec2b1d3-90e5-453c-8000-cd8a9e3796bf]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd3f37f-817e-4bec-a509-ba2916fa26c7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoGMuFnY {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WoGMuFnY" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee274be-e0dc-4060-9059-ef108be846a8]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WoGMuFnY'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc54aeb5-498b-4ebc-a59c-c4ab9461301c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd07d28-498d-4830-875b-ea30245e14e4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:54:15 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:54:15 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:54:15 user nova-compute[75210]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:54:15 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:54:15 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:54:15 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:54:15 user nova-compute[75210]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:54:15 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.136s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] HCTL ('37', '0', '0', 0) found on session 42 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b539c292-c06f-44fa-92c8-2d0d5ced42bb]: (4, ('0 0 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Searching for a device in session 42 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoGMuFnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.165s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] <== connect_volume: return (167ms) {'type': 'block', 'scsi_wwn': '23931653632623464', 'path': '/dev/sdf'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931653632623464', 'path': '/dev/sdf'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-549585726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-549585726',id=34,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:52:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-dd94ph0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:52:43Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=5ea4ce52-dd69-4b51-b066-bec88d069151,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "vif_mac": "fa:16:3e:97:68:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "vif_mac": "fa:16:3e:97:68:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:68:b4,bridge_name='br-int',has_traffic_filtering=True,id=9aeb9e13-ef8d-49e6-a98d-75e3fd783cea,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aeb9e13-ef') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.objects.instance [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ea4ce52-dd69-4b51-b066-bec88d069151 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.objects.base [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Object Instance<5ea4ce52-dd69-4b51-b066-bec88d069151> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:54:15 user nova-compute[75210]:   <uuid>5ea4ce52-dd69-4b51-b066-bec88d069151</uuid>
Nov 29 01:54:15 user nova-compute[75210]:   <name>instance-00000022</name>
Nov 29 01:54:15 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:54:15 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:54:15 user nova-compute[75210]:   <metadata>
Nov 29 01:54:15 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:54:15 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:54:15 user nova-compute[75210]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-549585726</nova:name>
Nov 29 01:54:15 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:54:15</nova:creationTime>
Nov 29 01:54:15 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:54:15 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:54:15 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:54:15 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:54:15 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:54:15 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:54:15 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:54:15 user nova-compute[75210]:       <nova:owner>
Nov 29 01:54:15 user nova-compute[75210]:         <nova:user uuid="28fd6f01158e4dd7a7df3e04e815a9d0">tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member</nova:user>
Nov 29 01:54:15 user nova-compute[75210]:         <nova:project uuid="34af8bfc0e1b4cbbb803c3bf6a8f7715">tempest-ServerBootFromVolumeStableRescueTest-440893694</nova:project>
Nov 29 01:54:15 user nova-compute[75210]:       </nova:owner>
Nov 29 01:54:15 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:54:15 user nova-compute[75210]:       <nova:ports>
Nov 29 01:54:15 user nova-compute[75210]:         <nova:port uuid="9aeb9e13-ef8d-49e6-a98d-75e3fd783cea">
Nov 29 01:54:15 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 01:54:15 user nova-compute[75210]:         </nova:port>
Nov 29 01:54:15 user nova-compute[75210]:       </nova:ports>
Nov 29 01:54:15 user nova-compute[75210]:     </nova:instance>
Nov 29 01:54:15 user nova-compute[75210]:   </metadata>
Nov 29 01:54:15 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:54:15 user nova-compute[75210]:     <system>
Nov 29 01:54:15 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:54:15 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:54:15 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:54:15 user nova-compute[75210]:       <entry name="serial">5ea4ce52-dd69-4b51-b066-bec88d069151</entry>
Nov 29 01:54:15 user nova-compute[75210]:       <entry name="uuid">5ea4ce52-dd69-4b51-b066-bec88d069151</entry>
Nov 29 01:54:15 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:54:15 user nova-compute[75210]:     </system>
Nov 29 01:54:15 user nova-compute[75210]:   </sysinfo>
Nov 29 01:54:15 user nova-compute[75210]:   <os>
Nov 29 01:54:15 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:54:15 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:54:15 user nova-compute[75210]:   </os>
Nov 29 01:54:15 user nova-compute[75210]:   <features>
Nov 29 01:54:15 user nova-compute[75210]:     <acpi/>
Nov 29 01:54:15 user nova-compute[75210]:     <apic/>
Nov 29 01:54:15 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:54:15 user nova-compute[75210]:   </features>
Nov 29 01:54:15 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:54:15 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:54:15 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:54:15 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:54:15 user nova-compute[75210]:   </clock>
Nov 29 01:54:15 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:54:15 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:54:15 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:54:15 user nova-compute[75210]:   </cpu>
Nov 29 01:54:15 user nova-compute[75210]:   <devices>
Nov 29 01:54:15 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:54:15 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:54:15 user nova-compute[75210]:       <source dev="/dev/sdf"/>
Nov 29 01:54:15 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:54:15 user nova-compute[75210]:       <serial>c7ee48ba-8fc7-46c6-a549-ec71825f29fc</serial>
Nov 29 01:54:15 user nova-compute[75210]:     </disk>
Nov 29 01:54:15 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:54:15 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:54:15 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.rescue"/>
Nov 29 01:54:15 user nova-compute[75210]:       <target dev="vdb" bus="virtio"/>
Nov 29 01:54:15 user nova-compute[75210]:       <boot order="1"/>
Nov 29 01:54:15 user nova-compute[75210]:     </disk>
Nov 29 01:54:15 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:54:15 user nova-compute[75210]:       <mac address="fa:16:3e:97:68:b4"/>
Nov 29 01:54:15 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:54:15 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:54:15 user nova-compute[75210]:       <target dev="tap9aeb9e13-ef"/>
Nov 29 01:54:15 user nova-compute[75210]:     </interface>
Nov 29 01:54:15 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:54:15 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/console.log" append="off"/>
Nov 29 01:54:15 user nova-compute[75210]:     </serial>
Nov 29 01:54:15 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:54:15 user nova-compute[75210]:     <video>
Nov 29 01:54:15 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:54:15 user nova-compute[75210]:     </video>
Nov 29 01:54:15 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:54:15 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:54:15 user nova-compute[75210]:     </rng>
Nov 29 01:54:15 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:54:15 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:54:15 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:54:15 user nova-compute[75210]:     </memballoon>
Nov 29 01:54:15 user nova-compute[75210]:   </devices>
Nov 29 01:54:15 user nova-compute[75210]: </domain>
Nov 29 01:54:15 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:54:15 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Instance destroyed successfully.
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:54:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] No VIF found with MAC fa:16:3e:97:68:b4, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:54:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-c15a1b5c-1b48-45ff-bf97-0f34e414a6b6 req-e50fb13b-a570-487b-ab33-050c358f9119 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:54:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c15a1b5c-1b48-45ff-bf97-0f34e414a6b6 req-e50fb13b-a570-487b-ab33-050c358f9119 service nova] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c15a1b5c-1b48-45ff-bf97-0f34e414a6b6 req-e50fb13b-a570-487b-ab33-050c358f9119 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c15a1b5c-1b48-45ff-bf97-0f34e414a6b6 req-e50fb13b-a570-487b-ab33-050c358f9119 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-c15a1b5c-1b48-45ff-bf97-0f34e414a6b6 req-e50fb13b-a570-487b-ab33-050c358f9119 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] No waiting events found dispatching network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:54:16 user nova-compute[75210]: WARNING nova.compute.manager [req-c15a1b5c-1b48-45ff-bf97-0f34e414a6b6 req-e50fb13b-a570-487b-ab33-050c358f9119 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received unexpected event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea for instance with vm_state active and task_state rescuing.
Nov 29 01:54:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:18 user nova-compute[75210]: DEBUG nova.compute.manager [None req-31ecab1a-c27d-4edc-8353-376a5887f3c0 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:54:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-c663fea7-70bc-4311-96c6-eeba222cb8e9 req-4f630475-6f39-44ff-999d-c3846e1c1575 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:54:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c663fea7-70bc-4311-96c6-eeba222cb8e9 req-4f630475-6f39-44ff-999d-c3846e1c1575 service nova] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c663fea7-70bc-4311-96c6-eeba222cb8e9 req-4f630475-6f39-44ff-999d-c3846e1c1575 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c663fea7-70bc-4311-96c6-eeba222cb8e9 req-4f630475-6f39-44ff-999d-c3846e1c1575 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-c663fea7-70bc-4311-96c6-eeba222cb8e9 req-4f630475-6f39-44ff-999d-c3846e1c1575 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] No waiting events found dispatching network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:54:18 user nova-compute[75210]: WARNING nova.compute.manager [req-c663fea7-70bc-4311-96c6-eeba222cb8e9 req-4f630475-6f39-44ff-999d-c3846e1c1575 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received unexpected event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea for instance with vm_state rescued and task_state None.
Nov 29 01:54:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:25 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:54:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:54:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:54:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 01:54:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:54:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:54:27 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:54:29 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:54:29 user nova-compute[75210]: INFO nova.compute.manager [None req-c89f8135-cfbb-4fd2-b493-45a16ce55b7c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Unrescuing
Nov 29 01:54:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c89f8135-cfbb-4fd2-b493-45a16ce55b7c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:54:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c89f8135-cfbb-4fd2-b493-45a16ce55b7c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquired lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:54:29 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c89f8135-cfbb-4fd2-b493-45a16ce55b7c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c89f8135-cfbb-4fd2-b493-45a16ce55b7c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Updating instance_info_cache with network_info: [{"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c89f8135-cfbb-4fd2-b493-45a16ce55b7c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Releasing lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c89f8135-cfbb-4fd2-b493-45a16ce55b7c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'flavor' on Instance uuid c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-2376b892-06fd-4d30-a2b2-568957807f95 req-05efdba0-6c75-4c3e-a432-c41bbe5349f5 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-unplugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2376b892-06fd-4d30-a2b2-568957807f95 req-05efdba0-6c75-4c3e-a432-c41bbe5349f5 service nova] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2376b892-06fd-4d30-a2b2-568957807f95 req-05efdba0-6c75-4c3e-a432-c41bbe5349f5 service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2376b892-06fd-4d30-a2b2-568957807f95 req-05efdba0-6c75-4c3e-a432-c41bbe5349f5 service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-2376b892-06fd-4d30-a2b2-568957807f95 req-05efdba0-6c75-4c3e-a432-c41bbe5349f5 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] No waiting events found dispatching network-vif-unplugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:54:30 user nova-compute[75210]: WARNING nova.compute.manager [req-2376b892-06fd-4d30-a2b2-568957807f95 req-05efdba0-6c75-4c3e-a432-c41bbe5349f5 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received unexpected event network-vif-unplugged-312421b0-0d55-4735-9810-310e70a30881 for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:54:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Didn't find any instances for network info cache update. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Instance destroyed successfully.
Nov 29 01:54:31 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:54:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-363d84ae-f57c-47e2-aea6-228a0727375a req-304e3720-fdf5-46f9-838b-0ba855603cfe service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:54:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-363d84ae-f57c-47e2-aea6-228a0727375a req-304e3720-fdf5-46f9-838b-0ba855603cfe service nova] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-363d84ae-f57c-47e2-aea6-228a0727375a req-304e3720-fdf5-46f9-838b-0ba855603cfe service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-363d84ae-f57c-47e2-aea6-228a0727375a req-304e3720-fdf5-46f9-838b-0ba855603cfe service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-363d84ae-f57c-47e2-aea6-228a0727375a req-304e3720-fdf5-46f9-838b-0ba855603cfe service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] No waiting events found dispatching network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:54:32 user nova-compute[75210]: WARNING nova.compute.manager [req-363d84ae-f57c-47e2-aea6-228a0727375a req-304e3720-fdf5-46f9-838b-0ba855603cfe service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received unexpected event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:54:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:34 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:54:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-c1d3ceec-5d80-4e31-97ed-c3b1cdc5fcff req-a67aeff9-70c9-4f0b-aeba-058a5c6dbbf4 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:54:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c1d3ceec-5d80-4e31-97ed-c3b1cdc5fcff req-a67aeff9-70c9-4f0b-aeba-058a5c6dbbf4 service nova] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c1d3ceec-5d80-4e31-97ed-c3b1cdc5fcff req-a67aeff9-70c9-4f0b-aeba-058a5c6dbbf4 service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c1d3ceec-5d80-4e31-97ed-c3b1cdc5fcff req-a67aeff9-70c9-4f0b-aeba-058a5c6dbbf4 service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-c1d3ceec-5d80-4e31-97ed-c3b1cdc5fcff req-a67aeff9-70c9-4f0b-aeba-058a5c6dbbf4 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] No waiting events found dispatching network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:54:34 user nova-compute[75210]: WARNING nova.compute.manager [req-c1d3ceec-5d80-4e31-97ed-c3b1cdc5fcff req-a67aeff9-70c9-4f0b-aeba-058a5c6dbbf4 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received unexpected event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:54:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-c1d3ceec-5d80-4e31-97ed-c3b1cdc5fcff req-a67aeff9-70c9-4f0b-aeba-058a5c6dbbf4 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:54:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c1d3ceec-5d80-4e31-97ed-c3b1cdc5fcff req-a67aeff9-70c9-4f0b-aeba-058a5c6dbbf4 service nova] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c1d3ceec-5d80-4e31-97ed-c3b1cdc5fcff req-a67aeff9-70c9-4f0b-aeba-058a5c6dbbf4 service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c1d3ceec-5d80-4e31-97ed-c3b1cdc5fcff req-a67aeff9-70c9-4f0b-aeba-058a5c6dbbf4 service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-c1d3ceec-5d80-4e31-97ed-c3b1cdc5fcff req-a67aeff9-70c9-4f0b-aeba-058a5c6dbbf4 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] No waiting events found dispatching network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:54:34 user nova-compute[75210]: WARNING nova.compute.manager [req-c1d3ceec-5d80-4e31-97ed-c3b1cdc5fcff req-a67aeff9-70c9-4f0b-aeba-058a5c6dbbf4 service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received unexpected event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:54:34 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c89f8135-cfbb-4fd2-b493-45a16ce55b7c tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:54:35 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:54:35 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:54:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:54:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:54:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:54:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:36 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:54:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:54:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:54:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:54:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:54:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:54:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:54:40 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:54:40 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8040MB free_disk=25.050273895263672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3df17188-c87e-49e5-9ca2-5d04632ea9bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c320d76b-58e8-4032-bef3-3aead513231e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 5ea4ce52-dd69-4b51-b066-bec88d069151 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 1ea93b31-f7c3-456f-aa99-113160704256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:54:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:54:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG nova.compute.manager [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:54:59 user nova-compute[75210]: INFO nova.compute.claims [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Claim successful on node user
Nov 29 01:54:59 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG nova.compute.manager [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG nova.compute.manager [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG nova.network.neutron [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:54:59 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:54:59 user nova-compute[75210]: DEBUG nova.compute.manager [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG nova.policy [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ee2d9a0f7574bad97338a59b8ce8968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aac75090884257a9c33f94ec9aa367', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG nova.compute.manager [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:54:59 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Creating image(s)
Nov 29 01:54:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "/opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "/opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "/opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:54:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.196s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk 1073741824" returned: 0 in 0.073s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG nova.network.neutron [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Successfully created port: c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Cannot resize image /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Ensure instance console log exists: /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.network.neutron [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Successfully updated port: c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquired lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.network.neutron [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-323e0daf-8b9e-4002-83a8-13abe2e549b6 req-1df43cc0-1b00-457c-8119-cdd87eb68915 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-changed-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-323e0daf-8b9e-4002-83a8-13abe2e549b6 req-1df43cc0-1b00-457c-8119-cdd87eb68915 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Refreshing instance network info cache due to event network-changed-c2989e5b-8405-458d-8862-86a28f95bb38. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-323e0daf-8b9e-4002-83a8-13abe2e549b6 req-1df43cc0-1b00-457c-8119-cdd87eb68915 service nova] Acquiring lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.network.neutron [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.network.neutron [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updating instance_info_cache with network_info: [{"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Releasing lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Instance network_info: |[{"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-323e0daf-8b9e-4002-83a8-13abe2e549b6 req-1df43cc0-1b00-457c-8119-cdd87eb68915 service nova] Acquired lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.network.neutron [req-323e0daf-8b9e-4002-83a8-13abe2e549b6 req-1df43cc0-1b00-457c-8119-cdd87eb68915 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Refreshing network info cache for port c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Start _get_guest_xml network_info=[{"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:55:01 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:55:01 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1654971335',display_name='tempest-AttachVolumeTestJSON-server-1654971335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1654971335',id=36,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGnqdmpBzYm6z7oGTNZRg+k46dT8ozTAGc/Jui4Cyn5xsrA9EzCgjJ4vksQkVJRWqNU8LRGswNNFzJWUQNeBPWWN26oJbHGu7RqD4PfAoZzP7e8c5Cd769h3F8sF6e9zg==',key_name='tempest-keypair-2129640759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64aac75090884257a9c33f94ec9aa367',ramdisk_id='',reservation_id='r-c673118l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-91454133',owner_user_name='tempest-AttachVolumeTestJSON-91454133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:55:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee2d9a0f7574bad97338a59b8ce8968',uuid=34309f2a-e58e-4c00-a80d-0fc86e72e4fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converting VIF {"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.objects.instance [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'pci_devices' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:55:01 user nova-compute[75210]:   <uuid>34309f2a-e58e-4c00-a80d-0fc86e72e4fa</uuid>
Nov 29 01:55:01 user nova-compute[75210]:   <name>instance-00000024</name>
Nov 29 01:55:01 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:55:01 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:55:01 user nova-compute[75210]:   <metadata>
Nov 29 01:55:01 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:55:01 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:55:01 user nova-compute[75210]:       <nova:name>tempest-AttachVolumeTestJSON-server-1654971335</nova:name>
Nov 29 01:55:01 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:55:01</nova:creationTime>
Nov 29 01:55:01 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:55:01 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:55:01 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:55:01 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:55:01 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:55:01 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:55:01 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:55:01 user nova-compute[75210]:       <nova:owner>
Nov 29 01:55:01 user nova-compute[75210]:         <nova:user uuid="3ee2d9a0f7574bad97338a59b8ce8968">tempest-AttachVolumeTestJSON-91454133-project-member</nova:user>
Nov 29 01:55:01 user nova-compute[75210]:         <nova:project uuid="64aac75090884257a9c33f94ec9aa367">tempest-AttachVolumeTestJSON-91454133</nova:project>
Nov 29 01:55:01 user nova-compute[75210]:       </nova:owner>
Nov 29 01:55:01 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:55:01 user nova-compute[75210]:       <nova:ports>
Nov 29 01:55:01 user nova-compute[75210]:         <nova:port uuid="c2989e5b-8405-458d-8862-86a28f95bb38">
Nov 29 01:55:01 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 01:55:01 user nova-compute[75210]:         </nova:port>
Nov 29 01:55:01 user nova-compute[75210]:       </nova:ports>
Nov 29 01:55:01 user nova-compute[75210]:     </nova:instance>
Nov 29 01:55:01 user nova-compute[75210]:   </metadata>
Nov 29 01:55:01 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:55:01 user nova-compute[75210]:     <system>
Nov 29 01:55:01 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:55:01 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:55:01 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:55:01 user nova-compute[75210]:       <entry name="serial">34309f2a-e58e-4c00-a80d-0fc86e72e4fa</entry>
Nov 29 01:55:01 user nova-compute[75210]:       <entry name="uuid">34309f2a-e58e-4c00-a80d-0fc86e72e4fa</entry>
Nov 29 01:55:01 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:55:01 user nova-compute[75210]:     </system>
Nov 29 01:55:01 user nova-compute[75210]:   </sysinfo>
Nov 29 01:55:01 user nova-compute[75210]:   <os>
Nov 29 01:55:01 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:55:01 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:55:01 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:55:01 user nova-compute[75210]:   </os>
Nov 29 01:55:01 user nova-compute[75210]:   <features>
Nov 29 01:55:01 user nova-compute[75210]:     <acpi/>
Nov 29 01:55:01 user nova-compute[75210]:     <apic/>
Nov 29 01:55:01 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:55:01 user nova-compute[75210]:   </features>
Nov 29 01:55:01 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:55:01 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:55:01 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:55:01 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:55:01 user nova-compute[75210]:   </clock>
Nov 29 01:55:01 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:55:01 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:55:01 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:55:01 user nova-compute[75210]:   </cpu>
Nov 29 01:55:01 user nova-compute[75210]:   <devices>
Nov 29 01:55:01 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:55:01 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:55:01 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk"/>
Nov 29 01:55:01 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:55:01 user nova-compute[75210]:     </disk>
Nov 29 01:55:01 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:55:01 user nova-compute[75210]:       <mac address="fa:16:3e:7b:b4:90"/>
Nov 29 01:55:01 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:55:01 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:55:01 user nova-compute[75210]:       <target dev="tapc2989e5b-84"/>
Nov 29 01:55:01 user nova-compute[75210]:     </interface>
Nov 29 01:55:01 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:55:01 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/console.log" append="off"/>
Nov 29 01:55:01 user nova-compute[75210]:     </serial>
Nov 29 01:55:01 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:55:01 user nova-compute[75210]:     <video>
Nov 29 01:55:01 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:55:01 user nova-compute[75210]:     </video>
Nov 29 01:55:01 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:55:01 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:55:01 user nova-compute[75210]:     </rng>
Nov 29 01:55:01 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:55:01 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:55:01 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:55:01 user nova-compute[75210]:     </memballoon>
Nov 29 01:55:01 user nova-compute[75210]:   </devices>
Nov 29 01:55:01 user nova-compute[75210]: </domain>
Nov 29 01:55:01 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1654971335',display_name='tempest-AttachVolumeTestJSON-server-1654971335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1654971335',id=36,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGnqdmpBzYm6z7oGTNZRg+k46dT8ozTAGc/Jui4Cyn5xsrA9EzCgjJ4vksQkVJRWqNU8LRGswNNFzJWUQNeBPWWN26oJbHGu7RqD4PfAoZzP7e8c5Cd769h3F8sF6e9zg==',key_name='tempest-keypair-2129640759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64aac75090884257a9c33f94ec9aa367',ramdisk_id='',reservation_id='r-c673118l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-91454133',owner_user_name='tempest-AttachVolumeTestJSON-91454133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:55:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee2d9a0f7574bad97338a59b8ce8968',uuid=34309f2a-e58e-4c00-a80d-0fc86e72e4fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converting VIF {"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG os_vif [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecc1b33f-62e6-5db9-82a7-66e573da2219', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2989e5b-84, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2989e5b-84, col_values=(('qos', UUID('543329ba-63c9-4de7-bf8b-22081b7d39f0')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2989e5b-84, col_values=(('external_ids', {'iface-id': 'c2989e5b-8405-458d-8862-86a28f95bb38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:b4:90', 'vm-uuid': '34309f2a-e58e-4c00-a80d-0fc86e72e4fa'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:01 user nova-compute[75210]: INFO os_vif [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84')
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:55:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No VIF found with MAC fa:16:3e:7b:b4:90, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:55:02 user nova-compute[75210]: DEBUG nova.network.neutron [req-323e0daf-8b9e-4002-83a8-13abe2e549b6 req-1df43cc0-1b00-457c-8119-cdd87eb68915 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updated VIF entry in instance network info cache for port c2989e5b-8405-458d-8862-86a28f95bb38. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:55:02 user nova-compute[75210]: DEBUG nova.network.neutron [req-323e0daf-8b9e-4002-83a8-13abe2e549b6 req-1df43cc0-1b00-457c-8119-cdd87eb68915 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updating instance_info_cache with network_info: [{"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:55:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-323e0daf-8b9e-4002-83a8-13abe2e549b6 req-1df43cc0-1b00-457c-8119-cdd87eb68915 service nova] Releasing lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:55:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-e905ee24-2037-4c58-8d31-09a789d0247b req-95eb4ebc-fbdb-4c0e-9205-7525b982ce22 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:55:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e905ee24-2037-4c58-8d31-09a789d0247b req-95eb4ebc-fbdb-4c0e-9205-7525b982ce22 service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e905ee24-2037-4c58-8d31-09a789d0247b req-95eb4ebc-fbdb-4c0e-9205-7525b982ce22 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e905ee24-2037-4c58-8d31-09a789d0247b req-95eb4ebc-fbdb-4c0e-9205-7525b982ce22 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-e905ee24-2037-4c58-8d31-09a789d0247b req-95eb4ebc-fbdb-4c0e-9205-7525b982ce22 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:55:03 user nova-compute[75210]: WARNING nova.compute.manager [req-e905ee24-2037-4c58-8d31-09a789d0247b req-95eb4ebc-fbdb-4c0e-9205-7525b982ce22 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state building and task_state spawning.
Nov 29 01:55:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:55:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Instance spawned successfully.
Nov 29 01:55:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-492547e1-d6c4-4d3a-b5e5-264b0e86a47c req-a584ddad-f2e0-4511-b99e-f081fd53c22d service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-492547e1-d6c4-4d3a-b5e5-264b0e86a47c req-a584ddad-f2e0-4511-b99e-f081fd53c22d service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-492547e1-d6c4-4d3a-b5e5-264b0e86a47c req-a584ddad-f2e0-4511-b99e-f081fd53c22d service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-492547e1-d6c4-4d3a-b5e5-264b0e86a47c req-a584ddad-f2e0-4511-b99e-f081fd53c22d service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-492547e1-d6c4-4d3a-b5e5-264b0e86a47c req-a584ddad-f2e0-4511-b99e-f081fd53c22d service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:55:05 user nova-compute[75210]: WARNING nova.compute.manager [req-492547e1-d6c4-4d3a-b5e5-264b0e86a47c req-a584ddad-f2e0-4511-b99e-f081fd53c22d service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state building and task_state spawning.
Nov 29 01:55:05 user nova-compute[75210]: INFO nova.compute.manager [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 29 01:55:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:55:05 user nova-compute[75210]: INFO nova.compute.manager [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Took 6.38 seconds to build instance.
Nov 29 01:55:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50d99762-85af-41cc-868b-88dd0915460f tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.489s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-7b77a412-ae75-4b8c-ba50-03802a708d20 req-686bccc0-5db8-42a1-8ff8-140008a8d05b service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Received event network-changed-91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:55:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-7b77a412-ae75-4b8c-ba50-03802a708d20 req-686bccc0-5db8-42a1-8ff8-140008a8d05b service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Refreshing instance network info cache due to event network-changed-91762155-8cec-4ac5-aeea-fe198c706136. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:55:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7b77a412-ae75-4b8c-ba50-03802a708d20 req-686bccc0-5db8-42a1-8ff8-140008a8d05b service nova] Acquiring lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:55:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7b77a412-ae75-4b8c-ba50-03802a708d20 req-686bccc0-5db8-42a1-8ff8-140008a8d05b service nova] Acquired lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:55:21 user nova-compute[75210]: DEBUG nova.network.neutron [req-7b77a412-ae75-4b8c-ba50-03802a708d20 req-686bccc0-5db8-42a1-8ff8-140008a8d05b service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Refreshing network info cache for port 91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:55:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:22 user nova-compute[75210]: DEBUG nova.network.neutron [req-7b77a412-ae75-4b8c-ba50-03802a708d20 req-686bccc0-5db8-42a1-8ff8-140008a8d05b service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updated VIF entry in instance network info cache for port 91762155-8cec-4ac5-aeea-fe198c706136. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:55:22 user nova-compute[75210]: DEBUG nova.network.neutron [req-7b77a412-ae75-4b8c-ba50-03802a708d20 req-686bccc0-5db8-42a1-8ff8-140008a8d05b service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updating instance_info_cache with network_info: [{"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:55:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7b77a412-ae75-4b8c-ba50-03802a708d20 req-686bccc0-5db8-42a1-8ff8-140008a8d05b service nova] Releasing lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:55:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "0280bdf1-f006-4252-be61-3fb3452707b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "0280bdf1-f006-4252-be61-3fb3452707b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:22 user nova-compute[75210]: DEBUG nova.compute.manager [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Stashing vm_state: active {{(pid=75210) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:55:23 user nova-compute[75210]: INFO nova.compute.claims [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Claim successful on node user
Nov 29 01:55:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-a1b40ea2-4811-4b39-b989-099e7bc83733 req-5bcd4d25-f910-4065-819a-c57c8a6768e5 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-changed-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-a1b40ea2-4811-4b39-b989-099e7bc83733 req-5bcd4d25-f910-4065-819a-c57c8a6768e5 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Refreshing instance network info cache due to event network-changed-09497c00-460e-40af-942c-0c6f727dc0d8. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a1b40ea2-4811-4b39-b989-099e7bc83733 req-5bcd4d25-f910-4065-819a-c57c8a6768e5 service nova] Acquiring lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a1b40ea2-4811-4b39-b989-099e7bc83733 req-5bcd4d25-f910-4065-819a-c57c8a6768e5 service nova] Acquired lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-a1b40ea2-4811-4b39-b989-099e7bc83733 req-5bcd4d25-f910-4065-819a-c57c8a6768e5 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Refreshing network info cache for port 09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.749s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.679s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-a1b40ea2-4811-4b39-b989-099e7bc83733 req-5bcd4d25-f910-4065-819a-c57c8a6768e5 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updated VIF entry in instance network info cache for port 09497c00-460e-40af-942c-0c6f727dc0d8. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-a1b40ea2-4811-4b39-b989-099e7bc83733 req-5bcd4d25-f910-4065-819a-c57c8a6768e5 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updating instance_info_cache with network_info: [{"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:55:23 user nova-compute[75210]: INFO nova.compute.claims [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Claim successful on node user
Nov 29 01:55:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a1b40ea2-4811-4b39-b989-099e7bc83733 req-5bcd4d25-f910-4065-819a-c57c8a6768e5 service nova] Releasing lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.network.neutron [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:55:23 user nova-compute[75210]: INFO nova.compute.resource_tracker [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updating resource usage from migration 33ce06dc-25d4-4489-9722-7c4f8265d559
Nov 29 01:55:23 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:55:23 user nova-compute[75210]: DEBUG nova.policy [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '080bcd228b454b03995b0f3e116df917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70d8cbb4232433cbd0db9e9448d897f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:55:24 user nova-compute[75210]: INFO nova.virt.block_device [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Booting with volume snapshot f82841d4-8e14-4786-a009-48f66a5fa9f6 at /dev/vda
Nov 29 01:55:24 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:55:24 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:55:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.469s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:24 user nova-compute[75210]: INFO nova.compute.manager [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Migrating
Nov 29 01:55:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:55:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquired lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:55:24 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:55:24 user nova-compute[75210]: DEBUG nova.network.neutron [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Successfully created port: 9f707398-e63a-4a23-8ac0-6836c31a80b8 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:55:24 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updating instance_info_cache with network_info: [{"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:55:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Releasing lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Starting migrate_disk_and_power_off {{(pid=75210) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.compute.manager [req-89c8c499-f23e-4740-b7a3-5823101a697b req-56a6d3e5-6e01-4343-891e-9ff4b9949c0a service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-unplugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-89c8c499-f23e-4740-b7a3-5823101a697b req-56a6d3e5-6e01-4343-891e-9ff4b9949c0a service nova] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-89c8c499-f23e-4740-b7a3-5823101a697b req-56a6d3e5-6e01-4343-891e-9ff4b9949c0a service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-89c8c499-f23e-4740-b7a3-5823101a697b req-56a6d3e5-6e01-4343-891e-9ff4b9949c0a service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.compute.manager [req-89c8c499-f23e-4740-b7a3-5823101a697b req-56a6d3e5-6e01-4343-891e-9ff4b9949c0a service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] No waiting events found dispatching network-vif-unplugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:55:25 user nova-compute[75210]: WARNING nova.compute.manager [req-89c8c499-f23e-4740-b7a3-5823101a697b req-56a6d3e5-6e01-4343-891e-9ff4b9949c0a service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received unexpected event network-vif-unplugged-09497c00-460e-40af-942c-0c6f727dc0d8 for instance with vm_state active and task_state resize_migrating.
Nov 29 01:55:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.network.neutron [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Successfully updated port: 9f707398-e63a-4a23-8ac0-6836c31a80b8 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "refresh_cache-0280bdf1-f006-4252-be61-3fb3452707b4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquired lock "refresh_cache-0280bdf1-f006-4252-be61-3fb3452707b4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.network.neutron [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.compute.manager [req-6c2082a5-46d3-453b-a186-5e21e00480c8 req-59ac991f-a67f-4714-a0a3-1b11e882897f service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Received event network-changed-9f707398-e63a-4a23-8ac0-6836c31a80b8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.compute.manager [req-6c2082a5-46d3-453b-a186-5e21e00480c8 req-59ac991f-a67f-4714-a0a3-1b11e882897f service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Refreshing instance network info cache due to event network-changed-9f707398-e63a-4a23-8ac0-6836c31a80b8. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6c2082a5-46d3-453b-a186-5e21e00480c8 req-59ac991f-a67f-4714-a0a3-1b11e882897f service nova] Acquiring lock "refresh_cache-0280bdf1-f006-4252-be61-3fb3452707b4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.network.neutron [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.network.neutron [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Updating instance_info_cache with network_info: [{"id": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "address": "fa:16:3e:65:ed:d4", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f707398-e6", "ovs_interfaceid": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Releasing lock "refresh_cache-0280bdf1-f006-4252-be61-3fb3452707b4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.compute.manager [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Instance network_info: |[{"id": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "address": "fa:16:3e:65:ed:d4", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f707398-e6", "ovs_interfaceid": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6c2082a5-46d3-453b-a186-5e21e00480c8 req-59ac991f-a67f-4714-a0a3-1b11e882897f service nova] Acquired lock "refresh_cache-0280bdf1-f006-4252-be61-3fb3452707b4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.network.neutron [req-6c2082a5-46d3-453b-a186-5e21e00480c8 req-59ac991f-a67f-4714-a0a3-1b11e882897f service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Refreshing network info cache for port 9f707398-e63a-4a23-8ac0-6836c31a80b8 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:55:25 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Instance destroyed successfully.
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1869106097',display_name='tempest-ServerActionsTestOtherA-server-1869106097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1869106097',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0ZPcsrrZ0p77iZVF3hXrlbitPxsOMUk6lEgPtIOZB1sypvzBAvVGb9BhgWOjWjr7Z8pdmqoU3sXtItuyafViUIU/dnioTrc/zJIESKhxOMP7SI+ZANtu7hU2Hj6RuPWQ==',key_name='tempest-keypair-192951479',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:53:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-f9ddzge5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:55:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=1ea93b31-f7c3-456f-aa99-113160704256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1066097154-network", "vif_mac": "fa:16:3e:3c:1d:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1066097154-network", "vif_mac": "fa:16:3e:3c:1d:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG os_vif [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09497c00-46, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8572b60-8207-4ebe-97c1-803c0d30ca21) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:25 user nova-compute[75210]: INFO os_vif [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46')
Nov 29 01:55:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoewKfcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:55:25 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:55:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b628cf-b6d1-42ed-8ebd-d2b1123e8976]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:55:25 user nova-compute[75210]: No targets found.
Nov 29 01:55:25 user nova-compute[75210]: iSNS:
Nov 29 01:55:25 user nova-compute[75210]: No targets found.
Nov 29 01:55:25 user nova-compute[75210]: STATIC:
Nov 29 01:55:25 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc
Nov 29 01:55:25 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:55:25 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:55:25 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256
Nov 29 01:55:25 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:55:25 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:55:25 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:55:25 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:55:25 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:55:25 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823
Nov 29 01:55:25 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:55:25 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:55:25 user nova-compute[75210]: FIRMWARE:
Nov 29 01:55:25 user nova-compute[75210]: No targets found.
Nov 29 01:55:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:55:25 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:55:25 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[734ca091-a4db-456d-8789-89e56e54fc6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5017b366-9acb-45f7-8b84-60dd306ed73f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:55:25 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:55:25 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:55:25 user nova-compute[75210]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:55:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:55:25 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:55:25 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:55:25 user nova-compute[75210]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:55:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f523b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256'): ({'sdg'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Removing single pathed devices sdg {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:55:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e98d3a4-8ef1-432d-9ae9-07b6f79c60a5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc21740-1974-4a22-8ffd-e3316be90304]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flushing IO for device /dev/sdg {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2848bf18-91b6-4264-9561-9ece871327b7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb928c9-6fd8-4ee5-aa4c-3d0f57538a3a]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] SCSI volumes sdg have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[912d2bea-2363-48db-ac14-69106c221016]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb52bd9a-a6c5-415c-ae13-08cefd3ea887]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260]
Nov 29 01:55:26 user nova-compute[75210]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260] successful.
Nov 29 01:55:26 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5657de6-8e76-4d0e-baeb-09d5036de90b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] <== disconnect_volume: return (304ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG nova.network.neutron [req-6c2082a5-46d3-453b-a186-5e21e00480c8 req-59ac991f-a67f-4714-a0a3-1b11e882897f service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Updated VIF entry in instance network info cache for port 9f707398-e63a-4a23-8ac0-6836c31a80b8. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG nova.network.neutron [req-6c2082a5-46d3-453b-a186-5e21e00480c8 req-59ac991f-a67f-4714-a0a3-1b11e882897f service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Updating instance_info_cache with network_info: [{"id": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "address": "fa:16:3e:65:ed:d4", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f707398-e6", "ovs_interfaceid": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6c2082a5-46d3-453b-a186-5e21e00480c8 req-59ac991f-a67f-4714-a0a3-1b11e882897f service nova] Releasing lock "refresh_cache-0280bdf1-f006-4252-be61-3fb3452707b4" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Port 09497c00-460e-40af-942c-0c6f727dc0d8 binding to destination host user is already ACTIVE {{(pid=75210) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquired lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-a578ba80-344f-4211-abf7-d9c3b32e94da req-cec25266-380f-4aac-8c62-2c75348fd043 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a578ba80-344f-4211-abf7-d9c3b32e94da req-cec25266-380f-4aac-8c62-2c75348fd043 service nova] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a578ba80-344f-4211-abf7-d9c3b32e94da req-cec25266-380f-4aac-8c62-2c75348fd043 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a578ba80-344f-4211-abf7-d9c3b32e94da req-cec25266-380f-4aac-8c62-2c75348fd043 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-a578ba80-344f-4211-abf7-d9c3b32e94da req-cec25266-380f-4aac-8c62-2c75348fd043 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] No waiting events found dispatching network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:55:27 user nova-compute[75210]: WARNING nova.compute.manager [req-a578ba80-344f-4211-abf7-d9c3b32e94da req-cec25266-380f-4aac-8c62-2c75348fd043 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received unexpected event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 for instance with vm_state active and task_state resize_migrated.
Nov 29 01:55:27 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updating instance_info_cache with network_info: [{"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Releasing lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG os_brick.utils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76e8d81-385e-430d-b579-92c87c83f861]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[04be73d2-c610-408a-971f-3622657b439e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb21bfb-4887-415a-a14e-42a1f2032ba7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d450e9ae-ab06-4f51-afe1-9d67ca64abd9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:55:27 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:55:27 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[79287152-0889-4351-90d7-681497447097]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:55:27 user nova-compute[75210]: DEBUG os_brick.utils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG os_brick.utils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[81196efe-0c9f-4233-81ec-ced1b876ef0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f1b226-0f09-49e5-9281-1d75123c8b3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba04daeb-39a1-4d5c-a48b-8e85143c1041]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[463272da-168c-4cfb-82cb-8cc8a83dc2a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:55:29 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:55:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac207e2-1f6d-4b3d-826b-77ca5befbd09]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG os_brick.utils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:55:29 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Updating existing volume attachment record: 0700cc4b-6248-45df-bd21-5f91f3fa09a0 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:55:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:31 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:55:31 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:55:31 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 01:55:31 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Skipping network cache update for instance because it is Building. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 29 01:55:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:55:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:55:31 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:55:31 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid 996b4364-9920-4b91-8a06-0b6f2c138aab {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:55:32 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Updating instance_info_cache with network_info: [{"id": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "address": "fa:16:3e:e0:7c:09", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dba9f4e-29", "ovs_interfaceid": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:55:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-996b4364-9920-4b91-8a06-0b6f2c138aab" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:55:32 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:55:32 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:55:32 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:55:32 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Starting finish_migration {{(pid=75210) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Instance directory exists: not creating {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 01:55:35 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Creating image(s)
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Ensure instance console log exists: /opt/stack/data/nova/instances/1ea93b31-f7c3-456f-aa99-113160704256/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Start _get_guest_xml network_info=[{"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1066097154-network", "vif_mac": "fa:16:3e:3c:1d:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': '8f970abc-ab20-47cd-9e58-5ed412e750c6', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoewKfcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1ea93b31-f7c3-456f-aa99-113160704256', 'attached_at': '2023-11-29T01:55:35.000000', 'detached_at': '', 'volume_id': 'e623ee5d-9e4f-4444-af26-0fc9dd480256', 'serial': 'e623ee5d-9e4f-4444-af26-0fc9dd480256'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:55:35 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:55:35 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoewKfcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:55:35 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:55:35 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:55:35 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd85449d-1c8a-4c63-9444-cd4369b33c3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:55:35 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[831e9f3b-5689-4105-acd3-5903e7aaedb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256] added
Nov 29 01:55:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4acf909-903b-4750-b425-707635093cc7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c42bf2-733c-42f4-ab2b-3c5bc58a8b35]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoewKfcm {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JoewKfcm" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8da8c3f-3aba-4032-bab4-0661a4a9deb2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JoewKfcm'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53e537e-0f37-4c98-a585-b75fefb0fa45]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a4f232-27c8-480e-aef9-2efdfd433d6b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:55:35 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:55:35 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:55:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:55:35 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:55:35 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:55:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e8555a-9055-4826-b294-b4119224c7a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260]
Nov 29 01:55:35 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260] successful.
Nov 29 01:55:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd871704-6e08-4eda-99ca-d80585998d07]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a56a4d-ce81-4d58-93b3-e1597501581f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:55:35 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:55:35 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:55:35 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:55:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:55:35 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:55:35 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:55:35 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:55:35 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[af99bea7-41dc-4bfd-ac89-2ccca689e716]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:55:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoewKfcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26137353830346236', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137353830346236', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1869106097',display_name='tempest-ServerActionsTestOtherA-server-1869106097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1869106097',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0ZPcsrrZ0p77iZVF3hXrlbitPxsOMUk6lEgPtIOZB1sypvzBAvVGb9BhgWOjWjr7Z8pdmqoU3sXtItuyafViUIU/dnioTrc/zJIESKhxOMP7SI+ZANtu7hU2Hj6RuPWQ==',key_name='tempest-keypair-192951479',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:53:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-f9ddzge5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:55:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=1ea93b31-f7c3-456f-aa99-113160704256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1066097154-network", "vif_mac": "fa:16:3e:3c:1d:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1066097154-network", "vif_mac": "fa:16:3e:3c:1d:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:55:36 user nova-compute[75210]:   <uuid>1ea93b31-f7c3-456f-aa99-113160704256</uuid>
Nov 29 01:55:36 user nova-compute[75210]:   <name>instance-00000023</name>
Nov 29 01:55:36 user nova-compute[75210]:   <memory>2097152</memory>
Nov 29 01:55:36 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:55:36 user nova-compute[75210]:   <metadata>
Nov 29 01:55:36 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:55:36 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:55:36 user nova-compute[75210]:       <nova:name>tempest-ServerActionsTestOtherA-server-1869106097</nova:name>
Nov 29 01:55:36 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:55:35</nova:creationTime>
Nov 29 01:55:36 user nova-compute[75210]:       <nova:flavor name="m1.small">
Nov 29 01:55:36 user nova-compute[75210]:         <nova:memory>2048</nova:memory>
Nov 29 01:55:36 user nova-compute[75210]:         <nova:disk>20</nova:disk>
Nov 29 01:55:36 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:55:36 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:55:36 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:55:36 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:55:36 user nova-compute[75210]:       <nova:owner>
Nov 29 01:55:36 user nova-compute[75210]:         <nova:user uuid="2d98e0c98f554dd5b8a84f9b3933cf1a">tempest-ServerActionsTestOtherA-1921082789-project-member</nova:user>
Nov 29 01:55:36 user nova-compute[75210]:         <nova:project uuid="30940563d2c94d87b2e350faf4d0c5b0">tempest-ServerActionsTestOtherA-1921082789</nova:project>
Nov 29 01:55:36 user nova-compute[75210]:       </nova:owner>
Nov 29 01:55:36 user nova-compute[75210]:       <nova:ports>
Nov 29 01:55:36 user nova-compute[75210]:         <nova:port uuid="09497c00-460e-40af-942c-0c6f727dc0d8">
Nov 29 01:55:36 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 01:55:36 user nova-compute[75210]:         </nova:port>
Nov 29 01:55:36 user nova-compute[75210]:       </nova:ports>
Nov 29 01:55:36 user nova-compute[75210]:     </nova:instance>
Nov 29 01:55:36 user nova-compute[75210]:   </metadata>
Nov 29 01:55:36 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:55:36 user nova-compute[75210]:     <system>
Nov 29 01:55:36 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:55:36 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:55:36 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:55:36 user nova-compute[75210]:       <entry name="serial">1ea93b31-f7c3-456f-aa99-113160704256</entry>
Nov 29 01:55:36 user nova-compute[75210]:       <entry name="uuid">1ea93b31-f7c3-456f-aa99-113160704256</entry>
Nov 29 01:55:36 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:55:36 user nova-compute[75210]:     </system>
Nov 29 01:55:36 user nova-compute[75210]:   </sysinfo>
Nov 29 01:55:36 user nova-compute[75210]:   <os>
Nov 29 01:55:36 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:55:36 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:55:36 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:55:36 user nova-compute[75210]:   </os>
Nov 29 01:55:36 user nova-compute[75210]:   <features>
Nov 29 01:55:36 user nova-compute[75210]:     <acpi/>
Nov 29 01:55:36 user nova-compute[75210]:     <apic/>
Nov 29 01:55:36 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:55:36 user nova-compute[75210]:   </features>
Nov 29 01:55:36 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:55:36 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:55:36 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:55:36 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:55:36 user nova-compute[75210]:   </clock>
Nov 29 01:55:36 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:55:36 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:55:36 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:55:36 user nova-compute[75210]:   </cpu>
Nov 29 01:55:36 user nova-compute[75210]:   <devices>
Nov 29 01:55:36 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:55:36 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:55:36 user nova-compute[75210]:       <source dev="/dev/sdc"/>
Nov 29 01:55:36 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:55:36 user nova-compute[75210]:       <serial>e623ee5d-9e4f-4444-af26-0fc9dd480256</serial>
Nov 29 01:55:36 user nova-compute[75210]:     </disk>
Nov 29 01:55:36 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:55:36 user nova-compute[75210]:       <mac address="fa:16:3e:3c:1d:c3"/>
Nov 29 01:55:36 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:55:36 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:55:36 user nova-compute[75210]:       <target dev="tap09497c00-46"/>
Nov 29 01:55:36 user nova-compute[75210]:     </interface>
Nov 29 01:55:36 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:55:36 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/1ea93b31-f7c3-456f-aa99-113160704256/console.log" append="off"/>
Nov 29 01:55:36 user nova-compute[75210]:     </serial>
Nov 29 01:55:36 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:55:36 user nova-compute[75210]:     <video>
Nov 29 01:55:36 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:55:36 user nova-compute[75210]:     </video>
Nov 29 01:55:36 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:55:36 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:55:36 user nova-compute[75210]:     </rng>
Nov 29 01:55:36 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:55:36 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:55:36 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:55:36 user nova-compute[75210]:     </memballoon>
Nov 29 01:55:36 user nova-compute[75210]:   </devices>
Nov 29 01:55:36 user nova-compute[75210]: </domain>
Nov 29 01:55:36 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1869106097',display_name='tempest-ServerActionsTestOtherA-server-1869106097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1869106097',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0ZPcsrrZ0p77iZVF3hXrlbitPxsOMUk6lEgPtIOZB1sypvzBAvVGb9BhgWOjWjr7Z8pdmqoU3sXtItuyafViUIU/dnioTrc/zJIESKhxOMP7SI+ZANtu7hU2Hj6RuPWQ==',key_name='tempest-keypair-192951479',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:53:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-f9ddzge5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:55:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=1ea93b31-f7c3-456f-aa99-113160704256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1066097154-network", "vif_mac": "fa:16:3e:3c:1d:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1066097154-network", "vif_mac": "fa:16:3e:3c:1d:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG os_vif [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c00db980-e301-5e65-8d2d-acbc42778067', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09497c00-46, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09497c00-46, col_values=(('qos', UUID('5b9c9145-cba3-4539-986f-50f442846ac2')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09497c00-46, col_values=(('external_ids', {'iface-id': '09497c00-460e-40af-942c-0c6f727dc0d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:1d:c3', 'vm-uuid': '1ea93b31-f7c3-456f-aa99-113160704256'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:36 user nova-compute[75210]: INFO os_vif [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46')
Nov 29 01:55:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:55:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] No VIF found with MAC fa:16:3e:3c:1d:c3, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:55:37 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Creating image(s)
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Ensure instance console log exists: /opt/stack/data/nova/instances/0280bdf1-f006-4252-be61-3fb3452707b4/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Start _get_guest_xml network_info=[{"id": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "address": "fa:16:3e:65:ed:d4", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f707398-e6", "ovs_interfaceid": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': '0700cc4b-6248-45df-bd21-5f91f3fa09a0', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyxpWVno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0280bdf1-f006-4252-be61-3fb3452707b4', 'attached_at': '', 'detached_at': '', 'volume_id': '9bbf5212-5bb0-4d7d-bca3-9c301f04ec32', 'serial': '9bbf5212-5bb0-4d7d-bca3-9c301f04ec32'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:55:37 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:55:37 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyxpWVno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:55:37 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:55:37 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:55:37 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44e3c98-300c-4683-b1ea-24c39f502d25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:55:37 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe4e8d-0f30-4ee1-9150-f6e9c2553dfd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32] added
Nov 29 01:55:37 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e6b481-2902-4a2c-8e54-f865128f2bab]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[831f8745-8704-45eb-86e4-78b8206fbd2b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyxpWVno {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyxpWVno" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d18b5ef-a8bb-49f0-bef5-70258ddf1778]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HyxpWVno'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ff90b8-d8c7-45de-905b-d1144ef625eb]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d731d92-9996-4253-a625-6d0069c78a83]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a31e304-c434-4495-8815-fdcd119f5469]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32, portal: 172.16.0.220,3260]
Nov 29 01:55:37 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32, portal: 172.16.0.220,3260] successful.
Nov 29 01:55:37 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4789dabe-78a3-4fdc-9327-35ac6be3581a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[730e46bf-ac6f-49e8-aead-933d75cd0fb4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)
Nov 29 01:55:37 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e285d0-7853-4aad-a617-e734dd3ea537]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyxpWVno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:55:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-858216b1-132f-45a6-9fe1-9b8504ae38b1 req-340d48ce-a7f8-4d14-9ec2-9b8f24f137fd service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-858216b1-132f-45a6-9fe1-9b8504ae38b1 req-340d48ce-a7f8-4d14-9ec2-9b8f24f137fd service nova] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-858216b1-132f-45a6-9fe1-9b8504ae38b1 req-340d48ce-a7f8-4d14-9ec2-9b8f24f137fd service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-858216b1-132f-45a6-9fe1-9b8504ae38b1 req-340d48ce-a7f8-4d14-9ec2-9b8f24f137fd service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-858216b1-132f-45a6-9fe1-9b8504ae38b1 req-340d48ce-a7f8-4d14-9ec2-9b8f24f137fd service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] No waiting events found dispatching network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:55:38 user nova-compute[75210]: WARNING nova.compute.manager [req-858216b1-132f-45a6-9fe1-9b8504ae38b1 req-340d48ce-a7f8-4d14-9ec2-9b8f24f137fd service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received unexpected event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 for instance with vm_state active and task_state resize_finish.
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23366396632313938', 'path': '/dev/sdd'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366396632313938', 'path': '/dev/sdd'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1184227882',display_name='tempest-TestVolumeBootPattern-server-1184227882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1184227882',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-n4dm6w0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:55:24Z,user_data=None,user_id='080bcd228b454b03995b0f3e116df917',uuid=0280bdf1-f006-4252-be61-3fb3452707b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "address": "fa:16:3e:65:ed:d4", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f707398-e6", "ovs_interfaceid": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "address": "fa:16:3e:65:ed:d4", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f707398-e6", "ovs_interfaceid": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=9f707398-e63a-4a23-8ac0-6836c31a80b8,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f707398-e6') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.objects.instance [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lazy-loading 'pci_devices' on Instance uuid 0280bdf1-f006-4252-be61-3fb3452707b4 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:55:38 user nova-compute[75210]:   <uuid>0280bdf1-f006-4252-be61-3fb3452707b4</uuid>
Nov 29 01:55:38 user nova-compute[75210]:   <name>instance-00000025</name>
Nov 29 01:55:38 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:55:38 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:55:38 user nova-compute[75210]:   <metadata>
Nov 29 01:55:38 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:55:38 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:55:38 user nova-compute[75210]:       <nova:name>tempest-TestVolumeBootPattern-server-1184227882</nova:name>
Nov 29 01:55:38 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:55:37</nova:creationTime>
Nov 29 01:55:38 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:55:38 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:55:38 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:55:38 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:55:38 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:55:38 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:55:38 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:55:38 user nova-compute[75210]:       <nova:owner>
Nov 29 01:55:38 user nova-compute[75210]:         <nova:user uuid="080bcd228b454b03995b0f3e116df917">tempest-TestVolumeBootPattern-670838009-project-member</nova:user>
Nov 29 01:55:38 user nova-compute[75210]:         <nova:project uuid="f70d8cbb4232433cbd0db9e9448d897f">tempest-TestVolumeBootPattern-670838009</nova:project>
Nov 29 01:55:38 user nova-compute[75210]:       </nova:owner>
Nov 29 01:55:38 user nova-compute[75210]:       <nova:ports>
Nov 29 01:55:38 user nova-compute[75210]:         <nova:port uuid="9f707398-e63a-4a23-8ac0-6836c31a80b8">
Nov 29 01:55:38 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 01:55:38 user nova-compute[75210]:         </nova:port>
Nov 29 01:55:38 user nova-compute[75210]:       </nova:ports>
Nov 29 01:55:38 user nova-compute[75210]:     </nova:instance>
Nov 29 01:55:38 user nova-compute[75210]:   </metadata>
Nov 29 01:55:38 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:55:38 user nova-compute[75210]:     <system>
Nov 29 01:55:38 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:55:38 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:55:38 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:55:38 user nova-compute[75210]:       <entry name="serial">0280bdf1-f006-4252-be61-3fb3452707b4</entry>
Nov 29 01:55:38 user nova-compute[75210]:       <entry name="uuid">0280bdf1-f006-4252-be61-3fb3452707b4</entry>
Nov 29 01:55:38 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:55:38 user nova-compute[75210]:     </system>
Nov 29 01:55:38 user nova-compute[75210]:   </sysinfo>
Nov 29 01:55:38 user nova-compute[75210]:   <os>
Nov 29 01:55:38 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:55:38 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:55:38 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:55:38 user nova-compute[75210]:   </os>
Nov 29 01:55:38 user nova-compute[75210]:   <features>
Nov 29 01:55:38 user nova-compute[75210]:     <acpi/>
Nov 29 01:55:38 user nova-compute[75210]:     <apic/>
Nov 29 01:55:38 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:55:38 user nova-compute[75210]:   </features>
Nov 29 01:55:38 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:55:38 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:55:38 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:55:38 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:55:38 user nova-compute[75210]:   </clock>
Nov 29 01:55:38 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:55:38 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:55:38 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:55:38 user nova-compute[75210]:   </cpu>
Nov 29 01:55:38 user nova-compute[75210]:   <devices>
Nov 29 01:55:38 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:55:38 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:55:38 user nova-compute[75210]:       <source dev="/dev/sdd"/>
Nov 29 01:55:38 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:55:38 user nova-compute[75210]:       <serial>9bbf5212-5bb0-4d7d-bca3-9c301f04ec32</serial>
Nov 29 01:55:38 user nova-compute[75210]:     </disk>
Nov 29 01:55:38 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:55:38 user nova-compute[75210]:       <mac address="fa:16:3e:65:ed:d4"/>
Nov 29 01:55:38 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:55:38 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:55:38 user nova-compute[75210]:       <target dev="tap9f707398-e6"/>
Nov 29 01:55:38 user nova-compute[75210]:     </interface>
Nov 29 01:55:38 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:55:38 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/0280bdf1-f006-4252-be61-3fb3452707b4/console.log" append="off"/>
Nov 29 01:55:38 user nova-compute[75210]:     </serial>
Nov 29 01:55:38 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:55:38 user nova-compute[75210]:     <video>
Nov 29 01:55:38 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:55:38 user nova-compute[75210]:     </video>
Nov 29 01:55:38 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:55:38 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:55:38 user nova-compute[75210]:     </rng>
Nov 29 01:55:38 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:55:38 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:55:38 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:55:38 user nova-compute[75210]:     </memballoon>
Nov 29 01:55:38 user nova-compute[75210]:   </devices>
Nov 29 01:55:38 user nova-compute[75210]: </domain>
Nov 29 01:55:38 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1184227882',display_name='tempest-TestVolumeBootPattern-server-1184227882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1184227882',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-n4dm6w0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:55:24Z,user_data=None,user_id='080bcd228b454b03995b0f3e116df917',uuid=0280bdf1-f006-4252-be61-3fb3452707b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "address": "fa:16:3e:65:ed:d4", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f707398-e6", "ovs_interfaceid": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "address": "fa:16:3e:65:ed:d4", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f707398-e6", "ovs_interfaceid": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=9f707398-e63a-4a23-8ac0-6836c31a80b8,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f707398-e6') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG os_vif [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=9f707398-e63a-4a23-8ac0-6836c31a80b8,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f707398-e6') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e408b72-5521-5e8d-8714-efd27b0a70c2', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f707398-e6, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f707398-e6, col_values=(('qos', UUID('8e49f9e6-fe17-424a-88c1-92127f246378')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f707398-e6, col_values=(('external_ids', {'iface-id': '9f707398-e63a-4a23-8ac0-6836c31a80b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:ed:d4', 'vm-uuid': '0280bdf1-f006-4252-be61-3fb3452707b4'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:38 user nova-compute[75210]: INFO os_vif [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=9f707398-e63a-4a23-8ac0-6836c31a80b8,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f707398-e6')
Nov 29 01:55:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:55:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] No VIF found with MAC fa:16:3e:65:ed:d4, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:55:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:39 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:55:39 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:55:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:40 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Instance running successfully.
Nov 29 01:55:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Failed to set time: agent not configured {{(pid=75210) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1056dd4b-756d-4c85-bfab-85318cfd6fc1 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] finish_migration finished successfully. {{(pid=75210) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-33496aac-b258-4e88-8c38-a12a7a866689 req-88bd1ac5-4bf7-4507-81fb-fffa02989306 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-33496aac-b258-4e88-8c38-a12a7a866689 req-88bd1ac5-4bf7-4507-81fb-fffa02989306 service nova] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-33496aac-b258-4e88-8c38-a12a7a866689 req-88bd1ac5-4bf7-4507-81fb-fffa02989306 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-33496aac-b258-4e88-8c38-a12a7a866689 req-88bd1ac5-4bf7-4507-81fb-fffa02989306 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-33496aac-b258-4e88-8c38-a12a7a866689 req-88bd1ac5-4bf7-4507-81fb-fffa02989306 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] No waiting events found dispatching network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:55:40 user nova-compute[75210]: WARNING nova.compute.manager [req-33496aac-b258-4e88-8c38-a12a7a866689 req-88bd1ac5-4bf7-4507-81fb-fffa02989306 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received unexpected event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 for instance with vm_state active and task_state resize_finish.
Nov 29 01:55:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:55:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.manager [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-c833cee3-77ca-4329-a54d-053b61e3a10c req-6f94809a-1c91-4492-b10b-cc988894298c service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Received event network-vif-plugged-9f707398-e63a-4a23-8ac0-6836c31a80b8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c833cee3-77ca-4329-a54d-053b61e3a10c req-6f94809a-1c91-4492-b10b-cc988894298c service nova] Acquiring lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c833cee3-77ca-4329-a54d-053b61e3a10c req-6f94809a-1c91-4492-b10b-cc988894298c service nova] Lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c833cee3-77ca-4329-a54d-053b61e3a10c req-6f94809a-1c91-4492-b10b-cc988894298c service nova] Lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-c833cee3-77ca-4329-a54d-053b61e3a10c req-6f94809a-1c91-4492-b10b-cc988894298c service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] No waiting events found dispatching network-vif-plugged-9f707398-e63a-4a23-8ac0-6836c31a80b8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:55:42 user nova-compute[75210]: WARNING nova.compute.manager [req-c833cee3-77ca-4329-a54d-053b61e3a10c req-6f94809a-1c91-4492-b10b-cc988894298c service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Received unexpected event network-vif-plugged-9f707398-e63a-4a23-8ac0-6836c31a80b8 for instance with vm_state building and task_state spawning.
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-c833cee3-77ca-4329-a54d-053b61e3a10c req-6f94809a-1c91-4492-b10b-cc988894298c service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Received event network-vif-plugged-9f707398-e63a-4a23-8ac0-6836c31a80b8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c833cee3-77ca-4329-a54d-053b61e3a10c req-6f94809a-1c91-4492-b10b-cc988894298c service nova] Acquiring lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c833cee3-77ca-4329-a54d-053b61e3a10c req-6f94809a-1c91-4492-b10b-cc988894298c service nova] Lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c833cee3-77ca-4329-a54d-053b61e3a10c req-6f94809a-1c91-4492-b10b-cc988894298c service nova] Lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-c833cee3-77ca-4329-a54d-053b61e3a10c req-6f94809a-1c91-4492-b10b-cc988894298c service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] No waiting events found dispatching network-vif-plugged-9f707398-e63a-4a23-8ac0-6836c31a80b8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:55:42 user nova-compute[75210]: WARNING nova.compute.manager [req-c833cee3-77ca-4329-a54d-053b61e3a10c req-6f94809a-1c91-4492-b10b-cc988894298c service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Received unexpected event network-vif-plugged-9f707398-e63a-4a23-8ac0-6836c31a80b8 for instance with vm_state building and task_state spawning.
Nov 29 01:55:42 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:55:42 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7921MB free_disk=24.992984771728516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:55:42 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Instance spawned successfully.
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:55:42 user nova-compute[75210]: INFO nova.compute.manager [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.manager [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Applying migration context for instance 1ea93b31-f7c3-456f-aa99-113160704256 as it has an incoming, in-progress migration 33ce06dc-25d4-4489-9722-7c4f8265d559. Migration status is finished {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 01:55:42 user nova-compute[75210]: INFO nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updating resource usage from migration 33ce06dc-25d4-4489-9722-7c4f8265d559
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3df17188-c87e-49e5-9ca2-5d04632ea9bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c320d76b-58e8-4032-bef3-3aead513231e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 5ea4ce52-dd69-4b51-b066-bec88d069151 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Migration 33ce06dc-25d4-4489-9722-7c4f8265d559 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 0280bdf1-f006-4252-be61-3fb3452707b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 1ea93b31-f7c3-456f-aa99-113160704256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:55:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:55:43 user nova-compute[75210]: INFO nova.compute.manager [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Took 20.00 seconds to build instance.
Nov 29 01:55:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d57d524a-58d6-46d3-85f5-204f6795caff tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "0280bdf1-f006-4252-be61-3fb3452707b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.115s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:43 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:55:43 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:55:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:55:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:55:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:55:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 01:55:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:55:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:55:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:55:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:02 user nova-compute[75210]: INFO nova.compute.manager [None req-d07ff931-c56a-467a-ab23-dd9bf00e99d5 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Unrescuing
Nov 29 01:56:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d07ff931-c56a-467a-ab23-dd9bf00e99d5 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "refresh_cache-5ea4ce52-dd69-4b51-b066-bec88d069151" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:56:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d07ff931-c56a-467a-ab23-dd9bf00e99d5 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquired lock "refresh_cache-5ea4ce52-dd69-4b51-b066-bec88d069151" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:56:02 user nova-compute[75210]: DEBUG nova.network.neutron [None req-d07ff931-c56a-467a-ab23-dd9bf00e99d5 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:56:03 user nova-compute[75210]: DEBUG nova.network.neutron [None req-d07ff931-c56a-467a-ab23-dd9bf00e99d5 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Updating instance_info_cache with network_info: [{"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:56:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d07ff931-c56a-467a-ab23-dd9bf00e99d5 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Releasing lock "refresh_cache-5ea4ce52-dd69-4b51-b066-bec88d069151" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:56:03 user nova-compute[75210]: DEBUG nova.objects.instance [None req-d07ff931-c56a-467a-ab23-dd9bf00e99d5 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'flavor' on Instance uuid 5ea4ce52-dd69-4b51-b066-bec88d069151 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:56:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-690e762e-aaae-4db3-874f-bb7f72fe0795 req-33e9d54a-a5ca-4b27-adce-640aeed2beaa service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-unplugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:56:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-690e762e-aaae-4db3-874f-bb7f72fe0795 req-33e9d54a-a5ca-4b27-adce-640aeed2beaa service nova] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:56:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-690e762e-aaae-4db3-874f-bb7f72fe0795 req-33e9d54a-a5ca-4b27-adce-640aeed2beaa service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:56:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-690e762e-aaae-4db3-874f-bb7f72fe0795 req-33e9d54a-a5ca-4b27-adce-640aeed2beaa service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:56:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-690e762e-aaae-4db3-874f-bb7f72fe0795 req-33e9d54a-a5ca-4b27-adce-640aeed2beaa service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] No waiting events found dispatching network-vif-unplugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:56:03 user nova-compute[75210]: WARNING nova.compute.manager [req-690e762e-aaae-4db3-874f-bb7f72fe0795 req-33e9d54a-a5ca-4b27-adce-640aeed2beaa service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received unexpected event network-vif-unplugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:56:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Instance destroyed successfully.
Nov 29 01:56:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-815e6d21-30e5-498f-9686-a4c877f145bd req-e295cef2-4930-4e9d-87bf-a9cf74915ec1 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:56:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-815e6d21-30e5-498f-9686-a4c877f145bd req-e295cef2-4930-4e9d-87bf-a9cf74915ec1 service nova] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:56:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-815e6d21-30e5-498f-9686-a4c877f145bd req-e295cef2-4930-4e9d-87bf-a9cf74915ec1 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:56:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-815e6d21-30e5-498f-9686-a4c877f145bd req-e295cef2-4930-4e9d-87bf-a9cf74915ec1 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:56:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-815e6d21-30e5-498f-9686-a4c877f145bd req-e295cef2-4930-4e9d-87bf-a9cf74915ec1 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] No waiting events found dispatching network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:56:05 user nova-compute[75210]: WARNING nova.compute.manager [req-815e6d21-30e5-498f-9686-a4c877f145bd req-e295cef2-4930-4e9d-87bf-a9cf74915ec1 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received unexpected event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:56:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-815e6d21-30e5-498f-9686-a4c877f145bd req-e295cef2-4930-4e9d-87bf-a9cf74915ec1 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:56:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-815e6d21-30e5-498f-9686-a4c877f145bd req-e295cef2-4930-4e9d-87bf-a9cf74915ec1 service nova] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:56:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-815e6d21-30e5-498f-9686-a4c877f145bd req-e295cef2-4930-4e9d-87bf-a9cf74915ec1 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:56:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-815e6d21-30e5-498f-9686-a4c877f145bd req-e295cef2-4930-4e9d-87bf-a9cf74915ec1 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:56:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-815e6d21-30e5-498f-9686-a4c877f145bd req-e295cef2-4930-4e9d-87bf-a9cf74915ec1 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] No waiting events found dispatching network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:56:05 user nova-compute[75210]: WARNING nova.compute.manager [req-815e6d21-30e5-498f-9686-a4c877f145bd req-e295cef2-4930-4e9d-87bf-a9cf74915ec1 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received unexpected event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea for instance with vm_state rescued and task_state unrescuing.
Nov 29 01:56:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-d07ff931-c56a-467a-ab23-dd9bf00e99d5 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:56:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-55975f23-1f1c-4f5b-ba3c-783a51a6c6a8 req-1b1d6266-1a47-4dbf-9e98-a054f7655d44 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:56:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-55975f23-1f1c-4f5b-ba3c-783a51a6c6a8 req-1b1d6266-1a47-4dbf-9e98-a054f7655d44 service nova] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:56:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-55975f23-1f1c-4f5b-ba3c-783a51a6c6a8 req-1b1d6266-1a47-4dbf-9e98-a054f7655d44 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:56:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-55975f23-1f1c-4f5b-ba3c-783a51a6c6a8 req-1b1d6266-1a47-4dbf-9e98-a054f7655d44 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:56:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-55975f23-1f1c-4f5b-ba3c-783a51a6c6a8 req-1b1d6266-1a47-4dbf-9e98-a054f7655d44 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] No waiting events found dispatching network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:56:07 user nova-compute[75210]: WARNING nova.compute.manager [req-55975f23-1f1c-4f5b-ba3c-783a51a6c6a8 req-1b1d6266-1a47-4dbf-9e98-a054f7655d44 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received unexpected event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea for instance with vm_state active and task_state None.
Nov 29 01:56:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b2fa8a-38a8-4e6d-bdbb-10dc82b0f7e9 req-2abdff0a-1838-4b71-a5e9-faa4836f6b9c service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-changed-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:56:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-67b2fa8a-38a8-4e6d-bdbb-10dc82b0f7e9 req-2abdff0a-1838-4b71-a5e9-faa4836f6b9c service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Refreshing instance network info cache due to event network-changed-312421b0-0d55-4735-9810-310e70a30881. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:56:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b2fa8a-38a8-4e6d-bdbb-10dc82b0f7e9 req-2abdff0a-1838-4b71-a5e9-faa4836f6b9c service nova] Acquiring lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:56:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b2fa8a-38a8-4e6d-bdbb-10dc82b0f7e9 req-2abdff0a-1838-4b71-a5e9-faa4836f6b9c service nova] Acquired lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:56:21 user nova-compute[75210]: DEBUG nova.network.neutron [req-67b2fa8a-38a8-4e6d-bdbb-10dc82b0f7e9 req-2abdff0a-1838-4b71-a5e9-faa4836f6b9c service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Refreshing network info cache for port 312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:56:21 user nova-compute[75210]: DEBUG nova.network.neutron [req-67b2fa8a-38a8-4e6d-bdbb-10dc82b0f7e9 req-2abdff0a-1838-4b71-a5e9-faa4836f6b9c service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Updated VIF entry in instance network info cache for port 312421b0-0d55-4735-9810-310e70a30881. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:56:21 user nova-compute[75210]: DEBUG nova.network.neutron [req-67b2fa8a-38a8-4e6d-bdbb-10dc82b0f7e9 req-2abdff0a-1838-4b71-a5e9-faa4836f6b9c service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Updating instance_info_cache with network_info: [{"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:56:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-67b2fa8a-38a8-4e6d-bdbb-10dc82b0f7e9 req-2abdff0a-1838-4b71-a5e9-faa4836f6b9c service nova] Releasing lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:56:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:56:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "c320d76b-58e8-4032-bef3-3aead513231e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:56:21 user nova-compute[75210]: INFO nova.compute.manager [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Detaching volume 77e6b650-cec4-4c0e-9f51-b8c3f22c1823
Nov 29 01:56:21 user nova-compute[75210]: INFO nova.virt.block_device [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Attempting to driver detach volume 77e6b650-cec4-4c0e-9f51-b8c3f22c1823 from mountpoint /dev/vdb
Nov 29 01:56:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Attempting to detach device vdb from instance c320d76b-58e8-4032-bef3-3aead513231e from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 01:56:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:56:21 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:56:21 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 01:56:21 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:56:21 user nova-compute[75210]:   <serial>77e6b650-cec4-4c0e-9f51-b8c3f22c1823</serial>
Nov 29 01:56:21 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:56:21 user nova-compute[75210]: </disk>
Nov 29 01:56:21 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:56:21 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Successfully detached device vdb from instance c320d76b-58e8-4032-bef3-3aead513231e from the persistent domain config.
Nov 29 01:56:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c320d76b-58e8-4032-bef3-3aead513231e from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 01:56:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 01:56:21 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:56:21 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 01:56:21 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:56:21 user nova-compute[75210]:   <serial>77e6b650-cec4-4c0e-9f51-b8c3f22c1823</serial>
Nov 29 01:56:21 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 01:56:21 user nova-compute[75210]: </disk>
Nov 29 01:56:21 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 01:56:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 01:56:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-43fa772c-38d4-4b0a-8212-296c705bc0f3 req-30da9c4d-edc6-4620-83fa-11862b44e95c service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-changed-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:56:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-43fa772c-38d4-4b0a-8212-296c705bc0f3 req-30da9c4d-edc6-4620-83fa-11862b44e95c service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Refreshing instance network info cache due to event network-changed-312421b0-0d55-4735-9810-310e70a30881. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:56:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-43fa772c-38d4-4b0a-8212-296c705bc0f3 req-30da9c4d-edc6-4620-83fa-11862b44e95c service nova] Acquiring lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:56:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-43fa772c-38d4-4b0a-8212-296c705bc0f3 req-30da9c4d-edc6-4620-83fa-11862b44e95c service nova] Acquired lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:56:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-43fa772c-38d4-4b0a-8212-296c705bc0f3 req-30da9c4d-edc6-4620-83fa-11862b44e95c service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Refreshing network info cache for port 312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:56:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-43fa772c-38d4-4b0a-8212-296c705bc0f3 req-30da9c4d-edc6-4620-83fa-11862b44e95c service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Updated VIF entry in instance network info cache for port 312421b0-0d55-4735-9810-310e70a30881. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:56:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-43fa772c-38d4-4b0a-8212-296c705bc0f3 req-30da9c4d-edc6-4620-83fa-11862b44e95c service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Updating instance_info_cache with network_info: [{"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:56:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-43fa772c-38d4-4b0a-8212-296c705bc0f3 req-30da9c4d-edc6-4620-83fa-11862b44e95c service nova] Releasing lock "refresh_cache-c320d76b-58e8-4032-bef3-3aead513231e" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:56:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:34 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:56:34 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:56:34 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:56:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:56:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:56:34 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:56:34 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updating instance_info_cache with network_info: [{"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:56:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:56:35 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:56:35 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:56:35 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:56:35 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:56:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:56:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:56:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:56:37 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:56:38 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:56:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:39 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:56:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:56:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:56:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:56:39 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:56:39 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:56:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:39 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:40 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c320d76b-58e8-4032-bef3-3aead513231e is timed out.
Nov 29 01:56:42 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Successfully detached device vdb from instance c320d76b-58e8-4032-bef3-3aead513231e from the live domain config.
Nov 29 01:56:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKvplVYM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:56:42 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec624a8-2772-422a-8974-5a8b54e86417]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:56:42 user nova-compute[75210]: No targets found.
Nov 29 01:56:42 user nova-compute[75210]: iSNS:
Nov 29 01:56:42 user nova-compute[75210]: No targets found.
Nov 29 01:56:42 user nova-compute[75210]: STATIC:
Nov 29 01:56:42 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32
Nov 29 01:56:42 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:56:42 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:56:42 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc
Nov 29 01:56:42 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:56:42 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:56:42 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256
Nov 29 01:56:42 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:56:42 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:56:42 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:56:42 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:56:42 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:56:42 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823
Nov 29 01:56:42 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:56:42 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:56:42 user nova-compute[75210]: FIRMWARE:
Nov 29 01:56:42 user nova-compute[75210]: No targets found.
Nov 29 01:56:42 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:56:42 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:56:42 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4f2c51-795a-433d-8a18-ece5a62a621c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[01190e08-f2d3-48cd-afed-3fc502715a1d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:56:42 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:56:42 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:56:42 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:56:42 user nova-compute[75210]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)
Nov 29 01:56:42 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:56:42 user nova-compute[75210]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 (non-flash)
Nov 29 01:56:42 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:56:42 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:56:42 user nova-compute[75210]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)
Nov 29 01:56:42 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e8708670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823'): ({'sde'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Removing single pathed devices sde {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f010d7ef-88fa-4fad-aac1-10217175ecd0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edaa59f-acc4-4fab-9f51-409e29ae535f]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Flushing IO for device /dev/sde {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20fc25e-5df5-4443-8de3-1a98dafd499d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf758e1d-ee8f-41d8-a464-a8287b51e662]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd33058-16da-4679-a7f9-e80f1cb3084c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[20458a96-35ba-4d53-8667-7a815ccc408b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823, portal: 172.16.0.220,3260]
Nov 29 01:56:42 user nova-compute[75210]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823, portal: 172.16.0.220,3260] successful.
Nov 29 01:56:42 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77e6b650-cec4-4c0e-9f51-b8c3f22c1823 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24225fc-4930-4d10-bd72-0d6d5de0f319]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] <== disconnect_volume: return (309ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:56:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:43 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:56:43 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=7674MB free_disk=24.9915771484375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Applying migration context for instance 1ea93b31-f7c3-456f-aa99-113160704256 as it has an incoming, in-progress migration 33ce06dc-25d4-4489-9722-7c4f8265d559. Migration status is finished {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 29 01:56:43 user nova-compute[75210]: INFO nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updating resource usage from migration 33ce06dc-25d4-4489-9722-7c4f8265d559
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3df17188-c87e-49e5-9ca2-5d04632ea9bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c320d76b-58e8-4032-bef3-3aead513231e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 5ea4ce52-dd69-4b51-b066-bec88d069151 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Migration 33ce06dc-25d4-4489-9722-7c4f8265d559 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 0280bdf1-f006-4252-be61-3fb3452707b4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 1ea93b31-f7c3-456f-aa99-113160704256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.objects.instance [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'flavor' on Instance uuid c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-fefc2c06-eb44-4142-9a2e-68ddb22a0481 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "c320d76b-58e8-4032-bef3-3aead513231e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.779s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:56:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:56:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 01:56:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:56:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:56:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-535b55e3-87b1-408e-94e4-c3326136dd3b req-bbafb3c0-562c-464f-891a-1cf8ca94a6ea service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-changed-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:56:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-535b55e3-87b1-408e-94e4-c3326136dd3b req-bbafb3c0-562c-464f-891a-1cf8ca94a6ea service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Refreshing instance network info cache due to event network-changed-c2989e5b-8405-458d-8862-86a28f95bb38. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:56:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-535b55e3-87b1-408e-94e4-c3326136dd3b req-bbafb3c0-562c-464f-891a-1cf8ca94a6ea service nova] Acquiring lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:56:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-535b55e3-87b1-408e-94e4-c3326136dd3b req-bbafb3c0-562c-464f-891a-1cf8ca94a6ea service nova] Acquired lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:56:49 user nova-compute[75210]: DEBUG nova.network.neutron [req-535b55e3-87b1-408e-94e4-c3326136dd3b req-bbafb3c0-562c-464f-891a-1cf8ca94a6ea service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Refreshing network info cache for port c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:56:50 user nova-compute[75210]: DEBUG nova.network.neutron [req-535b55e3-87b1-408e-94e4-c3326136dd3b req-bbafb3c0-562c-464f-891a-1cf8ca94a6ea service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updated VIF entry in instance network info cache for port c2989e5b-8405-458d-8862-86a28f95bb38. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:56:50 user nova-compute[75210]: DEBUG nova.network.neutron [req-535b55e3-87b1-408e-94e4-c3326136dd3b req-bbafb3c0-562c-464f-891a-1cf8ca94a6ea service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updating instance_info_cache with network_info: [{"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:56:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-535b55e3-87b1-408e-94e4-c3326136dd3b req-bbafb3c0-562c-464f-891a-1cf8ca94a6ea service nova] Releasing lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:56:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG nova.objects.instance [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'flavor' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:56:52 user nova-compute[75210]: INFO nova.compute.manager [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Attaching volume 031d4ab6-fdf7-4f6f-84ce-425506889b31 to /dev/vdb
Nov 29 01:56:52 user nova-compute[75210]: DEBUG os_brick.utils [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[561af002-70b6-4126-9c46-f0e1e1d80594]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9870517e-2ba2-4a5a-bbdd-f861cfdf74df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0539ee80-597e-409e-bb01-4de45df09b43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a665e2-7201-48f6-b3b9-a88d9679fc35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:56:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:56:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:56:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:56:53 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:56:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[721f2ad7-63d6-466b-9bd3-8a563be4abb1]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:56:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:56:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:56:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:56:53 user nova-compute[75210]: DEBUG os_brick.utils [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:56:53 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updating existing volume attachment record: 6e889c0b-8f38-4c5f-8a98-36505b6def17 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:56:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:56:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwekncqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:57:00 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:57:00 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:57:00 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bbb1e7-cf52-4d42-9100-6b2aa2126f3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:57:00 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c44ae82-49ed-4748-8d7d-8d1a616f9d40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31] added
Nov 29 01:57:00 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7482a8a-072a-49c5-8586-a4e87487f030]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a25b48f-8aa1-4c8c-a87a-fab5f3b81384]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OwekncqF {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OwekncqF" returned: 0 in 0.047s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1619938-1f8b-4182-812b-f82eacc78406]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OwekncqF'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a44519-095c-4cdb-9373-34f8c4289075]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cd6404-fdb6-4fb5-984b-e751f32c16a4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a9bada-a344-4fb5-a416-00c795f503b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260]
Nov 29 01:57:00 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260] successful.
Nov 29 01:57:00 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5648c27b-5521-436d-9927-e92f3bc18d91]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a038e26-539c-4376-bcea-a85c070a6838]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:57:00 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e5ca14-9f4a-4f9c-a92b-1ffdc0a68071]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:00 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:57:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:01 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:57:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwekncqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:57:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:57:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23336653866356631', 'path': '/dev/sde'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:57:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336653866356631', 'path': '/dev/sde'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:57:01 user nova-compute[75210]: DEBUG nova.objects.instance [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'flavor' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:57:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 01:57:01 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:57:01 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 01:57:01 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 01:57:01 user nova-compute[75210]:   <serial>031d4ab6-fdf7-4f6f-84ce-425506889b31</serial>
Nov 29 01:57:01 user nova-compute[75210]: </disk>
Nov 29 01:57:01 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 01:57:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:57:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:57:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No VIF found with MAC fa:16:3e:7b:b4:90, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:57:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-de9f4fc8-3883-4481-8584-fec91956c091 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.225s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-419c9377-db15-43d0-bfd7-510d7bc0edbc tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-419c9377-db15-43d0-bfd7-510d7bc0edbc tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-419c9377-db15-43d0-bfd7-510d7bc0edbc tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:57:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-419c9377-db15-43d0-bfd7-510d7bc0edbc tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75210) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 01:57:02 user nova-compute[75210]: DEBUG nova.objects.instance [None req-419c9377-db15-43d0-bfd7-510d7bc0edbc tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'flavor' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:57:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-c00b44c2-0313-4652-a824-6b2c61fb6658 req-651b3f81-32f2-4f51-9772-e7f5c1d56074 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-unplugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c00b44c2-0313-4652-a824-6b2c61fb6658 req-651b3f81-32f2-4f51-9772-e7f5c1d56074 service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c00b44c2-0313-4652-a824-6b2c61fb6658 req-651b3f81-32f2-4f51-9772-e7f5c1d56074 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c00b44c2-0313-4652-a824-6b2c61fb6658 req-651b3f81-32f2-4f51-9772-e7f5c1d56074 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-c00b44c2-0313-4652-a824-6b2c61fb6658 req-651b3f81-32f2-4f51-9772-e7f5c1d56074 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-unplugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:57:03 user nova-compute[75210]: WARNING nova.compute.manager [req-c00b44c2-0313-4652-a824-6b2c61fb6658 req-651b3f81-32f2-4f51-9772-e7f5c1d56074 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-unplugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state active and task_state powering-off.
Nov 29 01:57:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Instance destroyed successfully.
Nov 29 01:57:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-419c9377-db15-43d0-bfd7-510d7bc0edbc tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:57:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-419c9377-db15-43d0-bfd7-510d7bc0edbc tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.910s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:57:05 user nova-compute[75210]: WARNING nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state stopped and task_state None.
Nov 29 01:57:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:57:05 user nova-compute[75210]: WARNING nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state stopped and task_state None.
Nov 29 01:57:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:57:05 user nova-compute[75210]: WARNING nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state stopped and task_state None.
Nov 29 01:57:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-unplugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-unplugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:57:05 user nova-compute[75210]: WARNING nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-unplugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state stopped and task_state None.
Nov 29 01:57:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:57:05 user nova-compute[75210]: WARNING nova.compute.manager [req-61955644-edb0-461a-a5c1-a043d9a653c9 req-8ba337b8-fef3-4077-8442-f66391a81d68 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state stopped and task_state None.
Nov 29 01:57:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "c320d76b-58e8-4032-bef3-3aead513231e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:12 user nova-compute[75210]: INFO nova.compute.manager [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Terminating instance
Nov 29 01:57:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-f4299274-98e2-4812-baff-f0781551dfc6 req-c6a9d7bd-2a38-46c9-a393-53f491ba1dde service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-unplugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f4299274-98e2-4812-baff-f0781551dfc6 req-c6a9d7bd-2a38-46c9-a393-53f491ba1dde service nova] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f4299274-98e2-4812-baff-f0781551dfc6 req-c6a9d7bd-2a38-46c9-a393-53f491ba1dde service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f4299274-98e2-4812-baff-f0781551dfc6 req-c6a9d7bd-2a38-46c9-a393-53f491ba1dde service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-f4299274-98e2-4812-baff-f0781551dfc6 req-c6a9d7bd-2a38-46c9-a393-53f491ba1dde service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] No waiting events found dispatching network-vif-unplugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-f4299274-98e2-4812-baff-f0781551dfc6 req-c6a9d7bd-2a38-46c9-a393-53f491ba1dde service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-unplugged-312421b0-0d55-4735-9810-310e70a30881 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "1ea93b31-f7c3-456f-aa99-113160704256" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Going to confirm migration 2 {{(pid=75210) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 29 01:57:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Instance destroyed successfully.
Nov 29 01:57:12 user nova-compute[75210]: DEBUG nova.objects.instance [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'resources' on Instance uuid c320d76b-58e8-4032-bef3-3aead513231e {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:50:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-849162623',display_name='tempest-ServerRescueNegativeTestJSON-server-849162623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-849162623',id=33,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJg8slG8367U75ZSuTZzcgZW/XtJwbbU3K3GG0kWtPdNOpehMl9ysb0/U5N2JjcTlVneKBPkybYoSEOg0i9hlNe1spmrLC+aGK+IZC9PmV/YWkG+JGEWRilkYLgKZ0O2A==',key_name='tempest-keypair-780592974',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:52:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ea74c32e3354c9bb76465b39f437026',ramdisk_id='',reservation_id='r-pvgqd49k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-948038897',owner_user_name='tempest-ServerRescueNegativeTestJSON-948038897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:54:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='339a0127c78144a989498320081f2c15',uuid=c320d76b-58e8-4032-bef3-3aead513231e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converting VIF {"id": "312421b0-0d55-4735-9810-310e70a30881", "address": "fa:16:3e:f3:49:51", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312421b0-0d", "ovs_interfaceid": "312421b0-0d55-4735-9810-310e70a30881", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:49:51,bridge_name='br-int',has_traffic_filtering=True,id=312421b0-0d55-4735-9810-310e70a30881,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312421b0-0d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG os_vif [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:49:51,bridge_name='br-int',has_traffic_filtering=True,id=312421b0-0d55-4735-9810-310e70a30881,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312421b0-0d') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap312421b0-0d, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=507b9707-f7ce-47b4-8f1d-e578e84458d5) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:12 user nova-compute[75210]: INFO os_vif [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:49:51,bridge_name='br-int',has_traffic_filtering=True,id=312421b0-0d55-4735-9810-310e70a30881,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312421b0-0d')
Nov 29 01:57:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Deleting instance files /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e_del
Nov 29 01:57:12 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Deletion of /opt/stack/data/nova/instances/c320d76b-58e8-4032-bef3-3aead513231e_del complete
Nov 29 01:57:12 user nova-compute[75210]: INFO nova.compute.manager [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 29 01:57:12 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:57:12 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: c320d76b-58e8-4032-bef3-3aead513231e] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:57:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:57:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquired lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:57:13 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:57:13 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lazy-loading 'info_cache' on Instance uuid 1ea93b31-f7c3-456f-aa99-113160704256 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:57:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "0280bdf1-f006-4252-be61-3fb3452707b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "0280bdf1-f006-4252-be61-3fb3452707b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:13 user nova-compute[75210]: INFO nova.compute.manager [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Terminating instance
Nov 29 01:57:13 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updating instance_info_cache with network_info: [{"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Releasing lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lazy-loading 'migration_context' on Instance uuid 1ea93b31-f7c3-456f-aa99-113160704256 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.objects.base [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Object Instance<1ea93b31-f7c3-456f-aa99-113160704256> lazy-loaded attributes: info_cache,migration_context {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:57:14 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Took 1.21 seconds to deallocate network for instance.
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-bfcc6dd3-cbc9-4370-8158-743ed7681b84 req-1a8e111e-d572-4467-9405-de6908487c5f service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-deleted-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-01cc4334-dfd5-4ecc-a46f-0325c06dd2ae req-b3e56f0f-c8a9-4651-8f20-58c22136caab service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Received event network-vif-unplugged-9f707398-e63a-4a23-8ac0-6836c31a80b8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-01cc4334-dfd5-4ecc-a46f-0325c06dd2ae req-b3e56f0f-c8a9-4651-8f20-58c22136caab service nova] Acquiring lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-01cc4334-dfd5-4ecc-a46f-0325c06dd2ae req-b3e56f0f-c8a9-4651-8f20-58c22136caab service nova] Lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-01cc4334-dfd5-4ecc-a46f-0325c06dd2ae req-b3e56f0f-c8a9-4651-8f20-58c22136caab service nova] Lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-01cc4334-dfd5-4ecc-a46f-0325c06dd2ae req-b3e56f0f-c8a9-4651-8f20-58c22136caab service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] No waiting events found dispatching network-vif-unplugged-9f707398-e63a-4a23-8ac0-6836c31a80b8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-01cc4334-dfd5-4ecc-a46f-0325c06dd2ae req-b3e56f0f-c8a9-4651-8f20-58c22136caab service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Received event network-vif-unplugged-9f707398-e63a-4a23-8ac0-6836c31a80b8 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-b651c875-80ee-4dfc-bab2-77630993e633 req-a2eee34c-32db-41c7-97e7-4ef7079ef8fb service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b651c875-80ee-4dfc-bab2-77630993e633 req-a2eee34c-32db-41c7-97e7-4ef7079ef8fb service nova] Acquiring lock "c320d76b-58e8-4032-bef3-3aead513231e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b651c875-80ee-4dfc-bab2-77630993e633 req-a2eee34c-32db-41c7-97e7-4ef7079ef8fb service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b651c875-80ee-4dfc-bab2-77630993e633 req-a2eee34c-32db-41c7-97e7-4ef7079ef8fb service nova] Lock "c320d76b-58e8-4032-bef3-3aead513231e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-b651c875-80ee-4dfc-bab2-77630993e633 req-a2eee34c-32db-41c7-97e7-4ef7079ef8fb service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] No waiting events found dispatching network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:57:14 user nova-compute[75210]: WARNING nova.compute.manager [req-b651c875-80ee-4dfc-bab2-77630993e633 req-a2eee34c-32db-41c7-97e7-4ef7079ef8fb service nova] [instance: c320d76b-58e8-4032-bef3-3aead513231e] Received unexpected event network-vif-plugged-312421b0-0d55-4735-9810-310e70a30881 for instance with vm_state deleted and task_state None.
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.456s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.242s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:14 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Deleted allocation for migration 33ce06dc-25d4-4489-9722-7c4f8265d559
Nov 29 01:57:14 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Instance destroyed successfully.
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lazy-loading 'resources' on Instance uuid 0280bdf1-f006-4252-be61-3fb3452707b4 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:55:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1184227882',display_name='tempest-TestVolumeBootPattern-server-1184227882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1184227882',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:55:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-n4dm6w0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:55:43Z,user_data=None,user_id='080bcd228b454b03995b0f3e116df917',uuid=0280bdf1-f006-4252-be61-3fb3452707b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "address": "fa:16:3e:65:ed:d4", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f707398-e6", "ovs_interfaceid": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "address": "fa:16:3e:65:ed:d4", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f707398-e6", "ovs_interfaceid": "9f707398-e63a-4a23-8ac0-6836c31a80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=9f707398-e63a-4a23-8ac0-6836c31a80b8,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f707398-e6') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_vif [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=9f707398-e63a-4a23-8ac0-6836c31a80b8,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f707398-e6') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f707398-e6, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c48925c3-7ac6-47c6-83c1-4ce6e0249825 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "1ea93b31-f7c3-456f-aa99-113160704256" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.107s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e49f9e6-fe17-424a-88c1-92127f246378) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:14 user nova-compute[75210]: INFO os_vif [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=9f707398-e63a-4a23-8ac0-6836c31a80b8,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f707398-e6')
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyxpWVno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:57:14 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f074fd-9658-4ece-8f2f-570e4833eff5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:57:14 user nova-compute[75210]: No targets found.
Nov 29 01:57:14 user nova-compute[75210]: iSNS:
Nov 29 01:57:14 user nova-compute[75210]: No targets found.
Nov 29 01:57:14 user nova-compute[75210]: STATIC:
Nov 29 01:57:14 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32
Nov 29 01:57:14 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:57:14 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:57:14 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc
Nov 29 01:57:14 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:57:14 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:57:14 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31
Nov 29 01:57:14 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:57:14 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:57:14 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256
Nov 29 01:57:14 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:57:14 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:57:14 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:57:14 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:57:14 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:57:14 user nova-compute[75210]: FIRMWARE:
Nov 29 01:57:14 user nova-compute[75210]: No targets found.
Nov 29 01:57:14 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:57:14 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:57:14 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b662c73-aa49-4dff-acde-5033ae8ba063]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[74497059-1f7a-4c78-975a-3f68c7c45c65]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:57:14 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:57:14 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:57:14 user nova-compute[75210]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)
Nov 29 01:57:14 user nova-compute[75210]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:57:14 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:57:14 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:57:14 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:57:14 user nova-compute[75210]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 (non-flash)
Nov 29 01:57:14 user nova-compute[75210]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:57:14 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e865d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32'): ({'sdd'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Removing single pathed devices sdd {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[236d8857-d55a-410b-a1dd-181d0ed36466]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d82f8a-0ad8-4a9b-9416-4816d3d1fc61]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flushing IO for device /dev/sdd {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f677360-05ba-40fd-97b2-2129990e334a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[36719268-c52d-438f-b980-1d020031c507]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:14 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Deleted allocations for instance c320d76b-58e8-4032-bef3-3aead513231e
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a69f0b36', '/dev/disk/by-id/scsi-23366396632313938', '/dev/disk/by-id/scsi-1SCST_BIOa69f0b36-3f9f21980c3abf88') {{(pid=85542) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 01:57:14 user nova-compute[75210]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_a69f0b36
Nov 29 01:57:14 user nova-compute[75210]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23366396632313938
Nov 29 01:57:14 user nova-compute[75210]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOa69f0b36-3f9f21980c3abf88
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[943427e8-0f17-4d73-8b5e-3921f22cd9ea]: (4, None) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:57:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53705a9-649f-44cd-840d-608826a5a8e3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-21fb3e62-b5ea-4fc5-86ba-f967ce9e4266 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "c320d76b-58e8-4032-bef3-3aead513231e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.943s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc7edf5-3c3d-4a9d-a53b-159def19c865]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32, portal: 172.16.0.220,3260]
Nov 29 01:57:15 user nova-compute[75210]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32, portal: 172.16.0.220,3260] successful.
Nov 29 01:57:15 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[029864d4-d5a2-4220-a693-f80352d3ff29]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== disconnect_volume: return (333ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:57:15 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Deleting instance files /opt/stack/data/nova/instances/0280bdf1-f006-4252-be61-3fb3452707b4_del
Nov 29 01:57:15 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Deletion of /opt/stack/data/nova/instances/0280bdf1-f006-4252-be61-3fb3452707b4_del complete
Nov 29 01:57:15 user nova-compute[75210]: INFO nova.compute.manager [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 29 01:57:15 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:57:15 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:57:15 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Took 0.52 seconds to deallocate network for instance.
Nov 29 01:57:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-63f5edfc-1e3b-4f19-80de-84496c097376 req-a995420d-e846-4899-b0ec-4d1475b61d17 service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Received event network-vif-deleted-9f707398-e63a-4a23-8ac0-6836c31a80b8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-a96b4921-d54c-47aa-aa8b-0c062ffa2054 req-637efa8e-2e0e-47a0-bacd-746e7ea06cc2 service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Received event network-vif-plugged-9f707398-e63a-4a23-8ac0-6836c31a80b8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a96b4921-d54c-47aa-aa8b-0c062ffa2054 req-637efa8e-2e0e-47a0-bacd-746e7ea06cc2 service nova] Acquiring lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a96b4921-d54c-47aa-aa8b-0c062ffa2054 req-637efa8e-2e0e-47a0-bacd-746e7ea06cc2 service nova] Lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a96b4921-d54c-47aa-aa8b-0c062ffa2054 req-637efa8e-2e0e-47a0-bacd-746e7ea06cc2 service nova] Lock "0280bdf1-f006-4252-be61-3fb3452707b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-a96b4921-d54c-47aa-aa8b-0c062ffa2054 req-637efa8e-2e0e-47a0-bacd-746e7ea06cc2 service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] No waiting events found dispatching network-vif-plugged-9f707398-e63a-4a23-8ac0-6836c31a80b8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:57:16 user nova-compute[75210]: WARNING nova.compute.manager [req-a96b4921-d54c-47aa-aa8b-0c062ffa2054 req-637efa8e-2e0e-47a0-bacd-746e7ea06cc2 service nova] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Received unexpected event network-vif-plugged-9f707398-e63a-4a23-8ac0-6836c31a80b8 for instance with vm_state active and task_state deleting.
Nov 29 01:57:16 user nova-compute[75210]: INFO nova.compute.manager [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Took 0.81 seconds to detach 1 volumes for instance.
Nov 29 01:57:16 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 0280bdf1-f006-4252-be61-3fb3452707b4] Deleting volume: 9bbf5212-5bb0-4d7d-bca3-9c301f04ec32 {{(pid=75210) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 01:57:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:16 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:57:16 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:57:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:17 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Deleted allocations for instance 0280bdf1-f006-4252-be61-3fb3452707b4
Nov 29 01:57:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c4ff2c23-3456-458d-8412-ef6f85077f39 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "0280bdf1-f006-4252-be61-3fb3452707b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.119s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:32 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:57:32 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:57:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:57:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:57:32 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:57:33 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Updating instance_info_cache with network_info: [{"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:57:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-391642f0-2293-46bf-a93a-c6f2e61698f6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:57:33 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:57:33 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:57:33 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:57:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:57:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:57:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:57:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:57:37 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:57:37 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:57:38 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:57:39 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:57:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:57:41 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:57:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:41 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:57:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:57:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:57:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:44 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:57:44 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8174MB free_disk=25.01791000366211GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fa020b7e-c088-4c40-878d-27e43dca4ad0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3df17188-c87e-49e5-9ca2-5d04632ea9bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 5ea4ce52-dd69-4b51-b066-bec88d069151 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 1ea93b31-f7c3-456f-aa99-113160704256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing inventories for resource provider 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating ProviderTree inventory for provider 28871a06-d5c8-43d0-87af-3689cd143011 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating inventory in ProviderTree for provider 28871a06-d5c8-43d0-87af-3689cd143011 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 01:57:44 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing aggregate associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, aggregates: None {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 01:57:45 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing trait associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, traits: HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 01:57:45 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:57:45 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:57:45 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:57:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.737s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:57:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances with incomplete migration  {{(pid=75210) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 01:57:48 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:57:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 01:57:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] There are 0 instances to clean {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 01:57:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:57:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:53 user nova-compute[75210]: INFO nova.compute.manager [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Terminating instance
Nov 29 01:57:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:57:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:53 user nova-compute[75210]: DEBUG nova.compute.manager [req-f036ce77-1cb8-4c7b-9ef9-b957888881ef req-7b98ac31-5d8b-4df8-bd44-58c6684f90f4 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-unplugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f036ce77-1cb8-4c7b-9ef9-b957888881ef req-7b98ac31-5d8b-4df8-bd44-58c6684f90f4 service nova] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f036ce77-1cb8-4c7b-9ef9-b957888881ef req-7b98ac31-5d8b-4df8-bd44-58c6684f90f4 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f036ce77-1cb8-4c7b-9ef9-b957888881ef req-7b98ac31-5d8b-4df8-bd44-58c6684f90f4 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:53 user nova-compute[75210]: DEBUG nova.compute.manager [req-f036ce77-1cb8-4c7b-9ef9-b957888881ef req-7b98ac31-5d8b-4df8-bd44-58c6684f90f4 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] No waiting events found dispatching network-vif-unplugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-f036ce77-1cb8-4c7b-9ef9-b957888881ef req-7b98ac31-5d8b-4df8-bd44-58c6684f90f4 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-unplugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:54 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Instance destroyed successfully.
Nov 29 01:57:54 user nova-compute[75210]: DEBUG nova.objects.instance [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'resources' on Instance uuid 5ea4ce52-dd69-4b51-b066-bec88d069151 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:52:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-549585726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-549585726',id=34,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:54:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-dd94ph0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:56:07Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=5ea4ce52-dd69-4b51-b066-bec88d069151,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "address": "fa:16:3e:97:68:b4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aeb9e13-ef", "ovs_interfaceid": "9aeb9e13-ef8d-49e6-a98d-75e3fd783cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:68:b4,bridge_name='br-int',has_traffic_filtering=True,id=9aeb9e13-ef8d-49e6-a98d-75e3fd783cea,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aeb9e13-ef') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_vif [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:68:b4,bridge_name='br-int',has_traffic_filtering=True,id=9aeb9e13-ef8d-49e6-a98d-75e3fd783cea,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aeb9e13-ef') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9aeb9e13-ef, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60c79dfd-60a6-44ed-963a-74f68b92e1f0) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:57:54 user nova-compute[75210]: INFO os_vif [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:68:b4,bridge_name='br-int',has_traffic_filtering=True,id=9aeb9e13-ef8d-49e6-a98d-75e3fd783cea,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aeb9e13-ef')
Nov 29 01:57:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WoGMuFnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:57:54 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc1e38a-7bdf-4dbd-8592-3fc10cb10237]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:57:54 user nova-compute[75210]: No targets found.
Nov 29 01:57:54 user nova-compute[75210]: iSNS:
Nov 29 01:57:54 user nova-compute[75210]: No targets found.
Nov 29 01:57:54 user nova-compute[75210]: STATIC:
Nov 29 01:57:54 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc
Nov 29 01:57:54 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:57:54 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:57:54 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31
Nov 29 01:57:54 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:57:54 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:57:54 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256
Nov 29 01:57:54 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:57:54 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:57:54 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:57:54 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:57:54 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:57:54 user nova-compute[75210]: FIRMWARE:
Nov 29 01:57:54 user nova-compute[75210]: No targets found.
Nov 29 01:57:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:57:54 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:57:54 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9706ffd2-d69c-41ff-a03d-8a9fe9288da0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[044b046b-c451-49e9-8e6c-c6626cd8f7eb]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:57:54 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:57:54 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:57:54 user nova-compute[75210]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:57:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:57:54 user nova-compute[75210]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc (non-flash)
Nov 29 01:57:54 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:57:54 user nova-compute[75210]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:57:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f53400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc'): ({'sdf'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Removing single pathed devices sdf {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c807836-b834-4caf-8aec-6c28ba8608f8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee95439-0907-4ae5-a8d9-cc6e954fc3c7]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flushing IO for device /dev/sdf {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df8f72e-7046-4819-a696-83585234edef]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d34c4d4-9322-412a-9d4e-d234ffa8cb91]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] SCSI volumes sdf have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOabb84732-91e62b4d0917c27b', '/dev/disk/by-id/scsi-23931653632623464', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_abb84732') {{(pid=85542) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 01:57:54 user nova-compute[75210]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOabb84732-91e62b4d0917c27b
Nov 29 01:57:54 user nova-compute[75210]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23931653632623464
Nov 29 01:57:54 user nova-compute[75210]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_abb84732
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2834c86f-6122-45b3-bc74-7e4d1315cd72]: (4, None) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ff27b9-0549-477c-9bae-3332d8cbc4af]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e982104-e338-49ea-87f7-512056a1d50b]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc, portal: 172.16.0.220,3260]
Nov 29 01:57:54 user nova-compute[75210]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc, portal: 172.16.0.220,3260] successful.
Nov 29 01:57:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7ee48ba-8fc7-46c6-a549-ec71825f29fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[10001fbf-2937-428a-897c-a22cf6e495d4]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] <== disconnect_volume: return (328ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:57:54 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Deleting instance files /opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151_del
Nov 29 01:57:54 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Deletion of /opt/stack/data/nova/instances/5ea4ce52-dd69-4b51-b066-bec88d069151_del complete
Nov 29 01:57:54 user nova-compute[75210]: INFO nova.compute.manager [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 29 01:57:54 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:57:54 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:57:55 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:57:55 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Took 0.44 seconds to deallocate network for instance.
Nov 29 01:57:55 user nova-compute[75210]: DEBUG nova.compute.manager [req-e0bb0b6d-1f35-4f6f-8047-e53c2eb1a59e req-740fb262-ae0a-45f5-add3-8d44735b9205 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-deleted-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-eef10302-74a2-49dd-822d-e74d1a5f9708 req-053329c6-f704-4e8d-8f80-4e55de8fb2f2 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:57:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-eef10302-74a2-49dd-822d-e74d1a5f9708 req-053329c6-f704-4e8d-8f80-4e55de8fb2f2 service nova] Acquiring lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-eef10302-74a2-49dd-822d-e74d1a5f9708 req-053329c6-f704-4e8d-8f80-4e55de8fb2f2 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-eef10302-74a2-49dd-822d-e74d1a5f9708 req-053329c6-f704-4e8d-8f80-4e55de8fb2f2 service nova] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-eef10302-74a2-49dd-822d-e74d1a5f9708 req-053329c6-f704-4e8d-8f80-4e55de8fb2f2 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] No waiting events found dispatching network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:57:56 user nova-compute[75210]: WARNING nova.compute.manager [req-eef10302-74a2-49dd-822d-e74d1a5f9708 req-053329c6-f704-4e8d-8f80-4e55de8fb2f2 service nova] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Received unexpected event network-vif-plugged-9aeb9e13-ef8d-49e6-a98d-75e3fd783cea for instance with vm_state active and task_state deleting.
Nov 29 01:57:56 user nova-compute[75210]: INFO nova.compute.manager [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 5ea4ce52-dd69-4b51-b066-bec88d069151] Took 0.77 seconds to detach 1 volumes for instance.
Nov 29 01:57:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:57:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:57:56 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:57:56 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:57:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:56 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Deleted allocations for instance 5ea4ce52-dd69-4b51-b066-bec88d069151
Nov 29 01:57:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-90eab7f1-b29c-4eb0-8bf0-71e807c5f4d3 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "5ea4ce52-dd69-4b51-b066-bec88d069151" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.881s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:57:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "fa020b7e-c088-4c40-878d-27e43dca4ad0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:09 user nova-compute[75210]: INFO nova.compute.manager [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Terminating instance
Nov 29 01:58:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:58:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-f0c940a8-bfbb-4605-acc1-0b89105171d7 req-40d32d45-b79c-46a7-8cf4-881e86bfcef2 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received event network-vif-unplugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f0c940a8-bfbb-4605-acc1-0b89105171d7 req-40d32d45-b79c-46a7-8cf4-881e86bfcef2 service nova] Acquiring lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f0c940a8-bfbb-4605-acc1-0b89105171d7 req-40d32d45-b79c-46a7-8cf4-881e86bfcef2 service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f0c940a8-bfbb-4605-acc1-0b89105171d7 req-40d32d45-b79c-46a7-8cf4-881e86bfcef2 service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-f0c940a8-bfbb-4605-acc1-0b89105171d7 req-40d32d45-b79c-46a7-8cf4-881e86bfcef2 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] No waiting events found dispatching network-vif-unplugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-f0c940a8-bfbb-4605-acc1-0b89105171d7 req-40d32d45-b79c-46a7-8cf4-881e86bfcef2 service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received event network-vif-unplugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:10 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Instance destroyed successfully.
Nov 29 01:58:10 user nova-compute[75210]: DEBUG nova.objects.instance [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'resources' on Instance uuid fa020b7e-c088-4c40-878d-27e43dca4ad0 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-767989198',display_name='tempest-ServerRescueNegativeTestJSON-server-767989198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-767989198',id=20,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:44:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ea74c32e3354c9bb76465b39f437026',ramdisk_id='',reservation_id='r-zpy2v0bg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-948038897',owner_user_name='tempest-ServerRescueNegativeTestJSON-948038897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:44:01Z,user_data=None,user_id='339a0127c78144a989498320081f2c15',uuid=fa020b7e-c088-4c40-878d-27e43dca4ad0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converting VIF {"id": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "address": "fa:16:3e:50:38:41", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap430b36ae-28", "ovs_interfaceid": "430b36ae-28e1-4a6b-860f-86b336fb10b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:38:41,bridge_name='br-int',has_traffic_filtering=True,id=430b36ae-28e1-4a6b-860f-86b336fb10b3,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430b36ae-28') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG os_vif [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:38:41,bridge_name='br-int',has_traffic_filtering=True,id=430b36ae-28e1-4a6b-860f-86b336fb10b3,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430b36ae-28') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap430b36ae-28, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce8f3423-039b-4339-9577-f5910f3fd7a5) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:10 user nova-compute[75210]: INFO os_vif [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:38:41,bridge_name='br-int',has_traffic_filtering=True,id=430b36ae-28e1-4a6b-860f-86b336fb10b3,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap430b36ae-28')
Nov 29 01:58:10 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Deleting instance files /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0_del
Nov 29 01:58:10 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Deletion of /opt/stack/data/nova/instances/fa020b7e-c088-4c40-878d-27e43dca4ad0_del complete
Nov 29 01:58:10 user nova-compute[75210]: INFO nova.compute.manager [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 29 01:58:10 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:58:10 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:58:11 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:58:11 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Took 0.46 seconds to deallocate network for instance.
Nov 29 01:58:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:11 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:58:11 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:58:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:11 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Deleted allocations for instance fa020b7e-c088-4c40-878d-27e43dca4ad0
Nov 29 01:58:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-71cf4035-dc31-463f-a010-bc5d1a468aa4 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.881s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-01779ff9-7edc-4de0-9526-428e18dab5f9 req-a148e7d3-5e6b-4aa3-8007-5c060e773dab service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received event network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:58:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-01779ff9-7edc-4de0-9526-428e18dab5f9 req-a148e7d3-5e6b-4aa3-8007-5c060e773dab service nova] Acquiring lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-01779ff9-7edc-4de0-9526-428e18dab5f9 req-a148e7d3-5e6b-4aa3-8007-5c060e773dab service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-01779ff9-7edc-4de0-9526-428e18dab5f9 req-a148e7d3-5e6b-4aa3-8007-5c060e773dab service nova] Lock "fa020b7e-c088-4c40-878d-27e43dca4ad0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-01779ff9-7edc-4de0-9526-428e18dab5f9 req-a148e7d3-5e6b-4aa3-8007-5c060e773dab service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] No waiting events found dispatching network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:58:12 user nova-compute[75210]: WARNING nova.compute.manager [req-01779ff9-7edc-4de0-9526-428e18dab5f9 req-a148e7d3-5e6b-4aa3-8007-5c060e773dab service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received unexpected event network-vif-plugged-430b36ae-28e1-4a6b-860f-86b336fb10b3 for instance with vm_state deleted and task_state None.
Nov 29 01:58:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-01779ff9-7edc-4de0-9526-428e18dab5f9 req-a148e7d3-5e6b-4aa3-8007-5c060e773dab service nova] [instance: fa020b7e-c088-4c40-878d-27e43dca4ad0] Received event network-vif-deleted-430b36ae-28e1-4a6b-860f-86b336fb10b3 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:58:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 01:58:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:20 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 01:58:20 user nova-compute[75210]: INFO nova.compute.claims [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Claim successful on node user
Nov 29 01:58:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:20 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:58:20 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:58:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 01:58:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 01:58:20 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG nova.policy [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '080bcd228b454b03995b0f3e116df917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70d8cbb4232433cbd0db9e9448d897f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 01:58:21 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 01:58:21 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 01:58:21 user nova-compute[75210]: INFO nova.virt.block_device [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Booting with volume 9f56805d-79ba-4c98-b5d7-0d4157812193 at /dev/vda
Nov 29 01:58:21 user nova-compute[75210]: DEBUG os_brick.utils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3268866e-2e06-452d-a529-ea6493e8a1cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd6634f-18fd-4224-82a9-2a105a51380f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b747c9-0a5d-4c38-a322-6dfda737fc8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5057476c-c368-40cf-9e53-8018e702f101]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 01:58:21 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 01:58:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0195bd7-a751-4746-9daf-78cfd0628b83]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG os_brick.utils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Updating existing volume attachment record: ab649fe0-e682-4516-b774-f32dced34f62 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 01:58:21 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Successfully created port: a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 01:58:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Successfully updated port: a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 01:58:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "refresh_cache-48c1091b-67d1-4d0f-96e2-b6ccb8567466" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:58:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquired lock "refresh_cache-48c1091b-67d1-4d0f-96e2-b6ccb8567466" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:58:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:58:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-efb47b03-5f18-4392-a321-7e0728a68878 req-c58afb68-775a-4ffd-b565-aa08c80f2e6a service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Received event network-changed-a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:58:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-efb47b03-5f18-4392-a321-7e0728a68878 req-c58afb68-775a-4ffd-b565-aa08c80f2e6a service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Refreshing instance network info cache due to event network-changed-a00c75af-2d11-4e42-a2bf-c22357008629. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 01:58:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-efb47b03-5f18-4392-a321-7e0728a68878 req-c58afb68-775a-4ffd-b565-aa08c80f2e6a service nova] Acquiring lock "refresh_cache-48c1091b-67d1-4d0f-96e2-b6ccb8567466" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:58:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 01:58:22 user nova-compute[75210]: DEBUG nova.network.neutron [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Updating instance_info_cache with network_info: [{"id": "a00c75af-2d11-4e42-a2bf-c22357008629", "address": "fa:16:3e:ea:a3:85", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c75af-2d", "ovs_interfaceid": "a00c75af-2d11-4e42-a2bf-c22357008629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:58:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Releasing lock "refresh_cache-48c1091b-67d1-4d0f-96e2-b6ccb8567466" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:58:22 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Instance network_info: |[{"id": "a00c75af-2d11-4e42-a2bf-c22357008629", "address": "fa:16:3e:ea:a3:85", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c75af-2d", "ovs_interfaceid": "a00c75af-2d11-4e42-a2bf-c22357008629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 01:58:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-efb47b03-5f18-4392-a321-7e0728a68878 req-c58afb68-775a-4ffd-b565-aa08c80f2e6a service nova] Acquired lock "refresh_cache-48c1091b-67d1-4d0f-96e2-b6ccb8567466" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:58:22 user nova-compute[75210]: DEBUG nova.network.neutron [req-efb47b03-5f18-4392-a321-7e0728a68878 req-c58afb68-775a-4ffd-b565-aa08c80f2e6a service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Refreshing network info cache for port a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 01:58:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-efb47b03-5f18-4392-a321-7e0728a68878 req-c58afb68-775a-4ffd-b565-aa08c80f2e6a service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Updated VIF entry in instance network info cache for port a00c75af-2d11-4e42-a2bf-c22357008629. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 01:58:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-efb47b03-5f18-4392-a321-7e0728a68878 req-c58afb68-775a-4ffd-b565-aa08c80f2e6a service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Updating instance_info_cache with network_info: [{"id": "a00c75af-2d11-4e42-a2bf-c22357008629", "address": "fa:16:3e:ea:a3:85", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c75af-2d", "ovs_interfaceid": "a00c75af-2d11-4e42-a2bf-c22357008629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:58:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-efb47b03-5f18-4392-a321-7e0728a68878 req-c58afb68-775a-4ffd-b565-aa08c80f2e6a service nova] Releasing lock "refresh_cache-48c1091b-67d1-4d0f-96e2-b6ccb8567466" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:58:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 01:58:28 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Creating image(s)
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Ensure instance console log exists: /opt/stack/data/nova/instances/48c1091b-67d1-4d0f-96e2-b6ccb8567466/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Start _get_guest_xml network_info=[{"id": "a00c75af-2d11-4e42-a2bf-c22357008629", "address": "fa:16:3e:ea:a3:85", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c75af-2d", "ovs_interfaceid": "a00c75af-2d11-4e42-a2bf-c22357008629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'ab649fe0-e682-4516-b774-f32dced34f62', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQUJrDZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48c1091b-67d1-4d0f-96e2-b6ccb8567466', 'attached_at': '', 'detached_at': '', 'volume_id': '9f56805d-79ba-4c98-b5d7-0d4157812193', 'serial': '9f56805d-79ba-4c98-b5d7-0d4157812193'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:58:28 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:58:28 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQUJrDZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:58:28 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:58:28 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:58:28 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c07c20-df47-480f-86a2-52b6eee15198]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:58:28 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d658f8d0-9f1f-4d53-81ec-9e3059265754]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193] added
Nov 29 01:58:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8650bc-3202-4f95-a0a4-b8e26fa1b363]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d675744-79c1-4d36-bbb8-b357b8f651db]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQUJrDZz {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQUJrDZz" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e227758-0cf0-453e-912d-1ad35ccc5373]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AQUJrDZz'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55f09c3-3a4c-4659-b095-e52a0e3812f1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[446345b4-78d3-4e4f-982c-8d7be37ee4b9]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b2220f-a45e-46e6-8c49-2be6009a5bce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193, portal: 172.16.0.220,3260]
Nov 29 01:58:28 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193, portal: 172.16.0.220,3260] successful.
Nov 29 01:58:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4c888d-e988-4ea2-bccd-451a95689b64]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f577d3-c2a7-4c45-b0e6-ea76aa88744b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 01:58:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f8f730-fd8f-42c9-ac45-d5ab044de676]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:58:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQUJrDZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26535633935336639', 'path': '/dev/sdd'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535633935336639', 'path': '/dev/sdd'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1973726846',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1973726846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1973726846',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwwuA5a70S+FTZlwrGrzGJAtV9oKYVfIVumFnyEW56EnaqgwmTgWBQc4gZ8eZlvi8V5ju8DZk8PQhGhBrH45y72K4krpbUPM/VIHel3DwCxp8ScqU2UQqW2GNb9MzSsww==',key_name='tempest-keypair-458397239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-ykci4t2o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='080bcd228b454b03995b0f3e116df917',uuid=48c1091b-67d1-4d0f-96e2-b6ccb8567466,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a00c75af-2d11-4e42-a2bf-c22357008629", "address": "fa:16:3e:ea:a3:85", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c75af-2d", "ovs_interfaceid": "a00c75af-2d11-4e42-a2bf-c22357008629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "a00c75af-2d11-4e42-a2bf-c22357008629", "address": "fa:16:3e:ea:a3:85", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c75af-2d", "ovs_interfaceid": "a00c75af-2d11-4e42-a2bf-c22357008629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=a00c75af-2d11-4e42-a2bf-c22357008629,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c75af-2d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG nova.objects.instance [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lazy-loading 'pci_devices' on Instance uuid 48c1091b-67d1-4d0f-96e2-b6ccb8567466 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:58:29 user nova-compute[75210]:   <uuid>48c1091b-67d1-4d0f-96e2-b6ccb8567466</uuid>
Nov 29 01:58:29 user nova-compute[75210]:   <name>instance-00000026</name>
Nov 29 01:58:29 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:58:29 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:58:29 user nova-compute[75210]:   <metadata>
Nov 29 01:58:29 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:58:29 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:58:29 user nova-compute[75210]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1973726846</nova:name>
Nov 29 01:58:29 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:58:28</nova:creationTime>
Nov 29 01:58:29 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:58:29 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:58:29 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:58:29 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:58:29 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:58:29 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:58:29 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:58:29 user nova-compute[75210]:       <nova:owner>
Nov 29 01:58:29 user nova-compute[75210]:         <nova:user uuid="080bcd228b454b03995b0f3e116df917">tempest-TestVolumeBootPattern-670838009-project-member</nova:user>
Nov 29 01:58:29 user nova-compute[75210]:         <nova:project uuid="f70d8cbb4232433cbd0db9e9448d897f">tempest-TestVolumeBootPattern-670838009</nova:project>
Nov 29 01:58:29 user nova-compute[75210]:       </nova:owner>
Nov 29 01:58:29 user nova-compute[75210]:       <nova:ports>
Nov 29 01:58:29 user nova-compute[75210]:         <nova:port uuid="a00c75af-2d11-4e42-a2bf-c22357008629">
Nov 29 01:58:29 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 01:58:29 user nova-compute[75210]:         </nova:port>
Nov 29 01:58:29 user nova-compute[75210]:       </nova:ports>
Nov 29 01:58:29 user nova-compute[75210]:     </nova:instance>
Nov 29 01:58:29 user nova-compute[75210]:   </metadata>
Nov 29 01:58:29 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:58:29 user nova-compute[75210]:     <system>
Nov 29 01:58:29 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:58:29 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:58:29 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:58:29 user nova-compute[75210]:       <entry name="serial">48c1091b-67d1-4d0f-96e2-b6ccb8567466</entry>
Nov 29 01:58:29 user nova-compute[75210]:       <entry name="uuid">48c1091b-67d1-4d0f-96e2-b6ccb8567466</entry>
Nov 29 01:58:29 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:58:29 user nova-compute[75210]:     </system>
Nov 29 01:58:29 user nova-compute[75210]:   </sysinfo>
Nov 29 01:58:29 user nova-compute[75210]:   <os>
Nov 29 01:58:29 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:58:29 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:58:29 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:58:29 user nova-compute[75210]:   </os>
Nov 29 01:58:29 user nova-compute[75210]:   <features>
Nov 29 01:58:29 user nova-compute[75210]:     <acpi/>
Nov 29 01:58:29 user nova-compute[75210]:     <apic/>
Nov 29 01:58:29 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:58:29 user nova-compute[75210]:   </features>
Nov 29 01:58:29 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:58:29 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:58:29 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:58:29 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:58:29 user nova-compute[75210]:   </clock>
Nov 29 01:58:29 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:58:29 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:58:29 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:58:29 user nova-compute[75210]:   </cpu>
Nov 29 01:58:29 user nova-compute[75210]:   <devices>
Nov 29 01:58:29 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:58:29 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:58:29 user nova-compute[75210]:       <source dev="/dev/sdd"/>
Nov 29 01:58:29 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:58:29 user nova-compute[75210]:       <serial>9f56805d-79ba-4c98-b5d7-0d4157812193</serial>
Nov 29 01:58:29 user nova-compute[75210]:     </disk>
Nov 29 01:58:29 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:58:29 user nova-compute[75210]:       <mac address="fa:16:3e:ea:a3:85"/>
Nov 29 01:58:29 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:58:29 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:58:29 user nova-compute[75210]:       <target dev="tapa00c75af-2d"/>
Nov 29 01:58:29 user nova-compute[75210]:     </interface>
Nov 29 01:58:29 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:58:29 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/48c1091b-67d1-4d0f-96e2-b6ccb8567466/console.log" append="off"/>
Nov 29 01:58:29 user nova-compute[75210]:     </serial>
Nov 29 01:58:29 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:58:29 user nova-compute[75210]:     <video>
Nov 29 01:58:29 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:58:29 user nova-compute[75210]:     </video>
Nov 29 01:58:29 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:58:29 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:58:29 user nova-compute[75210]:     </rng>
Nov 29 01:58:29 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:58:29 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:58:29 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:58:29 user nova-compute[75210]:     </memballoon>
Nov 29 01:58:29 user nova-compute[75210]:   </devices>
Nov 29 01:58:29 user nova-compute[75210]: </domain>
Nov 29 01:58:29 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1973726846',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1973726846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1973726846',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwwuA5a70S+FTZlwrGrzGJAtV9oKYVfIVumFnyEW56EnaqgwmTgWBQc4gZ8eZlvi8V5ju8DZk8PQhGhBrH45y72K4krpbUPM/VIHel3DwCxp8ScqU2UQqW2GNb9MzSsww==',key_name='tempest-keypair-458397239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-ykci4t2o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='080bcd228b454b03995b0f3e116df917',uuid=48c1091b-67d1-4d0f-96e2-b6ccb8567466,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a00c75af-2d11-4e42-a2bf-c22357008629", "address": "fa:16:3e:ea:a3:85", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c75af-2d", "ovs_interfaceid": "a00c75af-2d11-4e42-a2bf-c22357008629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "a00c75af-2d11-4e42-a2bf-c22357008629", "address": "fa:16:3e:ea:a3:85", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c75af-2d", "ovs_interfaceid": "a00c75af-2d11-4e42-a2bf-c22357008629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=a00c75af-2d11-4e42-a2bf-c22357008629,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c75af-2d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG os_vif [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=a00c75af-2d11-4e42-a2bf-c22357008629,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c75af-2d') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2db81bd9-7371-5790-b839-cc9731ded0fe', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa00c75af-2d, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa00c75af-2d, col_values=(('qos', UUID('f1999484-8d84-487f-9be2-3661ddbb6b21')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa00c75af-2d, col_values=(('external_ids', {'iface-id': 'a00c75af-2d11-4e42-a2bf-c22357008629', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a3:85', 'vm-uuid': '48c1091b-67d1-4d0f-96e2-b6ccb8567466'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:58:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:30 user nova-compute[75210]: INFO os_vif [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=a00c75af-2d11-4e42-a2bf-c22357008629,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c75af-2d')
Nov 29 01:58:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 01:58:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] No VIF found with MAC fa:16:3e:ea:a3:85, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-fafa8003-d188-4611-a5fb-ea896450783b req-669422d8-dc66-4a39-9064-64c7e0ed1ec0 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Received event network-vif-plugged-a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fafa8003-d188-4611-a5fb-ea896450783b req-669422d8-dc66-4a39-9064-64c7e0ed1ec0 service nova] Acquiring lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fafa8003-d188-4611-a5fb-ea896450783b req-669422d8-dc66-4a39-9064-64c7e0ed1ec0 service nova] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fafa8003-d188-4611-a5fb-ea896450783b req-669422d8-dc66-4a39-9064-64c7e0ed1ec0 service nova] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-fafa8003-d188-4611-a5fb-ea896450783b req-669422d8-dc66-4a39-9064-64c7e0ed1ec0 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] No waiting events found dispatching network-vif-plugged-a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:58:31 user nova-compute[75210]: WARNING nova.compute.manager [req-fafa8003-d188-4611-a5fb-ea896450783b req-669422d8-dc66-4a39-9064-64c7e0ed1ec0 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Received unexpected event network-vif-plugged-a00c75af-2d11-4e42-a2bf-c22357008629 for instance with vm_state building and task_state spawning.
Nov 29 01:58:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 01:58:33 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Instance spawned successfully.
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.compute.manager [req-df13a73e-6b48-4a76-8cd0-c4f85040a7d4 req-09b0cbcc-c4ae-4051-b3a7-6804f081012e service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Received event network-vif-plugged-a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-df13a73e-6b48-4a76-8cd0-c4f85040a7d4 req-09b0cbcc-c4ae-4051-b3a7-6804f081012e service nova] Acquiring lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-df13a73e-6b48-4a76-8cd0-c4f85040a7d4 req-09b0cbcc-c4ae-4051-b3a7-6804f081012e service nova] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-df13a73e-6b48-4a76-8cd0-c4f85040a7d4 req-09b0cbcc-c4ae-4051-b3a7-6804f081012e service nova] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.compute.manager [req-df13a73e-6b48-4a76-8cd0-c4f85040a7d4 req-09b0cbcc-c4ae-4051-b3a7-6804f081012e service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] No waiting events found dispatching network-vif-plugged-a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:58:33 user nova-compute[75210]: WARNING nova.compute.manager [req-df13a73e-6b48-4a76-8cd0-c4f85040a7d4 req-09b0cbcc-c4ae-4051-b3a7-6804f081012e service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Received unexpected event network-vif-plugged-a00c75af-2d11-4e42-a2bf-c22357008629 for instance with vm_state building and task_state spawning.
Nov 29 01:58:33 user nova-compute[75210]: INFO nova.compute.manager [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.compute.manager [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:58:33 user nova-compute[75210]: INFO nova.compute.manager [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Took 13.14 seconds to build instance.
Nov 29 01:58:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-1af7de9f-e59b-4db7-b6ea-f3ad551d2fba tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.230s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Updating instance_info_cache with network_info: [{"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-13274e43-2984-4aa6-ad9b-23e3bbe7c959" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:58:33 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:58:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:58:37 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:58:37 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:58:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:58:39 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:58:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:40 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:58:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:58:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:58:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:58:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:58:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:44 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:58:44 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8259MB free_disk=25.035682678222656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:44 user nova-compute[75210]: INFO nova.compute.manager [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Terminating instance
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.compute.manager [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 391642f0-2293-46bf-a93a-c6f2e61698f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3df17188-c87e-49e5-9ca2-5d04632ea9bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 1ea93b31-f7c3-456f-aa99-113160704256 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 48c1091b-67d1-4d0f-96e2-b6ccb8567466 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:58:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG nova.compute.manager [req-63e6a3a6-31b1-4b29-b2cc-46819c40dec3 req-386e64b3-a62b-439d-97e1-a317075315b2 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Received event network-vif-unplugged-fbebc7dc-3846-49ae-8226-6a9559434359 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-63e6a3a6-31b1-4b29-b2cc-46819c40dec3 req-386e64b3-a62b-439d-97e1-a317075315b2 service nova] Acquiring lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-63e6a3a6-31b1-4b29-b2cc-46819c40dec3 req-386e64b3-a62b-439d-97e1-a317075315b2 service nova] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-63e6a3a6-31b1-4b29-b2cc-46819c40dec3 req-386e64b3-a62b-439d-97e1-a317075315b2 service nova] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG nova.compute.manager [req-63e6a3a6-31b1-4b29-b2cc-46819c40dec3 req-386e64b3-a62b-439d-97e1-a317075315b2 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] No waiting events found dispatching network-vif-unplugged-fbebc7dc-3846-49ae-8226-6a9559434359 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG nova.compute.manager [req-63e6a3a6-31b1-4b29-b2cc-46819c40dec3 req-386e64b3-a62b-439d-97e1-a317075315b2 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Received event network-vif-unplugged-fbebc7dc-3846-49ae-8226-6a9559434359 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:45 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Instance destroyed successfully.
Nov 29 01:58:45 user nova-compute[75210]: DEBUG nova.objects.instance [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'resources' on Instance uuid 3df17188-c87e-49e5-9ca2-5d04632ea9bb {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:49:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-85170163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-85170163',id=32,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:49:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-0mmk0g2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:51:19Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=3df17188-c87e-49e5-9ca2-5d04632ea9bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbebc7dc-3846-49ae-8226-6a9559434359", "address": "fa:16:3e:82:69:38", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbebc7dc-38", "ovs_interfaceid": "fbebc7dc-3846-49ae-8226-6a9559434359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "fbebc7dc-3846-49ae-8226-6a9559434359", "address": "fa:16:3e:82:69:38", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbebc7dc-38", "ovs_interfaceid": "fbebc7dc-3846-49ae-8226-6a9559434359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:69:38,bridge_name='br-int',has_traffic_filtering=True,id=fbebc7dc-3846-49ae-8226-6a9559434359,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbebc7dc-38') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG os_vif [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:69:38,bridge_name='br-int',has_traffic_filtering=True,id=fbebc7dc-3846-49ae-8226-6a9559434359,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbebc7dc-38') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbebc7dc-38, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=049fba0b-de66-4e1d-93dc-afac5ea5e48b) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:45 user nova-compute[75210]: INFO os_vif [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:69:38,bridge_name='br-int',has_traffic_filtering=True,id=fbebc7dc-3846-49ae-8226-6a9559434359,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbebc7dc-38')
Nov 29 01:58:45 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Deleting instance files /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb_del
Nov 29 01:58:45 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Deletion of /opt/stack/data/nova/instances/3df17188-c87e-49e5-9ca2-5d04632ea9bb_del complete
Nov 29 01:58:45 user nova-compute[75210]: INFO nova.compute.manager [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 29 01:58:45 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:58:45 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:58:46 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:58:46 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Took 0.45 seconds to deallocate network for instance.
Nov 29 01:58:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-a712c664-43de-4b47-8237-a92965d7d072 req-0ad24052-0f3c-408d-ac73-07372cecae6e service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Received event network-vif-deleted-fbebc7dc-3846-49ae-8226-6a9559434359 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:58:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:46 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:58:46 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:58:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:46 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Deleted allocations for instance 3df17188-c87e-49e5-9ca2-5d04632ea9bb
Nov 29 01:58:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-18a4029a-44e3-45dc-b307-7dfc431ea4a6 tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.727s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:47 user nova-compute[75210]: DEBUG nova.compute.manager [req-f069410c-1919-4b9d-9c7e-27251a84bc1b req-f7a20bc4-45d7-44e8-bb70-f6f948d78411 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Received event network-vif-plugged-fbebc7dc-3846-49ae-8226-6a9559434359 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:58:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f069410c-1919-4b9d-9c7e-27251a84bc1b req-f7a20bc4-45d7-44e8-bb70-f6f948d78411 service nova] Acquiring lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f069410c-1919-4b9d-9c7e-27251a84bc1b req-f7a20bc4-45d7-44e8-bb70-f6f948d78411 service nova] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f069410c-1919-4b9d-9c7e-27251a84bc1b req-f7a20bc4-45d7-44e8-bb70-f6f948d78411 service nova] Lock "3df17188-c87e-49e5-9ca2-5d04632ea9bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:47 user nova-compute[75210]: DEBUG nova.compute.manager [req-f069410c-1919-4b9d-9c7e-27251a84bc1b req-f7a20bc4-45d7-44e8-bb70-f6f948d78411 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] No waiting events found dispatching network-vif-plugged-fbebc7dc-3846-49ae-8226-6a9559434359 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:58:47 user nova-compute[75210]: WARNING nova.compute.manager [req-f069410c-1919-4b9d-9c7e-27251a84bc1b req-f7a20bc4-45d7-44e8-bb70-f6f948d78411 service nova] [instance: 3df17188-c87e-49e5-9ca2-5d04632ea9bb] Received unexpected event network-vif-plugged-fbebc7dc-3846-49ae-8226-6a9559434359 for instance with vm_state deleted and task_state None.
Nov 29 01:58:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:53 user nova-compute[75210]: DEBUG nova.objects.instance [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'flavor' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:58:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:58:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquired lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:58:53 user nova-compute[75210]: DEBUG nova.network.neutron [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 01:58:53 user nova-compute[75210]: DEBUG nova.objects.instance [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'info_cache' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:58:53 user nova-compute[75210]: DEBUG nova.objects.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:58:53 user nova-compute[75210]: DEBUG nova.network.neutron [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updating instance_info_cache with network_info: [{"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Releasing lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:58:54 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Instance destroyed successfully.
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.objects.instance [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'resources' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.objects.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1654971335',display_name='tempest-AttachVolumeTestJSON-server-1654971335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1654971335',id=36,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGnqdmpBzYm6z7oGTNZRg+k46dT8ozTAGc/Jui4Cyn5xsrA9EzCgjJ4vksQkVJRWqNU8LRGswNNFzJWUQNeBPWWN26oJbHGu7RqD4PfAoZzP7e8c5Cd769h3F8sF6e9zg==',key_name='tempest-keypair-2129640759',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='64aac75090884257a9c33f94ec9aa367',ramdisk_id='',reservation_id='r-c673118l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-91454133',owner_user_name='tempest-AttachVolumeTestJSON-91454133-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:57:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee2d9a0f7574bad97338a59b8ce8968',uuid=34309f2a-e58e-4c00-a80d-0fc86e72e4fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converting VIF {"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_vif [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2989e5b-84, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=543329ba-63c9-4de7-bf8b-22081b7d39f0) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:54 user nova-compute[75210]: INFO os_vif [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84')
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwekncqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:58:54 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc73134-1420-4f8b-bf23-71c2e7c0045d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:58:54 user nova-compute[75210]: No targets found.
Nov 29 01:58:54 user nova-compute[75210]: iSNS:
Nov 29 01:58:54 user nova-compute[75210]: No targets found.
Nov 29 01:58:54 user nova-compute[75210]: STATIC:
Nov 29 01:58:54 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31
Nov 29 01:58:54 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:58:54 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:58:54 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256
Nov 29 01:58:54 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:58:54 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:58:54 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:58:54 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:58:54 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:58:54 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193
Nov 29 01:58:54 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:58:54 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:58:54 user nova-compute[75210]: FIRMWARE:
Nov 29 01:58:54 user nova-compute[75210]: No targets found.
Nov 29 01:58:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:58:54 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:58:54 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b55146-2590-40a9-a8f3-9f799f5e5818]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68f15b7-b7da-45bb-a0da-ee49a1946f45]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f52710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31'): ({'sde'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Removing single pathed devices sde {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a06c860-e284-4c4d-907b-94e6175880cf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[015a8ab4-6237-4379-b5c4-96e1885a40f1]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Flushing IO for device /dev/sde {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a680e885-b60b-4d2e-a137-8526f66d9072]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd56a77d-7013-448a-bbda-b0302bc6e22e]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa561c1-d628-4329-bbbb-b0b192028903]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d798183d-3d39-434f-89a0-57fbba750228]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260]
Nov 29 01:58:54 user nova-compute[75210]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260] successful.
Nov 29 01:58:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9f689e-549b-48c7-aafb-e980b70521b7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] <== disconnect_volume: return (301ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Start _get_guest_xml network_info=[{"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '6e889c0b-8f38-4c5f-8a98-36505b6def17', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwekncqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '34309f2a-e58e-4c00-a80d-0fc86e72e4fa', 'attached_at': '', 'detached_at': '', 'volume_id': '031d4ab6-fdf7-4f6f-84ce-425506889b31', 'serial': '031d4ab6-fdf7-4f6f-84ce-425506889b31'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.objects.instance [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'numa_topology' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.objects.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:58:54 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:58:54 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.objects.instance [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'vcpu_model' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.objects.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwekncqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:58:54 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:58:54 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:58:54 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d23139d-534d-4d60-a7db-9a4a72b679eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 01:58:54 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ea11d4-4ec4-4c51-bc6e-07f5a276d6e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31] added
Nov 29 01:58:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[72554fab-f766-4241-b074-93709f2877c1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d8fc2e-471a-4bba-9d91-3ba913d2c91b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OwekncqF {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OwekncqF" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f7de88-b905-4329-be0c-c12bca4b1ec6]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OwekncqF'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a77add-82fe-4fa0-9a6a-b8ed1a4a7ae0]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3978ef-0460-47e4-9518-660909903157]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa38519f-53ee-42c6-adde-cbb3c9190a7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260]
Nov 29 01:58:54 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260] successful.
Nov 29 01:58:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa4180a-60f9-45ad-b726-401dc9b5727f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31de7ce-b7cf-4639-9da5-103df1f4e2e8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:58:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[276ea4b0-829a-4e83-8bab-d15851a708a8]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 01:58:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwekncqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 01:58:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:58:55 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23336653866356631', 'path': '/dev/sde'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:58:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336653866356631', 'path': '/dev/sde'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 01:58:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1654971335',display_name='tempest-AttachVolumeTestJSON-server-1654971335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1654971335',id=36,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGnqdmpBzYm6z7oGTNZRg+k46dT8ozTAGc/Jui4Cyn5xsrA9EzCgjJ4vksQkVJRWqNU8LRGswNNFzJWUQNeBPWWN26oJbHGu7RqD4PfAoZzP7e8c5Cd769h3F8sF6e9zg==',key_name='tempest-keypair-2129640759',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='64aac75090884257a9c33f94ec9aa367',ramdisk_id='',reservation_id='r-c673118l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-91454133',owner_user_name='tempest-AttachVolumeTestJSON-91454133-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:57:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee2d9a0f7574bad97338a59b8ce8968',uuid=34309f2a-e58e-4c00-a80d-0fc86e72e4fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 01:58:55 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converting VIF {"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:58:55 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:58:55 user nova-compute[75210]: DEBUG nova.objects.instance [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'pci_devices' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:58:55 user nova-compute[75210]: DEBUG nova.objects.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:58:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] End _get_guest_xml xml=<domain type="kvm">
Nov 29 01:58:55 user nova-compute[75210]:   <uuid>34309f2a-e58e-4c00-a80d-0fc86e72e4fa</uuid>
Nov 29 01:58:55 user nova-compute[75210]:   <name>instance-00000024</name>
Nov 29 01:58:55 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 01:58:55 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 01:58:55 user nova-compute[75210]:   <metadata>
Nov 29 01:58:55 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 01:58:55 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 01:58:55 user nova-compute[75210]:       <nova:name>tempest-AttachVolumeTestJSON-server-1654971335</nova:name>
Nov 29 01:58:55 user nova-compute[75210]:       <nova:creationTime>2023-11-29 01:58:54</nova:creationTime>
Nov 29 01:58:55 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 01:58:55 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 01:58:55 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 01:58:55 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 01:58:55 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 01:58:55 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 01:58:55 user nova-compute[75210]:       </nova:flavor>
Nov 29 01:58:55 user nova-compute[75210]:       <nova:owner>
Nov 29 01:58:55 user nova-compute[75210]:         <nova:user uuid="3ee2d9a0f7574bad97338a59b8ce8968">tempest-AttachVolumeTestJSON-91454133-project-member</nova:user>
Nov 29 01:58:55 user nova-compute[75210]:         <nova:project uuid="64aac75090884257a9c33f94ec9aa367">tempest-AttachVolumeTestJSON-91454133</nova:project>
Nov 29 01:58:55 user nova-compute[75210]:       </nova:owner>
Nov 29 01:58:55 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 01:58:55 user nova-compute[75210]:       <nova:ports>
Nov 29 01:58:55 user nova-compute[75210]:         <nova:port uuid="c2989e5b-8405-458d-8862-86a28f95bb38">
Nov 29 01:58:55 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 01:58:55 user nova-compute[75210]:         </nova:port>
Nov 29 01:58:55 user nova-compute[75210]:       </nova:ports>
Nov 29 01:58:55 user nova-compute[75210]:     </nova:instance>
Nov 29 01:58:55 user nova-compute[75210]:   </metadata>
Nov 29 01:58:55 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 01:58:55 user nova-compute[75210]:     <system>
Nov 29 01:58:55 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 01:58:55 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 01:58:55 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 01:58:55 user nova-compute[75210]:       <entry name="serial">34309f2a-e58e-4c00-a80d-0fc86e72e4fa</entry>
Nov 29 01:58:55 user nova-compute[75210]:       <entry name="uuid">34309f2a-e58e-4c00-a80d-0fc86e72e4fa</entry>
Nov 29 01:58:55 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 01:58:55 user nova-compute[75210]:     </system>
Nov 29 01:58:55 user nova-compute[75210]:   </sysinfo>
Nov 29 01:58:55 user nova-compute[75210]:   <os>
Nov 29 01:58:55 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 01:58:55 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 01:58:55 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 01:58:55 user nova-compute[75210]:   </os>
Nov 29 01:58:55 user nova-compute[75210]:   <features>
Nov 29 01:58:55 user nova-compute[75210]:     <acpi/>
Nov 29 01:58:55 user nova-compute[75210]:     <apic/>
Nov 29 01:58:55 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 01:58:55 user nova-compute[75210]:   </features>
Nov 29 01:58:55 user nova-compute[75210]:   <clock offset="utc">
Nov 29 01:58:55 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 01:58:55 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 01:58:55 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 01:58:55 user nova-compute[75210]:   </clock>
Nov 29 01:58:55 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 01:58:55 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 01:58:55 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 01:58:55 user nova-compute[75210]:   </cpu>
Nov 29 01:58:55 user nova-compute[75210]:   <devices>
Nov 29 01:58:55 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 01:58:55 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 01:58:55 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk"/>
Nov 29 01:58:55 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 01:58:55 user nova-compute[75210]:     </disk>
Nov 29 01:58:55 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 01:58:55 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 01:58:55 user nova-compute[75210]:       <source dev="/dev/sde"/>
Nov 29 01:58:55 user nova-compute[75210]:       <target dev="vdb" bus="virtio"/>
Nov 29 01:58:55 user nova-compute[75210]:       <serial>031d4ab6-fdf7-4f6f-84ce-425506889b31</serial>
Nov 29 01:58:55 user nova-compute[75210]:     </disk>
Nov 29 01:58:55 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 01:58:55 user nova-compute[75210]:       <mac address="fa:16:3e:7b:b4:90"/>
Nov 29 01:58:55 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:58:55 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 01:58:55 user nova-compute[75210]:       <target dev="tapc2989e5b-84"/>
Nov 29 01:58:55 user nova-compute[75210]:     </interface>
Nov 29 01:58:55 user nova-compute[75210]:     <serial type="pty">
Nov 29 01:58:55 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/console.log" append="off"/>
Nov 29 01:58:55 user nova-compute[75210]:     </serial>
Nov 29 01:58:55 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 01:58:55 user nova-compute[75210]:     <video>
Nov 29 01:58:55 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 01:58:55 user nova-compute[75210]:     </video>
Nov 29 01:58:55 user nova-compute[75210]:     <rng model="virtio">
Nov 29 01:58:55 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 01:58:55 user nova-compute[75210]:     </rng>
Nov 29 01:58:55 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 01:58:55 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 01:58:55 user nova-compute[75210]:       <stats period="10"/>
Nov 29 01:58:55 user nova-compute[75210]:     </memballoon>
Nov 29 01:58:55 user nova-compute[75210]:   </devices>
Nov 29 01:58:55 user nova-compute[75210]: </domain>
Nov 29 01:58:55 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 01:58:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG nova.objects.instance [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'trusted_certs' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG nova.objects.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Cannot resize image /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG nova.objects.instance [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'migration_context' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG nova.objects.base [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1654971335',display_name='tempest-AttachVolumeTestJSON-server-1654971335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1654971335',id=36,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGnqdmpBzYm6z7oGTNZRg+k46dT8ozTAGc/Jui4Cyn5xsrA9EzCgjJ4vksQkVJRWqNU8LRGswNNFzJWUQNeBPWWN26oJbHGu7RqD4PfAoZzP7e8c5Cd769h3F8sF6e9zg==',key_name='tempest-keypair-2129640759',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='64aac75090884257a9c33f94ec9aa367',ramdisk_id='',reservation_id='r-c673118l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-91454133',owner_user_name='tempest-AttachVolumeTestJSON-91454133-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T01:57:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee2d9a0f7574bad97338a59b8ce8968',uuid=34309f2a-e58e-4c00-a80d-0fc86e72e4fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converting VIF {"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG os_vif [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecc1b33f-62e6-5db9-82a7-66e573da2219', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2989e5b-84, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2989e5b-84, col_values=(('qos', UUID('edff51d1-6504-447b-8c8f-7627285e6b18')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2989e5b-84, col_values=(('external_ids', {'iface-id': 'c2989e5b-8405-458d-8862-86a28f95bb38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:b4:90', 'vm-uuid': '34309f2a-e58e-4c00-a80d-0fc86e72e4fa'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:58:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:56 user nova-compute[75210]: INFO os_vif [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84')
Nov 29 01:58:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-6d2e3bd4-c49c-4e85-a95b-e09d4b71328d req-1c492a6f-8446-4665-af3c-0be8c39ea976 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:58:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6d2e3bd4-c49c-4e85-a95b-e09d4b71328d req-1c492a6f-8446-4665-af3c-0be8c39ea976 service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:58:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6d2e3bd4-c49c-4e85-a95b-e09d4b71328d req-1c492a6f-8446-4665-af3c-0be8c39ea976 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:58:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6d2e3bd4-c49c-4e85-a95b-e09d4b71328d req-1c492a6f-8446-4665-af3c-0be8c39ea976 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:58:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-6d2e3bd4-c49c-4e85-a95b-e09d4b71328d req-1c492a6f-8446-4665-af3c-0be8c39ea976 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:58:58 user nova-compute[75210]: WARNING nova.compute.manager [req-6d2e3bd4-c49c-4e85-a95b-e09d4b71328d req-1c492a6f-8446-4665-af3c-0be8c39ea976 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state stopped and task_state powering-on.
Nov 29 01:58:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:58:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG nova.compute.manager [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 01:59:00 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Instance rebooted successfully.
Nov 29 01:59:00 user nova-compute[75210]: DEBUG nova.compute.manager [None req-749e7798-546d-4dad-a355-a591bd7661f2 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:00 user nova-compute[75210]: INFO nova.compute.manager [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Terminating instance
Nov 29 01:59:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-283816f6-d0ef-4d37-9c65-12ce13bcb605 req-a3a3d402-ebbf-4d59-8417-67ddc4f90540 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-283816f6-d0ef-4d37-9c65-12ce13bcb605 req-a3a3d402-ebbf-4d59-8417-67ddc4f90540 service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-283816f6-d0ef-4d37-9c65-12ce13bcb605 req-a3a3d402-ebbf-4d59-8417-67ddc4f90540 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-283816f6-d0ef-4d37-9c65-12ce13bcb605 req-a3a3d402-ebbf-4d59-8417-67ddc4f90540 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-283816f6-d0ef-4d37-9c65-12ce13bcb605 req-a3a3d402-ebbf-4d59-8417-67ddc4f90540 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:59:00 user nova-compute[75210]: WARNING nova.compute.manager [req-283816f6-d0ef-4d37-9c65-12ce13bcb605 req-a3a3d402-ebbf-4d59-8417-67ddc4f90540 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state active and task_state None.
Nov 29 01:59:00 user nova-compute[75210]: DEBUG nova.compute.manager [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Instance destroyed successfully.
Nov 29 01:59:01 user nova-compute[75210]: DEBUG nova.objects.instance [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lazy-loading 'resources' on Instance uuid 391642f0-2293-46bf-a93a-c6f2e61698f6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2054332848',display_name='tempest-ServerRescueNegativeTestJSON-server-2054332848',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2054332848',id=19,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:46:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ea74c32e3354c9bb76465b39f437026',ramdisk_id='',reservation_id='r-fr65hu1w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-948038897',owner_user_name='tempest-ServerRescueNegativeTestJSON-948038897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:48:45Z,user_data=None,user_id='339a0127c78144a989498320081f2c15',uuid=391642f0-2293-46bf-a93a-c6f2e61698f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converting VIF {"id": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "address": "fa:16:3e:57:a8:7e", "network": {"id": "f24420cc-33d1-402a-8354-ef8befafd8bf", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-420520956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ea74c32e3354c9bb76465b39f437026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81029dcc-8c", "ovs_interfaceid": "81029dcc-8ce3-4765-b4a9-9dbe2860f2cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=81029dcc-8ce3-4765-b4a9-9dbe2860f2cd,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81029dcc-8c') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG os_vif [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=81029dcc-8ce3-4765-b4a9-9dbe2860f2cd,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81029dcc-8c') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81029dcc-8c, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d82b1d79-7800-4b94-8f2c-0aa82527fda8) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: INFO os_vif [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:a8:7e,bridge_name='br-int',has_traffic_filtering=True,id=81029dcc-8ce3-4765-b4a9-9dbe2860f2cd,network=Network(f24420cc-33d1-402a-8354-ef8befafd8bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81029dcc-8c')
Nov 29 01:59:01 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Deleting instance files /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6_del
Nov 29 01:59:01 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Deletion of /opt/stack/data/nova/instances/391642f0-2293-46bf-a93a-c6f2e61698f6_del complete
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: INFO nova.compute.manager [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 29 01:59:01 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:59:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:01 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Took 0.61 seconds to deallocate network for instance.
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-46acd61c-cf0b-4c86-8790-34be3a52357d req-3bead9ad-95f5-497f-bf5c-56fad7d96c4b service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-deleted-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:02 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Deleted allocations for instance 391642f0-2293-46bf-a93a-c6f2e61698f6
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:59:02 user nova-compute[75210]: WARNING nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state deleted and task_state None.
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:59:02 user nova-compute[75210]: WARNING nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state deleted and task_state None.
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:59:02 user nova-compute[75210]: WARNING nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state deleted and task_state None.
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:59:02 user nova-compute[75210]: WARNING nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state deleted and task_state None.
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:59:02 user nova-compute[75210]: WARNING nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-unplugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state deleted and task_state None.
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Acquiring lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] No waiting events found dispatching network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:59:02 user nova-compute[75210]: WARNING nova.compute.manager [req-f59f665d-1df4-40eb-953f-bf82e42512e6 req-76ce91b1-f807-4076-b9a6-561c15e25c50 service nova] [instance: 391642f0-2293-46bf-a93a-c6f2e61698f6] Received unexpected event network-vif-plugged-81029dcc-8ce3-4765-b4a9-9dbe2860f2cd for instance with vm_state deleted and task_state None.
Nov 29 01:59:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-255446e6-0cd7-46eb-810b-d748bde04724 tempest-ServerRescueNegativeTestJSON-948038897 tempest-ServerRescueNegativeTestJSON-948038897-project-member] Lock "391642f0-2293-46bf-a93a-c6f2e61698f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.192s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:03 user nova-compute[75210]: INFO nova.compute.manager [None req-0df15f43-2a48-4126-9d7d-c73e908c3c25 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Get console output
Nov 29 01:59:03 user nova-compute[75210]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 29 01:59:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:59:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 01:59:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:59:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:59:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:33 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:59:33 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:35 user nova-compute[75210]: INFO nova.compute.manager [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Terminating instance
Nov 29 01:59:35 user nova-compute[75210]: DEBUG nova.compute.manager [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-bfa1e74a-59ce-4ee0-ae72-0212023e9f08 req-7f220e47-abd4-441c-9cec-7117e2a13fdd service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bfa1e74a-59ce-4ee0-ae72-0212023e9f08 req-7f220e47-abd4-441c-9cec-7117e2a13fdd service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bfa1e74a-59ce-4ee0-ae72-0212023e9f08 req-7f220e47-abd4-441c-9cec-7117e2a13fdd service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bfa1e74a-59ce-4ee0-ae72-0212023e9f08 req-7f220e47-abd4-441c-9cec-7117e2a13fdd service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-bfa1e74a-59ce-4ee0-ae72-0212023e9f08 req-7f220e47-abd4-441c-9cec-7117e2a13fdd service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-bfa1e74a-59ce-4ee0-ae72-0212023e9f08 req-7f220e47-abd4-441c-9cec-7117e2a13fdd service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-unplugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updating instance_info_cache with network_info: [{"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-1ea93b31-f7c3-456f-aa99-113160704256" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 01:59:36 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Instance destroyed successfully.
Nov 29 01:59:36 user nova-compute[75210]: DEBUG nova.objects.instance [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'resources' on Instance uuid 13274e43-2984-4aa6-ad9b-23e3bbe7c959 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-355946989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-355946989',id=24,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:45:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-3t40l2p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:47:34Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=13274e43-2984-4aa6-ad9b-23e3bbe7c959,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "7a2f4623-853c-43d9-9964-d00e16199a0c", "address": "fa:16:3e:3d:a2:c4", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2f4623-85", "ovs_interfaceid": "7a2f4623-853c-43d9-9964-d00e16199a0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a2:c4,bridge_name='br-int',has_traffic_filtering=True,id=7a2f4623-853c-43d9-9964-d00e16199a0c,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2f4623-85') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_vif [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a2:c4,bridge_name='br-int',has_traffic_filtering=True,id=7a2f4623-853c-43d9-9964-d00e16199a0c,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2f4623-85') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a2f4623-85, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29d4dc11-8600-4af8-a103-720314ff2416) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:36 user nova-compute[75210]: INFO os_vif [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a2:c4,bridge_name='br-int',has_traffic_filtering=True,id=7a2f4623-853c-43d9-9964-d00e16199a0c,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2f4623-85')
Nov 29 01:59:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIiTrKbs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 01:59:36 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ae636d-df88-4088-9fe1-10721a25a6e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 01:59:36 user nova-compute[75210]: No targets found.
Nov 29 01:59:36 user nova-compute[75210]: iSNS:
Nov 29 01:59:36 user nova-compute[75210]: No targets found.
Nov 29 01:59:36 user nova-compute[75210]: STATIC:
Nov 29 01:59:36 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31
Nov 29 01:59:36 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:59:36 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:59:36 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256
Nov 29 01:59:36 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:59:36 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:59:36 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29
Nov 29 01:59:36 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:59:36 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:59:36 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193
Nov 29 01:59:36 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 01:59:36 user nova-compute[75210]:                 Iface Name: default
Nov 29 01:59:36 user nova-compute[75210]: FIRMWARE:
Nov 29 01:59:36 user nova-compute[75210]: No targets found.
Nov 29 01:59:36 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 01:59:36 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 01:59:36 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58afb8f-d4bb-4001-8d0e-2b4b08d48cd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[58076690-33c5-4256-89f6-6a6bf78d15dc]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:59:36 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:59:36 user nova-compute[75210]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 01:59:36 user nova-compute[75210]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:59:36 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 (non-flash)
Nov 29 01:59:36 user nova-compute[75210]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 01:59:36 user nova-compute[75210]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 01:59:36 user nova-compute[75210]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 01:59:36 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f24082d6d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc9e25c-190c-4050-a5a2-31e342b3f176]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e681fb-53cc-473d-9bcf-f09877a2a494]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6249a28-a59c-4a96-9528-5b6e916088d1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[271442d2-f072-4f91-a0d3-4cc07ba5fb3d]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a329a5-30b0-4bfa-9559-3463b0a064a9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a05e2ed-e216-479d-81f5-b7f6262d6da5]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29, portal: 172.16.0.220,3260]
Nov 29 01:59:36 user nova-compute[75210]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29, portal: 172.16.0.220,3260] successful.
Nov 29 01:59:36 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ecc5284-b9f3-4bc1-a19f-a2ca55318e29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bd6687-c460-4e9a-87f1-2b019bc05099]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] <== disconnect_volume: return (310ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 01:59:36 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Deleting instance files /opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959_del
Nov 29 01:59:36 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Deletion of /opt/stack/data/nova/instances/13274e43-2984-4aa6-ad9b-23e3bbe7c959_del complete
Nov 29 01:59:36 user nova-compute[75210]: INFO nova.compute.manager [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 29 01:59:36 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 01:59:36 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 01:59:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:37 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:59:37 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Took 0.44 seconds to deallocate network for instance.
Nov 29 01:59:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-181befed-873b-4214-ace9-3d629dcf304e req-8db7db28-f172-4363-8a10-513d1b3a4c36 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-deleted-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:59:37 user nova-compute[75210]: INFO nova.compute.manager [req-181befed-873b-4214-ace9-3d629dcf304e req-8db7db28-f172-4363-8a10-513d1b3a4c36 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Neutron deleted interface 7a2f4623-853c-43d9-9964-d00e16199a0c; detaching it from the instance and deleting it from the info cache
Nov 29 01:59:37 user nova-compute[75210]: DEBUG nova.network.neutron [req-181befed-873b-4214-ace9-3d629dcf304e req-8db7db28-f172-4363-8a10-513d1b3a4c36 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 01:59:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-181befed-873b-4214-ace9-3d629dcf304e req-8db7db28-f172-4363-8a10-513d1b3a4c36 service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Detach interface failed, port_id=7a2f4623-853c-43d9-9964-d00e16199a0c, reason: Instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 01:59:37 user nova-compute[75210]: INFO nova.compute.manager [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Took 0.77 seconds to detach 1 volumes for instance.
Nov 29 01:59:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-f244c787-c9f8-4c9c-8017-d38de039c5a2 req-3b537540-0e0e-4235-9f84-c9d23a5df40b service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 01:59:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f244c787-c9f8-4c9c-8017-d38de039c5a2 req-3b537540-0e0e-4235-9f84-c9d23a5df40b service nova] Acquiring lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f244c787-c9f8-4c9c-8017-d38de039c5a2 req-3b537540-0e0e-4235-9f84-c9d23a5df40b service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f244c787-c9f8-4c9c-8017-d38de039c5a2 req-3b537540-0e0e-4235-9f84-c9d23a5df40b service nova] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-f244c787-c9f8-4c9c-8017-d38de039c5a2 req-3b537540-0e0e-4235-9f84-c9d23a5df40b service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] No waiting events found dispatching network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 01:59:37 user nova-compute[75210]: WARNING nova.compute.manager [req-f244c787-c9f8-4c9c-8017-d38de039c5a2 req-3b537540-0e0e-4235-9f84-c9d23a5df40b service nova] [instance: 13274e43-2984-4aa6-ad9b-23e3bbe7c959] Received unexpected event network-vif-plugged-7a2f4623-853c-43d9-9964-d00e16199a0c for instance with vm_state active and task_state deleting.
Nov 29 01:59:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:38 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:59:38 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:59:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:38 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Deleted allocations for instance 13274e43-2984-4aa6-ad9b-23e3bbe7c959
Nov 29 01:59:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-28f74ab3-97a7-4e55-a09e-060f7bced6ac tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "13274e43-2984-4aa6-ad9b-23e3bbe7c959" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.837s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:39 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:59:39 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:59:39 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:59:39 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 01:59:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:41 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:59:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:59:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 01:59:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:42 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 01:59:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:59:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:59:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 01:59:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 01:59:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 01:59:44 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:59:44 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 01:59:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8296MB free_disk=25.18695068359375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 01:59:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 01:59:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 01:59:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 996b4364-9920-4b91-8a06-0b6f2c138aab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:59:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:59:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:59:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 1ea93b31-f7c3-456f-aa99-113160704256 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:59:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 48c1091b-67d1-4d0f-96e2-b6ccb8567466 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 01:59:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 01:59:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 01:59:44 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 01:59:44 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 01:59:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 01:59:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 01:59:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:59:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 01:59:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 01:59:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:59:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 01:59:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 01:59:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:00:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:00:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:00:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:00:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "1ea93b31-f7c3-456f-aa99-113160704256" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:04 user nova-compute[75210]: INFO nova.compute.manager [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Terminating instance
Nov 29 02:00:04 user nova-compute[75210]: DEBUG nova.compute.manager [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:00:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-9dbaf945-87d5-4a6f-9034-3490fe467e43 req-94ca8a5c-eccc-4bec-93ea-3218d7ffc0a1 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-unplugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9dbaf945-87d5-4a6f-9034-3490fe467e43 req-94ca8a5c-eccc-4bec-93ea-3218d7ffc0a1 service nova] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9dbaf945-87d5-4a6f-9034-3490fe467e43 req-94ca8a5c-eccc-4bec-93ea-3218d7ffc0a1 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9dbaf945-87d5-4a6f-9034-3490fe467e43 req-94ca8a5c-eccc-4bec-93ea-3218d7ffc0a1 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-9dbaf945-87d5-4a6f-9034-3490fe467e43 req-94ca8a5c-eccc-4bec-93ea-3218d7ffc0a1 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] No waiting events found dispatching network-vif-unplugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-9dbaf945-87d5-4a6f-9034-3490fe467e43 req-94ca8a5c-eccc-4bec-93ea-3218d7ffc0a1 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-unplugged-09497c00-460e-40af-942c-0c6f727dc0d8 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Instance destroyed successfully.
Nov 29 02:00:05 user nova-compute[75210]: DEBUG nova.objects.instance [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lazy-loading 'resources' on Instance uuid 1ea93b31-f7c3-456f-aa99-113160704256 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1869106097',display_name='tempest-ServerActionsTestOtherA-server-1869106097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1869106097',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0ZPcsrrZ0p77iZVF3hXrlbitPxsOMUk6lEgPtIOZB1sypvzBAvVGb9BhgWOjWjr7Z8pdmqoU3sXtItuyafViUIU/dnioTrc/zJIESKhxOMP7SI+ZANtu7hU2Hj6RuPWQ==',key_name='tempest-keypair-192951479',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:55:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-f9ddzge5',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:57:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=1ea93b31-f7c3-456f-aa99-113160704256,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "09497c00-460e-40af-942c-0c6f727dc0d8", "address": "fa:16:3e:3c:1d:c3", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09497c00-46", "ovs_interfaceid": "09497c00-460e-40af-942c-0c6f727dc0d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_vif [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09497c00-46, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b9c9145-cba3-4539-986f-50f442846ac2) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:05 user nova-compute[75210]: INFO os_vif [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:1d:c3,bridge_name='br-int',has_traffic_filtering=True,id=09497c00-460e-40af-942c-0c6f727dc0d8,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09497c00-46')
Nov 29 02:00:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JoewKfcm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:00:05 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3612eb1-0aeb-478d-bcdd-14b22c931360]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:00:05 user nova-compute[75210]: No targets found.
Nov 29 02:00:05 user nova-compute[75210]: iSNS:
Nov 29 02:00:05 user nova-compute[75210]: No targets found.
Nov 29 02:00:05 user nova-compute[75210]: STATIC:
Nov 29 02:00:05 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31
Nov 29 02:00:05 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:00:05 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:00:05 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256
Nov 29 02:00:05 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:00:05 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:00:05 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193
Nov 29 02:00:05 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:00:05 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:00:05 user nova-compute[75210]: FIRMWARE:
Nov 29 02:00:05 user nova-compute[75210]: No targets found.
Nov 29 02:00:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:00:05 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:00:05 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb175804-9ee0-4905-bbe5-b73a9559d640]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9ff273-bfc5-4859-99a3-e64d75970ee6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 02:00:05 user nova-compute[75210]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 02:00:05 user nova-compute[75210]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 02:00:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 (non-flash)
Nov 29 02:00:05 user nova-compute[75210]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 02:00:05 user nova-compute[75210]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 02:00:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f240811bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f291f8-a82c-4d0f-8132-e6b9ddc6494c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[814910d5-7fab-4a49-b5df-b9bc825956b7]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef82cfa1-8941-4be2-9649-8fc84028fa43]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc88d464-5ecd-46ef-82cc-9cce7d0b60a8]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26137353830346236', '/dev/disk/by-id/scsi-1SCST_BIOce614499-a75804b64726b5d6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ce614499') {{(pid=85542) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[21450d11-4262-4261-81e1-751b2b013a20]: (4, None) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb49578-f15d-4f9e-9eea-d8e7247cd2dc]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9c0843-cc7f-4365-88cd-f1f356c6a8ce]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260]
Nov 29 02:00:05 user nova-compute[75210]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256, portal: 172.16.0.220,3260] successful.
Nov 29 02:00:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e623ee5d-9e4f-4444-af26-0fc9dd480256 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdc7219-37b7-4a8c-8df9-f8e74ec49c9e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] <== disconnect_volume: return (361ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:00:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Deleting instance files /opt/stack/data/nova/instances/1ea93b31-f7c3-456f-aa99-113160704256_del
Nov 29 02:00:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Deletion of /opt/stack/data/nova/instances/1ea93b31-f7c3-456f-aa99-113160704256_del complete
Nov 29 02:00:05 user nova-compute[75210]: INFO nova.compute.manager [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 29 02:00:05 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:00:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:06 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:00:06 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Took 0.73 seconds to deallocate network for instance.
Nov 29 02:00:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-69772b8b-26b0-4e5b-8782-6c4c803dd293 req-4306befe-f672-4d62-bb2f-674ef94744bc service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-deleted-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:06 user nova-compute[75210]: INFO nova.compute.manager [req-69772b8b-26b0-4e5b-8782-6c4c803dd293 req-4306befe-f672-4d62-bb2f-674ef94744bc service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Neutron deleted interface 09497c00-460e-40af-942c-0c6f727dc0d8; detaching it from the instance and deleting it from the info cache
Nov 29 02:00:06 user nova-compute[75210]: DEBUG nova.network.neutron [req-69772b8b-26b0-4e5b-8782-6c4c803dd293 req-4306befe-f672-4d62-bb2f-674ef94744bc service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:00:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-69772b8b-26b0-4e5b-8782-6c4c803dd293 req-4306befe-f672-4d62-bb2f-674ef94744bc service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Detach interface failed, port_id=09497c00-460e-40af-942c-0c6f727dc0d8, reason: Instance 1ea93b31-f7c3-456f-aa99-113160704256 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] No waiting events found dispatching network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:00:07 user nova-compute[75210]: WARNING nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received unexpected event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 for instance with vm_state active and task_state deleting.
Nov 29 02:00:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] No waiting events found dispatching network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:00:07 user nova-compute[75210]: WARNING nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received unexpected event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 for instance with vm_state active and task_state deleting.
Nov 29 02:00:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] No waiting events found dispatching network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:00:07 user nova-compute[75210]: WARNING nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received unexpected event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 for instance with vm_state active and task_state deleting.
Nov 29 02:00:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-unplugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] No waiting events found dispatching network-vif-unplugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-unplugged-09497c00-460e-40af-942c-0c6f727dc0d8 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Acquiring lock "1ea93b31-f7c3-456f-aa99-113160704256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] Lock "1ea93b31-f7c3-456f-aa99-113160704256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] No waiting events found dispatching network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:00:07 user nova-compute[75210]: WARNING nova.compute.manager [req-e1e2176c-7498-4ad3-8ae0-62371f909408 req-c8dbfe74-b983-4094-a5f3-8bf85a668c36 service nova] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Received unexpected event network-vif-plugged-09497c00-460e-40af-942c-0c6f727dc0d8 for instance with vm_state active and task_state deleting.
Nov 29 02:00:07 user nova-compute[75210]: INFO nova.compute.manager [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Took 1.31 seconds to detach 1 volumes for instance.
Nov 29 02:00:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 1ea93b31-f7c3-456f-aa99-113160704256] Deleting volume: e623ee5d-9e4f-4444-af26-0fc9dd480256 {{(pid=75210) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:08 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:00:08 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:00:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:08 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Deleted allocations for instance 1ea93b31-f7c3-456f-aa99-113160704256
Nov 29 02:00:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-def66338-3d73-4b89-ab58-7035364e8948 tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "1ea93b31-f7c3-456f-aa99-113160704256" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.799s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-76502336-1ac6-4b75-acb3-c3f4046218bf req-6e9b85c8-c519-4401-ac68-960405debc53 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Received event network-changed-a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-76502336-1ac6-4b75-acb3-c3f4046218bf req-6e9b85c8-c519-4401-ac68-960405debc53 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Refreshing instance network info cache due to event network-changed-a00c75af-2d11-4e42-a2bf-c22357008629. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:00:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-76502336-1ac6-4b75-acb3-c3f4046218bf req-6e9b85c8-c519-4401-ac68-960405debc53 service nova] Acquiring lock "refresh_cache-48c1091b-67d1-4d0f-96e2-b6ccb8567466" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:00:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-76502336-1ac6-4b75-acb3-c3f4046218bf req-6e9b85c8-c519-4401-ac68-960405debc53 service nova] Acquired lock "refresh_cache-48c1091b-67d1-4d0f-96e2-b6ccb8567466" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:00:11 user nova-compute[75210]: DEBUG nova.network.neutron [req-76502336-1ac6-4b75-acb3-c3f4046218bf req-6e9b85c8-c519-4401-ac68-960405debc53 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Refreshing network info cache for port a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:00:12 user nova-compute[75210]: DEBUG nova.network.neutron [req-76502336-1ac6-4b75-acb3-c3f4046218bf req-6e9b85c8-c519-4401-ac68-960405debc53 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Updated VIF entry in instance network info cache for port a00c75af-2d11-4e42-a2bf-c22357008629. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:00:12 user nova-compute[75210]: DEBUG nova.network.neutron [req-76502336-1ac6-4b75-acb3-c3f4046218bf req-6e9b85c8-c519-4401-ac68-960405debc53 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Updating instance_info_cache with network_info: [{"id": "a00c75af-2d11-4e42-a2bf-c22357008629", "address": "fa:16:3e:ea:a3:85", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c75af-2d", "ovs_interfaceid": "a00c75af-2d11-4e42-a2bf-c22357008629", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:00:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-76502336-1ac6-4b75-acb3-c3f4046218bf req-6e9b85c8-c519-4401-ac68-960405debc53 service nova] Releasing lock "refresh_cache-48c1091b-67d1-4d0f-96e2-b6ccb8567466" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:00:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:19 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:00:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:00:19 user nova-compute[75210]: INFO nova.compute.claims [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Claim successful on node user
Nov 29 02:00:19 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:00:19 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:00:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:19 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:00:19 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:00:19 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:00:19 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:00:19 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:00:19 user nova-compute[75210]: INFO nova.virt.block_device [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Booting with volume snapshot efac62c7-d8ae-46e2-9633-6fab847f56b3 at /dev/vda
Nov 29 02:00:19 user nova-compute[75210]: DEBUG nova.policy [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '080bcd228b454b03995b0f3e116df917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70d8cbb4232433cbd0db9e9448d897f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:00:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:20 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Successfully created port: dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Successfully updated port: dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "refresh_cache-fbb4ed42-4fd2-4edb-adcb-85afa3d48672" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquired lock "refresh_cache-fbb4ed42-4fd2-4edb-adcb-85afa3d48672" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-31aeef32-cb30-43d2-b9f0-53a5b70fd825 req-1e8343d2-2fa8-4ffc-a2f3-1cfb194c2666 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Received event network-changed-dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-31aeef32-cb30-43d2-b9f0-53a5b70fd825 req-1e8343d2-2fa8-4ffc-a2f3-1cfb194c2666 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Refreshing instance network info cache due to event network-changed-dcc05e13-3504-40d7-a85a-5cd1f2624276. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-31aeef32-cb30-43d2-b9f0-53a5b70fd825 req-1e8343d2-2fa8-4ffc-a2f3-1cfb194c2666 service nova] Acquiring lock "refresh_cache-fbb4ed42-4fd2-4edb-adcb-85afa3d48672" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Updating instance_info_cache with network_info: [{"id": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "address": "fa:16:3e:e5:7c:f6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc05e13-35", "ovs_interfaceid": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Releasing lock "refresh_cache-fbb4ed42-4fd2-4edb-adcb-85afa3d48672" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Instance network_info: |[{"id": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "address": "fa:16:3e:e5:7c:f6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc05e13-35", "ovs_interfaceid": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-31aeef32-cb30-43d2-b9f0-53a5b70fd825 req-1e8343d2-2fa8-4ffc-a2f3-1cfb194c2666 service nova] Acquired lock "refresh_cache-fbb4ed42-4fd2-4edb-adcb-85afa3d48672" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:00:21 user nova-compute[75210]: DEBUG nova.network.neutron [req-31aeef32-cb30-43d2-b9f0-53a5b70fd825 req-1e8343d2-2fa8-4ffc-a2f3-1cfb194c2666 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Refreshing network info cache for port dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:00:22 user nova-compute[75210]: DEBUG nova.network.neutron [req-31aeef32-cb30-43d2-b9f0-53a5b70fd825 req-1e8343d2-2fa8-4ffc-a2f3-1cfb194c2666 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Updated VIF entry in instance network info cache for port dcc05e13-3504-40d7-a85a-5cd1f2624276. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:00:22 user nova-compute[75210]: DEBUG nova.network.neutron [req-31aeef32-cb30-43d2-b9f0-53a5b70fd825 req-1e8343d2-2fa8-4ffc-a2f3-1cfb194c2666 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Updating instance_info_cache with network_info: [{"id": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "address": "fa:16:3e:e5:7c:f6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc05e13-35", "ovs_interfaceid": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:00:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-31aeef32-cb30-43d2-b9f0-53a5b70fd825 req-1e8343d2-2fa8-4ffc-a2f3-1cfb194c2666 service nova] Releasing lock "refresh_cache-fbb4ed42-4fd2-4edb-adcb-85afa3d48672" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG os_brick.utils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ff87c9-978a-4853-8464-d2b9fcc522c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f4da38-8218-4efd-8c03-27dc285dab46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cca99ec-f3a7-4974-918f-fb5525fa6099]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a72fd1-26e9-4225-9862-9aa63823c85f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:00:25 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:00:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[154095bb-3259-4922-bf6d-72e3e0301eac]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG os_brick.utils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:00:25 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Updating existing volume attachment record: d575f930-097e-4b75-8905-a9def9deb7a9 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "996b4364-9920-4b91-8a06-0b6f2c138aab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:26 user nova-compute[75210]: INFO nova.compute.manager [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Terminating instance
Nov 29 02:00:26 user nova-compute[75210]: DEBUG nova.compute.manager [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-d357b81c-d1b0-4835-ac3c-6050867963d2 req-b937c32f-3b8a-451f-ad54-06b333872b77 service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Received event network-vif-unplugged-7dba9f4e-29b3-4b8b-94e3-70b343004fcb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d357b81c-d1b0-4835-ac3c-6050867963d2 req-b937c32f-3b8a-451f-ad54-06b333872b77 service nova] Acquiring lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d357b81c-d1b0-4835-ac3c-6050867963d2 req-b937c32f-3b8a-451f-ad54-06b333872b77 service nova] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d357b81c-d1b0-4835-ac3c-6050867963d2 req-b937c32f-3b8a-451f-ad54-06b333872b77 service nova] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-d357b81c-d1b0-4835-ac3c-6050867963d2 req-b937c32f-3b8a-451f-ad54-06b333872b77 service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] No waiting events found dispatching network-vif-unplugged-7dba9f4e-29b3-4b8b-94e3-70b343004fcb {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:00:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-d357b81c-d1b0-4835-ac3c-6050867963d2 req-b937c32f-3b8a-451f-ad54-06b333872b77 service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Received event network-vif-unplugged-7dba9f4e-29b3-4b8b-94e3-70b343004fcb for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:00:27 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Instance destroyed successfully.
Nov 29 02:00:27 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lazy-loading 'resources' on Instance uuid 996b4364-9920-4b91-8a06-0b6f2c138aab {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:40:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1597633535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1597633535',id=15,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34af8bfc0e1b4cbbb803c3bf6a8f7715',ramdisk_id='',reservation_id='r-4hnwwrkm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-440893694',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:42:45Z,user_data=None,user_id='28fd6f01158e4dd7a7df3e04e815a9d0',uuid=996b4364-9920-4b91-8a06-0b6f2c138aab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "address": "fa:16:3e:e0:7c:09", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dba9f4e-29", "ovs_interfaceid": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converting VIF {"id": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "address": "fa:16:3e:e0:7c:09", "network": {"id": "6d49803b-27ee-4a01-8e8e-b4cec14f6ae3", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-771023293-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34af8bfc0e1b4cbbb803c3bf6a8f7715", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dba9f4e-29", "ovs_interfaceid": "7dba9f4e-29b3-4b8b-94e3-70b343004fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7c:09,bridge_name='br-int',has_traffic_filtering=True,id=7dba9f4e-29b3-4b8b-94e3-70b343004fcb,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dba9f4e-29') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG os_vif [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7c:09,bridge_name='br-int',has_traffic_filtering=True,id=7dba9f4e-29b3-4b8b-94e3-70b343004fcb,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dba9f4e-29') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dba9f4e-29, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bec944cf-6a7c-48cb-9d91-414c77a5a647) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:00:27 user nova-compute[75210]: INFO os_vif [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7c:09,bridge_name='br-int',has_traffic_filtering=True,id=7dba9f4e-29b3-4b8b-94e3-70b343004fcb,network=Network(6d49803b-27ee-4a01-8e8e-b4cec14f6ae3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dba9f4e-29')
Nov 29 02:00:27 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Deleting instance files /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab_del
Nov 29 02:00:27 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Deletion of /opt/stack/data/nova/instances/996b4364-9920-4b91-8a06-0b6f2c138aab_del complete
Nov 29 02:00:27 user nova-compute[75210]: INFO nova.compute.manager [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 02:00:27 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:00:27 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Took 0.66 seconds to deallocate network for instance.
Nov 29 02:00:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:28 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:00:28 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:00:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:28 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Deleted allocations for instance 996b4364-9920-4b91-8a06-0b6f2c138aab
Nov 29 02:00:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2554dd0c-f189-4f01-9722-69a236f57b5a tempest-ServerBootFromVolumeStableRescueTest-440893694 tempest-ServerBootFromVolumeStableRescueTest-440893694-project-member] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.082s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-87843fdf-3fa7-47eb-994e-71db0e2373e6 req-4189d64e-13b5-410f-aadd-6733ad829704 service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Received event network-vif-plugged-7dba9f4e-29b3-4b8b-94e3-70b343004fcb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-87843fdf-3fa7-47eb-994e-71db0e2373e6 req-4189d64e-13b5-410f-aadd-6733ad829704 service nova] Acquiring lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-87843fdf-3fa7-47eb-994e-71db0e2373e6 req-4189d64e-13b5-410f-aadd-6733ad829704 service nova] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-87843fdf-3fa7-47eb-994e-71db0e2373e6 req-4189d64e-13b5-410f-aadd-6733ad829704 service nova] Lock "996b4364-9920-4b91-8a06-0b6f2c138aab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-87843fdf-3fa7-47eb-994e-71db0e2373e6 req-4189d64e-13b5-410f-aadd-6733ad829704 service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] No waiting events found dispatching network-vif-plugged-7dba9f4e-29b3-4b8b-94e3-70b343004fcb {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:00:28 user nova-compute[75210]: WARNING nova.compute.manager [req-87843fdf-3fa7-47eb-994e-71db0e2373e6 req-4189d64e-13b5-410f-aadd-6733ad829704 service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Received unexpected event network-vif-plugged-7dba9f4e-29b3-4b8b-94e3-70b343004fcb for instance with vm_state deleted and task_state None.
Nov 29 02:00:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-87843fdf-3fa7-47eb-994e-71db0e2373e6 req-4189d64e-13b5-410f-aadd-6733ad829704 service nova] [instance: 996b4364-9920-4b91-8a06-0b6f2c138aab] Received event network-vif-deleted-7dba9f4e-29b3-4b8b-94e3-70b343004fcb {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:00:33 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Creating image(s)
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Ensure instance console log exists: /opt/stack/data/nova/instances/fbb4ed42-4fd2-4edb-adcb-85afa3d48672/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Start _get_guest_xml network_info=[{"id": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "address": "fa:16:3e:e5:7c:f6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc05e13-35", "ovs_interfaceid": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T02:00:14Z,direct_url=<?>,disk_format='qcow2',id=24d4fdee-28ab-42ee-afdc-112aae06ec1e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1367113074',owner='f70d8cbb4232433cbd0db9e9448d897f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T02:00:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'd575f930-097e-4b75-8905-a9def9deb7a9', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUbTvIFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fbb4ed42-4fd2-4edb-adcb-85afa3d48672', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb7deae5-0b8a-49ae-831e-238e56a33596', 'serial': 'bb7deae5-0b8a-49ae-831e-238e56a33596'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:00:33 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:00:33 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-29T02:00:14Z,direct_url=<?>,disk_format='qcow2',id=24d4fdee-28ab-42ee-afdc-112aae06ec1e,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1367113074',owner='f70d8cbb4232433cbd0db9e9448d897f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-29T02:00:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUbTvIFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:00:33 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:00:33 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:00:33 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf9a962-2193-4742-a62b-84fad432377d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:00:33 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa3458b-276f-4bd3-83c9-c50721951dde]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596] added
Nov 29 02:00:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcae079-edc5-45b6-bef7-0752df468cd3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5748c5b-869e-40d3-9f01-f30149100819]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUbTvIFz {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AUbTvIFz" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e7a124-4e50-4eba-a56a-bfa6b1a6d610]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AUbTvIFz'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[22538aa2-9870-42fb-b480-1bfe8eacfeec]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2a8503-19da-4952-9027-531f6682c9f6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 02:00:33 user nova-compute[75210]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 02:00:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 02:00:33 user nova-compute[75210]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 02:00:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df90daa-eef1-4f28-a97c-c6872dbd498e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596, portal: 172.16.0.220,3260]
Nov 29 02:00:33 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596, portal: 172.16.0.220,3260] successful.
Nov 29 02:00:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[661d6255-7e03-4d2b-b05a-554c600aca80]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f114437-6499-4952-9e16-2d5a1e2f91d6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 02:00:33 user nova-compute[75210]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 02:00:33 user nova-compute[75210]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 (non-flash)
Nov 29 02:00:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 02:00:33 user nova-compute[75210]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 02:00:33 user nova-compute[75210]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 (non-flash)
Nov 29 02:00:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba6a7df-9caf-4c98-bdd9-6818f8311703]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:00:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUbTvIFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23835633538396438', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835633538396438', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-25974572',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-25974572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-25974572',id=39,image_ref='24d4fdee-28ab-42ee-afdc-112aae06ec1e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuqwU8c41GAsrSEwILQRdwupCl/Nw1XQwob47iPHMoW4nCkFlYu7kw0SCLla6NsQNOlhLvv3HFoYa2TNvwSLYjmr3HglcHAnmCHIoHVhxTAUQOja6iTJy/xu5yBaXHM+A==',key_name='tempest-keypair-62292304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-3mx3x5c6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-670838009',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='080bcd228b454b03995b0f3e116df917',uuid=fbb4ed42-4fd2-4edb-adcb-85afa3d48672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "address": "fa:16:3e:e5:7c:f6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc05e13-35", "ovs_interfaceid": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "address": "fa:16:3e:e5:7c:f6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc05e13-35", "ovs_interfaceid": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7c:f6,bridge_name='br-int',has_traffic_filtering=True,id=dcc05e13-3504-40d7-a85a-5cd1f2624276,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc05e13-35') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG nova.objects.instance [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lazy-loading 'pci_devices' on Instance uuid fbb4ed42-4fd2-4edb-adcb-85afa3d48672 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:00:34 user nova-compute[75210]:   <uuid>fbb4ed42-4fd2-4edb-adcb-85afa3d48672</uuid>
Nov 29 02:00:34 user nova-compute[75210]:   <name>instance-00000027</name>
Nov 29 02:00:34 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:00:34 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:00:34 user nova-compute[75210]:   <metadata>
Nov 29 02:00:34 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:00:34 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:00:34 user nova-compute[75210]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-25974572</nova:name>
Nov 29 02:00:34 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:00:33</nova:creationTime>
Nov 29 02:00:34 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:00:34 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:00:34 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:00:34 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:00:34 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:00:34 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:00:34 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:00:34 user nova-compute[75210]:       <nova:owner>
Nov 29 02:00:34 user nova-compute[75210]:         <nova:user uuid="080bcd228b454b03995b0f3e116df917">tempest-TestVolumeBootPattern-670838009-project-member</nova:user>
Nov 29 02:00:34 user nova-compute[75210]:         <nova:project uuid="f70d8cbb4232433cbd0db9e9448d897f">tempest-TestVolumeBootPattern-670838009</nova:project>
Nov 29 02:00:34 user nova-compute[75210]:       </nova:owner>
Nov 29 02:00:34 user nova-compute[75210]:       <nova:root type="image" uuid="24d4fdee-28ab-42ee-afdc-112aae06ec1e"/>
Nov 29 02:00:34 user nova-compute[75210]:       <nova:ports>
Nov 29 02:00:34 user nova-compute[75210]:         <nova:port uuid="dcc05e13-3504-40d7-a85a-5cd1f2624276">
Nov 29 02:00:34 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 02:00:34 user nova-compute[75210]:         </nova:port>
Nov 29 02:00:34 user nova-compute[75210]:       </nova:ports>
Nov 29 02:00:34 user nova-compute[75210]:     </nova:instance>
Nov 29 02:00:34 user nova-compute[75210]:   </metadata>
Nov 29 02:00:34 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:00:34 user nova-compute[75210]:     <system>
Nov 29 02:00:34 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:00:34 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:00:34 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:00:34 user nova-compute[75210]:       <entry name="serial">fbb4ed42-4fd2-4edb-adcb-85afa3d48672</entry>
Nov 29 02:00:34 user nova-compute[75210]:       <entry name="uuid">fbb4ed42-4fd2-4edb-adcb-85afa3d48672</entry>
Nov 29 02:00:34 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:00:34 user nova-compute[75210]:     </system>
Nov 29 02:00:34 user nova-compute[75210]:   </sysinfo>
Nov 29 02:00:34 user nova-compute[75210]:   <os>
Nov 29 02:00:34 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:00:34 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:00:34 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:00:34 user nova-compute[75210]:   </os>
Nov 29 02:00:34 user nova-compute[75210]:   <features>
Nov 29 02:00:34 user nova-compute[75210]:     <acpi/>
Nov 29 02:00:34 user nova-compute[75210]:     <apic/>
Nov 29 02:00:34 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:00:34 user nova-compute[75210]:   </features>
Nov 29 02:00:34 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:00:34 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:00:34 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:00:34 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:00:34 user nova-compute[75210]:   </clock>
Nov 29 02:00:34 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:00:34 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:00:34 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:00:34 user nova-compute[75210]:   </cpu>
Nov 29 02:00:34 user nova-compute[75210]:   <devices>
Nov 29 02:00:34 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 02:00:34 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:00:34 user nova-compute[75210]:       <source dev="/dev/sdb"/>
Nov 29 02:00:34 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:00:34 user nova-compute[75210]:       <serial>bb7deae5-0b8a-49ae-831e-238e56a33596</serial>
Nov 29 02:00:34 user nova-compute[75210]:     </disk>
Nov 29 02:00:34 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:00:34 user nova-compute[75210]:       <mac address="fa:16:3e:e5:7c:f6"/>
Nov 29 02:00:34 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:00:34 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:00:34 user nova-compute[75210]:       <target dev="tapdcc05e13-35"/>
Nov 29 02:00:34 user nova-compute[75210]:     </interface>
Nov 29 02:00:34 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:00:34 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/fbb4ed42-4fd2-4edb-adcb-85afa3d48672/console.log" append="off"/>
Nov 29 02:00:34 user nova-compute[75210]:     </serial>
Nov 29 02:00:34 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:00:34 user nova-compute[75210]:     <video>
Nov 29 02:00:34 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:00:34 user nova-compute[75210]:     </video>
Nov 29 02:00:34 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:00:34 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:00:34 user nova-compute[75210]:     </rng>
Nov 29 02:00:34 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:00:34 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:00:34 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:00:34 user nova-compute[75210]:     </memballoon>
Nov 29 02:00:34 user nova-compute[75210]:   </devices>
Nov 29 02:00:34 user nova-compute[75210]: </domain>
Nov 29 02:00:34 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-25974572',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-25974572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-25974572',id=39,image_ref='24d4fdee-28ab-42ee-afdc-112aae06ec1e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuqwU8c41GAsrSEwILQRdwupCl/Nw1XQwob47iPHMoW4nCkFlYu7kw0SCLla6NsQNOlhLvv3HFoYa2TNvwSLYjmr3HglcHAnmCHIoHVhxTAUQOja6iTJy/xu5yBaXHM+A==',key_name='tempest-keypair-62292304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-3mx3x5c6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-670838009',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:00:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='080bcd228b454b03995b0f3e116df917',uuid=fbb4ed42-4fd2-4edb-adcb-85afa3d48672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "address": "fa:16:3e:e5:7c:f6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc05e13-35", "ovs_interfaceid": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "address": "fa:16:3e:e5:7c:f6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc05e13-35", "ovs_interfaceid": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7c:f6,bridge_name='br-int',has_traffic_filtering=True,id=dcc05e13-3504-40d7-a85a-5cd1f2624276,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc05e13-35') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG os_vif [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7c:f6,bridge_name='br-int',has_traffic_filtering=True,id=dcc05e13-3504-40d7-a85a-5cd1f2624276,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc05e13-35') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '783751f2-fa03-590d-bb27-e798aa32ca51', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcc05e13-35, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcc05e13-35, col_values=(('qos', UUID('e3f4d347-27d8-45f2-a039-13b5c2f7e364')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcc05e13-35, col_values=(('external_ids', {'iface-id': 'dcc05e13-3504-40d7-a85a-5cd1f2624276', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:7c:f6', 'vm-uuid': 'fbb4ed42-4fd2-4edb-adcb-85afa3d48672'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:34 user nova-compute[75210]: INFO os_vif [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7c:f6,bridge_name='br-int',has_traffic_filtering=True,id=dcc05e13-3504-40d7-a85a-5cd1f2624276,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc05e13-35')
Nov 29 02:00:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:00:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] No VIF found with MAC fa:16:3e:e5:7c:f6, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-8eb54c50-b0f6-4bb3-907d-c4f439398426 req-3da5ff94-32e8-4282-9087-6bc058c62bbc service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Received event network-vif-plugged-dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8eb54c50-b0f6-4bb3-907d-c4f439398426 req-3da5ff94-32e8-4282-9087-6bc058c62bbc service nova] Acquiring lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8eb54c50-b0f6-4bb3-907d-c4f439398426 req-3da5ff94-32e8-4282-9087-6bc058c62bbc service nova] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8eb54c50-b0f6-4bb3-907d-c4f439398426 req-3da5ff94-32e8-4282-9087-6bc058c62bbc service nova] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-8eb54c50-b0f6-4bb3-907d-c4f439398426 req-3da5ff94-32e8-4282-9087-6bc058c62bbc service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] No waiting events found dispatching network-vif-plugged-dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:00:36 user nova-compute[75210]: WARNING nova.compute.manager [req-8eb54c50-b0f6-4bb3-907d-c4f439398426 req-3da5ff94-32e8-4282-9087-6bc058c62bbc service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Received unexpected event network-vif-plugged-dcc05e13-3504-40d7-a85a-5cd1f2624276 for instance with vm_state building and task_state spawning.
Nov 29 02:00:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:00:36 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:00:37 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updating instance_info_cache with network_info: [{"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:00:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:00:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:00:38 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:00:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:00:38 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Instance spawned successfully.
Nov 29 02:00:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:00:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:00:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:00:38 user nova-compute[75210]: INFO nova.compute.manager [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 29 02:00:38 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:00:38 user nova-compute[75210]: INFO nova.compute.manager [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Took 18.93 seconds to build instance.
Nov 29 02:00:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-d5059415-7bcd-40e2-809b-d3c703de2f5f req-8878079c-6762-44f3-a7be-5058c0fe6b4a service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Received event network-vif-plugged-dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d5059415-7bcd-40e2-809b-d3c703de2f5f req-8878079c-6762-44f3-a7be-5058c0fe6b4a service nova] Acquiring lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d5059415-7bcd-40e2-809b-d3c703de2f5f req-8878079c-6762-44f3-a7be-5058c0fe6b4a service nova] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d5059415-7bcd-40e2-809b-d3c703de2f5f req-8878079c-6762-44f3-a7be-5058c0fe6b4a service nova] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-d5059415-7bcd-40e2-809b-d3c703de2f5f req-8878079c-6762-44f3-a7be-5058c0fe6b4a service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] No waiting events found dispatching network-vif-plugged-dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:00:38 user nova-compute[75210]: WARNING nova.compute.manager [req-d5059415-7bcd-40e2-809b-d3c703de2f5f req-8878079c-6762-44f3-a7be-5058c0fe6b4a service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Received unexpected event network-vif-plugged-dcc05e13-3504-40d7-a85a-5cd1f2624276 for instance with vm_state active and task_state None.
Nov 29 02:00:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5c0645a4-c8ac-4678-b7ac-575e29d28ffa tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.085s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:40 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:00:40 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:00:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:41 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:00:41 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:00:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:00:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:44 user nova-compute[75210]: INFO nova.compute.manager [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Detaching volume 031d4ab6-fdf7-4f6f-84ce-425506889b31
Nov 29 02:00:44 user nova-compute[75210]: INFO nova.virt.block_device [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Attempting to driver detach volume 031d4ab6-fdf7-4f6f-84ce-425506889b31 from mountpoint /dev/vdb
Nov 29 02:00:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Attempting to detach device vdb from instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:00:44 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:00:44 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 02:00:44 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:00:44 user nova-compute[75210]:   <serial>031d4ab6-fdf7-4f6f-84ce-425506889b31</serial>
Nov 29 02:00:44 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 02:00:44 user nova-compute[75210]: </disk>
Nov 29 02:00:44 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:00:44 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully detached device vdb from instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa from the persistent domain config.
Nov 29 02:00:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:00:44 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:00:44 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 02:00:44 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:00:44 user nova-compute[75210]:   <serial>031d4ab6-fdf7-4f6f-84ce-425506889b31</serial>
Nov 29 02:00:44 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 02:00:44 user nova-compute[75210]: </disk>
Nov 29 02:00:44 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:00:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:00:45 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:00:45 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:00:45 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8448MB free_disk=25.30799102783203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 48c1091b-67d1-4d0f-96e2-b6ccb8567466 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fbb4ed42-4fd2-4edb-adcb-85afa3d48672 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:00:45 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:00:46 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:00:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:00:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:59 user nova-compute[75210]: INFO nova.compute.manager [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Terminating instance
Nov 29 02:00:59 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG nova.compute.manager [req-10384a7b-e372-4553-99d1-5651fa9f66c1 req-ffcf76d5-61f8-4327-a58e-7c947b2d6c82 service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Received event network-vif-unplugged-91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-10384a7b-e372-4553-99d1-5651fa9f66c1 req-ffcf76d5-61f8-4327-a58e-7c947b2d6c82 service nova] Acquiring lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-10384a7b-e372-4553-99d1-5651fa9f66c1 req-ffcf76d5-61f8-4327-a58e-7c947b2d6c82 service nova] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-10384a7b-e372-4553-99d1-5651fa9f66c1 req-ffcf76d5-61f8-4327-a58e-7c947b2d6c82 service nova] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG nova.compute.manager [req-10384a7b-e372-4553-99d1-5651fa9f66c1 req-ffcf76d5-61f8-4327-a58e-7c947b2d6c82 service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] No waiting events found dispatching network-vif-unplugged-91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG nova.compute.manager [req-10384a7b-e372-4553-99d1-5651fa9f66c1 req-ffcf76d5-61f8-4327-a58e-7c947b2d6c82 service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Received event network-vif-unplugged-91762155-8cec-4ac5-aeea-fe198c706136 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:00:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:00 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Instance destroyed successfully.
Nov 29 02:01:00 user nova-compute[75210]: DEBUG nova.objects.instance [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lazy-loading 'resources' on Instance uuid 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:42:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-987495974',display_name='tempest-ServerActionsTestOtherA-server-987495974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-987495974',id=18,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0ZPcsrrZ0p77iZVF3hXrlbitPxsOMUk6lEgPtIOZB1sypvzBAvVGb9BhgWOjWjr7Z8pdmqoU3sXtItuyafViUIU/dnioTrc/zJIESKhxOMP7SI+ZANtu7hU2Hj6RuPWQ==',key_name='tempest-keypair-192951479',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:42:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30940563d2c94d87b2e350faf4d0c5b0',ramdisk_id='',reservation_id='r-cn58y5m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1921082789',owner_user_name='tempest-ServerActionsTestOtherA-1921082789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:42:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d98e0c98f554dd5b8a84f9b3933cf1a',uuid=3042fea8-4bfc-4ae1-8f06-e0a39bd362e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converting VIF {"id": "91762155-8cec-4ac5-aeea-fe198c706136", "address": "fa:16:3e:90:e6:d1", "network": {"id": "519dd04c-bcd9-4854-aa4c-b0d1da2492f5", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1066097154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30940563d2c94d87b2e350faf4d0c5b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91762155-8c", "ovs_interfaceid": "91762155-8cec-4ac5-aeea-fe198c706136", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:e6:d1,bridge_name='br-int',has_traffic_filtering=True,id=91762155-8cec-4ac5-aeea-fe198c706136,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91762155-8c') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG os_vif [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:e6:d1,bridge_name='br-int',has_traffic_filtering=True,id=91762155-8cec-4ac5-aeea-fe198c706136,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91762155-8c') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91762155-8c, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=449e98e3-96dd-4a7e-835a-0235d06cb8ba) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:01:00 user nova-compute[75210]: INFO os_vif [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:e6:d1,bridge_name='br-int',has_traffic_filtering=True,id=91762155-8cec-4ac5-aeea-fe198c706136,network=Network(519dd04c-bcd9-4854-aa4c-b0d1da2492f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91762155-8c')
Nov 29 02:01:00 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Deleting instance files /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5_del
Nov 29 02:01:00 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Deletion of /opt/stack/data/nova/instances/3042fea8-4bfc-4ae1-8f06-e0a39bd362e5_del complete
Nov 29 02:01:00 user nova-compute[75210]: INFO nova.compute.manager [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Took 0.80 seconds to destroy the instance on the hypervisor.
Nov 29 02:01:00 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:01:00 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Took 0.46 seconds to deallocate network for instance.
Nov 29 02:01:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-641cc45f-804d-45f6-a72e-4b479b9b3141 req-4dfae2da-70ce-481e-86da-bba811fcc7e7 service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Received event network-vif-deleted-91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:01:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:00 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Deleted allocations for instance 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5
Nov 29 02:01:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9dfde954-b41f-4b4a-923f-e643832641ab tempest-ServerActionsTestOtherA-1921082789 tempest-ServerActionsTestOtherA-1921082789-project-member] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.637s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-355050d1-092a-4114-a008-1342a2b63be0 req-6536c6c9-70e2-4c69-a03a-980c076d6448 service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Received event network-vif-plugged-91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:01:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-355050d1-092a-4114-a008-1342a2b63be0 req-6536c6c9-70e2-4c69-a03a-980c076d6448 service nova] Acquiring lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-355050d1-092a-4114-a008-1342a2b63be0 req-6536c6c9-70e2-4c69-a03a-980c076d6448 service nova] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-355050d1-092a-4114-a008-1342a2b63be0 req-6536c6c9-70e2-4c69-a03a-980c076d6448 service nova] Lock "3042fea8-4bfc-4ae1-8f06-e0a39bd362e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-355050d1-092a-4114-a008-1342a2b63be0 req-6536c6c9-70e2-4c69-a03a-980c076d6448 service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] No waiting events found dispatching network-vif-plugged-91762155-8cec-4ac5-aeea-fe198c706136 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:01:01 user nova-compute[75210]: WARNING nova.compute.manager [req-355050d1-092a-4114-a008-1342a2b63be0 req-6536c6c9-70e2-4c69-a03a-980c076d6448 service nova] [instance: 3042fea8-4bfc-4ae1-8f06-e0a39bd362e5] Received unexpected event network-vif-plugged-91762155-8cec-4ac5-aeea-fe198c706136 for instance with vm_state deleted and task_state None.
Nov 29 02:01:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:05 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa is timed out.
Nov 29 02:01:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully detached device vdb from instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa from the live domain config.
Nov 29 02:01:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OwekncqF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:01:05 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ffa2f1-df23-4ec5-aba2-7d14431613c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:01:05 user nova-compute[75210]: No targets found.
Nov 29 02:01:05 user nova-compute[75210]: iSNS:
Nov 29 02:01:05 user nova-compute[75210]: No targets found.
Nov 29 02:01:05 user nova-compute[75210]: STATIC:
Nov 29 02:01:05 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31
Nov 29 02:01:05 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:01:05 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:01:05 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596
Nov 29 02:01:05 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:01:05 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:01:05 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193
Nov 29 02:01:05 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:01:05 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:01:05 user nova-compute[75210]: FIRMWARE:
Nov 29 02:01:05 user nova-compute[75210]: No targets found.
Nov 29 02:01:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:01:05 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:01:05 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2373d41-c3e1-4686-aca1-99fb3e128a2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed18da6-adf3-4435-a7bb-0b468dd198ba]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 02:01:05 user nova-compute[75210]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 02:01:05 user nova-compute[75210]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 (non-flash)
Nov 29 02:01:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 02:01:05 user nova-compute[75210]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 (non-flash)
Nov 29 02:01:05 user nova-compute[75210]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 (non-flash)
Nov 29 02:01:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f240813eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31'): ({'sde'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Removing single pathed devices sde {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[634f4f46-1acf-46e7-a405-35941f2685e3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31b83de-acd2-4825-ae33-902588631c14]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Flushing IO for device /dev/sde {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9901cf4f-56e3-44b7-8793-e72ab00e5720]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[15db42e2-6f8a-436c-ba1c-eec6caa5c969]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac23939-3946-46f5-bdb2-89b5b446ac38]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22577f7-c7c9-4eee-93a0-6ef62cf19df6]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260]
Nov 29 02:01:05 user nova-compute[75210]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31, portal: 172.16.0.220,3260] successful.
Nov 29 02:01:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031d4ab6-fdf7-4f6f-84ce-425506889b31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8c50e4-efdc-4c58-8e15-8b578b98ead8]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] <== disconnect_volume: return (277ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:01:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:01:06 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'flavor' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:01:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2fa99f85-3779-4a17-9c04-430edfc45f1d tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.579s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9d106602-80c2-41a8-b69f-8a25a7cf3002 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9d106602-80c2-41a8-b69f-8a25a7cf3002 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9d106602-80c2-41a8-b69f-8a25a7cf3002 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9d106602-80c2-41a8-b69f-8a25a7cf3002 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75210) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG nova.objects.instance [None req-9d106602-80c2-41a8-b69f-8a25a7cf3002 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'flavor' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-f6b84ae7-e2cc-4ca9-9cc4-ff53364d083f req-a4caa42a-8082-4afd-97a3-267b3a81bdf4 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-unplugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f6b84ae7-e2cc-4ca9-9cc4-ff53364d083f req-a4caa42a-8082-4afd-97a3-267b3a81bdf4 service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f6b84ae7-e2cc-4ca9-9cc4-ff53364d083f req-a4caa42a-8082-4afd-97a3-267b3a81bdf4 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f6b84ae7-e2cc-4ca9-9cc4-ff53364d083f req-a4caa42a-8082-4afd-97a3-267b3a81bdf4 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-f6b84ae7-e2cc-4ca9-9cc4-ff53364d083f req-a4caa42a-8082-4afd-97a3-267b3a81bdf4 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-unplugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:01:07 user nova-compute[75210]: WARNING nova.compute.manager [req-f6b84ae7-e2cc-4ca9-9cc4-ff53364d083f req-a4caa42a-8082-4afd-97a3-267b3a81bdf4 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-unplugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state active and task_state powering-off.
Nov 29 02:01:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:08 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Instance destroyed successfully.
Nov 29 02:01:08 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9d106602-80c2-41a8-b69f-8a25a7cf3002 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:01:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9d106602-80c2-41a8-b69f-8a25a7cf3002 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.830s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-ccbc7abe-433d-4965-8adf-02e7b37eebc4 req-edd55904-d7da-4c19-a7e7-4abcdb969689 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:01:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ccbc7abe-433d-4965-8adf-02e7b37eebc4 req-edd55904-d7da-4c19-a7e7-4abcdb969689 service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ccbc7abe-433d-4965-8adf-02e7b37eebc4 req-edd55904-d7da-4c19-a7e7-4abcdb969689 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ccbc7abe-433d-4965-8adf-02e7b37eebc4 req-edd55904-d7da-4c19-a7e7-4abcdb969689 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-ccbc7abe-433d-4965-8adf-02e7b37eebc4 req-edd55904-d7da-4c19-a7e7-4abcdb969689 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:01:09 user nova-compute[75210]: WARNING nova.compute.manager [req-ccbc7abe-433d-4965-8adf-02e7b37eebc4 req-edd55904-d7da-4c19-a7e7-4abcdb969689 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state stopped and task_state None.
Nov 29 02:01:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Acquiring lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:17 user nova-compute[75210]: DEBUG nova.compute.manager [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:01:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:17 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:01:17 user nova-compute[75210]: INFO nova.compute.claims [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Claim successful on node user
Nov 29 02:01:18 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG nova.compute.manager [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG nova.compute.manager [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG nova.network.neutron [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:01:18 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:01:18 user nova-compute[75210]: DEBUG nova.compute.manager [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG nova.compute.manager [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:01:18 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Creating image(s)
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "/opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "/opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG nova.policy [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20b0e8774de54c108f39ad3e56175d2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa47c61b2426455e96936aae51d3ad74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.170s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk 1073741824" returned: 0 in 0.053s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.171s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG nova.network.neutron [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Successfully created port: 740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Cannot resize image /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Ensure instance console log exists: /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG nova.network.neutron [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Successfully updated port: 740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Acquiring lock "refresh_cache-3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Acquired lock "refresh_cache-3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG nova.network.neutron [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-0a938a26-c361-43f2-bcd4-56378a7cfecf req-280b50eb-0eff-4d68-8589-eead8b33cef8 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received event network-changed-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-0a938a26-c361-43f2-bcd4-56378a7cfecf req-280b50eb-0eff-4d68-8589-eead8b33cef8 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Refreshing instance network info cache due to event network-changed-740ef7f8-f8e1-4073-91b2-be629357e759. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0a938a26-c361-43f2-bcd4-56378a7cfecf req-280b50eb-0eff-4d68-8589-eead8b33cef8 service nova] Acquiring lock "refresh_cache-3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:01:19 user nova-compute[75210]: DEBUG nova.network.neutron [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.network.neutron [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Updating instance_info_cache with network_info: [{"id": "740ef7f8-f8e1-4073-91b2-be629357e759", "address": "fa:16:3e:e2:8e:cf", "network": {"id": "a4fcd825-5e74-4c22-8c62-912833bd4848", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d462191b18242ee876eccb74d204f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740ef7f8-f8", "ovs_interfaceid": "740ef7f8-f8e1-4073-91b2-be629357e759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Releasing lock "refresh_cache-3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.compute.manager [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Instance network_info: |[{"id": "740ef7f8-f8e1-4073-91b2-be629357e759", "address": "fa:16:3e:e2:8e:cf", "network": {"id": "a4fcd825-5e74-4c22-8c62-912833bd4848", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d462191b18242ee876eccb74d204f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740ef7f8-f8", "ovs_interfaceid": "740ef7f8-f8e1-4073-91b2-be629357e759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0a938a26-c361-43f2-bcd4-56378a7cfecf req-280b50eb-0eff-4d68-8589-eead8b33cef8 service nova] Acquired lock "refresh_cache-3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.network.neutron [req-0a938a26-c361-43f2-bcd4-56378a7cfecf req-280b50eb-0eff-4d68-8589-eead8b33cef8 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Refreshing network info cache for port 740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Start _get_guest_xml network_info=[{"id": "740ef7f8-f8e1-4073-91b2-be629357e759", "address": "fa:16:3e:e2:8e:cf", "network": {"id": "a4fcd825-5e74-4c22-8c62-912833bd4848", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d462191b18242ee876eccb74d204f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740ef7f8-f8", "ovs_interfaceid": "740ef7f8-f8e1-4073-91b2-be629357e759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:01:20 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:01:20 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-973240312',display_name='tempest-VolumesNegativeTest-instance-973240312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-973240312',id=40,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa47c61b2426455e96936aae51d3ad74',ramdisk_id='',reservation_id='r-1xm2vug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-632785540',owner_user_name='tempest-VolumesNegativeTest-632785540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:01:18Z,user_data=None,user_id='20b0e8774de54c108f39ad3e56175d2b',uuid=3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "740ef7f8-f8e1-4073-91b2-be629357e759", "address": "fa:16:3e:e2:8e:cf", "network": {"id": "a4fcd825-5e74-4c22-8c62-912833bd4848", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d462191b18242ee876eccb74d204f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740ef7f8-f8", "ovs_interfaceid": "740ef7f8-f8e1-4073-91b2-be629357e759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Converting VIF {"id": "740ef7f8-f8e1-4073-91b2-be629357e759", "address": "fa:16:3e:e2:8e:cf", "network": {"id": "a4fcd825-5e74-4c22-8c62-912833bd4848", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d462191b18242ee876eccb74d204f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740ef7f8-f8", "ovs_interfaceid": "740ef7f8-f8e1-4073-91b2-be629357e759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:cf,bridge_name='br-int',has_traffic_filtering=True,id=740ef7f8-f8e1-4073-91b2-be629357e759,network=Network(a4fcd825-5e74-4c22-8c62-912833bd4848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740ef7f8-f8') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.objects.instance [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:01:20 user nova-compute[75210]:   <uuid>3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f</uuid>
Nov 29 02:01:20 user nova-compute[75210]:   <name>instance-00000028</name>
Nov 29 02:01:20 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:01:20 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:01:20 user nova-compute[75210]:   <metadata>
Nov 29 02:01:20 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:01:20 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:01:20 user nova-compute[75210]:       <nova:name>tempest-VolumesNegativeTest-instance-973240312</nova:name>
Nov 29 02:01:20 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:01:20</nova:creationTime>
Nov 29 02:01:20 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:01:20 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:01:20 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:01:20 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:01:20 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:01:20 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:01:20 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:01:20 user nova-compute[75210]:       <nova:owner>
Nov 29 02:01:20 user nova-compute[75210]:         <nova:user uuid="20b0e8774de54c108f39ad3e56175d2b">tempest-VolumesNegativeTest-632785540-project-member</nova:user>
Nov 29 02:01:20 user nova-compute[75210]:         <nova:project uuid="aa47c61b2426455e96936aae51d3ad74">tempest-VolumesNegativeTest-632785540</nova:project>
Nov 29 02:01:20 user nova-compute[75210]:       </nova:owner>
Nov 29 02:01:20 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 02:01:20 user nova-compute[75210]:       <nova:ports>
Nov 29 02:01:20 user nova-compute[75210]:         <nova:port uuid="740ef7f8-f8e1-4073-91b2-be629357e759">
Nov 29 02:01:20 user nova-compute[75210]:           <nova:ip type="fixed" address="192.168.233.224" ipVersion="4"/>
Nov 29 02:01:20 user nova-compute[75210]:         </nova:port>
Nov 29 02:01:20 user nova-compute[75210]:       </nova:ports>
Nov 29 02:01:20 user nova-compute[75210]:     </nova:instance>
Nov 29 02:01:20 user nova-compute[75210]:   </metadata>
Nov 29 02:01:20 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:01:20 user nova-compute[75210]:     <system>
Nov 29 02:01:20 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:01:20 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:01:20 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:01:20 user nova-compute[75210]:       <entry name="serial">3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f</entry>
Nov 29 02:01:20 user nova-compute[75210]:       <entry name="uuid">3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f</entry>
Nov 29 02:01:20 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:01:20 user nova-compute[75210]:     </system>
Nov 29 02:01:20 user nova-compute[75210]:   </sysinfo>
Nov 29 02:01:20 user nova-compute[75210]:   <os>
Nov 29 02:01:20 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:01:20 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:01:20 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:01:20 user nova-compute[75210]:   </os>
Nov 29 02:01:20 user nova-compute[75210]:   <features>
Nov 29 02:01:20 user nova-compute[75210]:     <acpi/>
Nov 29 02:01:20 user nova-compute[75210]:     <apic/>
Nov 29 02:01:20 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:01:20 user nova-compute[75210]:   </features>
Nov 29 02:01:20 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:01:20 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:01:20 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:01:20 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:01:20 user nova-compute[75210]:   </clock>
Nov 29 02:01:20 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:01:20 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:01:20 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:01:20 user nova-compute[75210]:   </cpu>
Nov 29 02:01:20 user nova-compute[75210]:   <devices>
Nov 29 02:01:20 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:01:20 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:01:20 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk"/>
Nov 29 02:01:20 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:01:20 user nova-compute[75210]:     </disk>
Nov 29 02:01:20 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:01:20 user nova-compute[75210]:       <mac address="fa:16:3e:e2:8e:cf"/>
Nov 29 02:01:20 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:01:20 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:01:20 user nova-compute[75210]:       <target dev="tap740ef7f8-f8"/>
Nov 29 02:01:20 user nova-compute[75210]:     </interface>
Nov 29 02:01:20 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:01:20 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/console.log" append="off"/>
Nov 29 02:01:20 user nova-compute[75210]:     </serial>
Nov 29 02:01:20 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:01:20 user nova-compute[75210]:     <video>
Nov 29 02:01:20 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:01:20 user nova-compute[75210]:     </video>
Nov 29 02:01:20 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:01:20 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:01:20 user nova-compute[75210]:     </rng>
Nov 29 02:01:20 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:01:20 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:01:20 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:01:20 user nova-compute[75210]:     </memballoon>
Nov 29 02:01:20 user nova-compute[75210]:   </devices>
Nov 29 02:01:20 user nova-compute[75210]: </domain>
Nov 29 02:01:20 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-973240312',display_name='tempest-VolumesNegativeTest-instance-973240312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-973240312',id=40,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa47c61b2426455e96936aae51d3ad74',ramdisk_id='',reservation_id='r-1xm2vug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-632785540',owner_user_name='tempest-VolumesNegativeTest-632785540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:01:18Z,user_data=None,user_id='20b0e8774de54c108f39ad3e56175d2b',uuid=3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "740ef7f8-f8e1-4073-91b2-be629357e759", "address": "fa:16:3e:e2:8e:cf", "network": {"id": "a4fcd825-5e74-4c22-8c62-912833bd4848", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d462191b18242ee876eccb74d204f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740ef7f8-f8", "ovs_interfaceid": "740ef7f8-f8e1-4073-91b2-be629357e759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Converting VIF {"id": "740ef7f8-f8e1-4073-91b2-be629357e759", "address": "fa:16:3e:e2:8e:cf", "network": {"id": "a4fcd825-5e74-4c22-8c62-912833bd4848", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d462191b18242ee876eccb74d204f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740ef7f8-f8", "ovs_interfaceid": "740ef7f8-f8e1-4073-91b2-be629357e759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:cf,bridge_name='br-int',has_traffic_filtering=True,id=740ef7f8-f8e1-4073-91b2-be629357e759,network=Network(a4fcd825-5e74-4c22-8c62-912833bd4848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740ef7f8-f8') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG os_vif [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:cf,bridge_name='br-int',has_traffic_filtering=True,id=740ef7f8-f8e1-4073-91b2-be629357e759,network=Network(a4fcd825-5e74-4c22-8c62-912833bd4848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740ef7f8-f8') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '615ea131-0b8e-5cf1-8570-e80cf70b9704', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap740ef7f8-f8, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap740ef7f8-f8, col_values=(('qos', UUID('f092340e-9b23-4e3b-a13f-2e4644e1abfa')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap740ef7f8-f8, col_values=(('external_ids', {'iface-id': '740ef7f8-f8e1-4073-91b2-be629357e759', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:8e:cf', 'vm-uuid': '3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:20 user nova-compute[75210]: INFO os_vif [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:cf,bridge_name='br-int',has_traffic_filtering=True,id=740ef7f8-f8e1-4073-91b2-be629357e759,network=Network(a4fcd825-5e74-4c22-8c62-912833bd4848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740ef7f8-f8')
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] No VIF found with MAC fa:16:3e:e2:8e:cf, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.network.neutron [req-0a938a26-c361-43f2-bcd4-56378a7cfecf req-280b50eb-0eff-4d68-8589-eead8b33cef8 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Updated VIF entry in instance network info cache for port 740ef7f8-f8e1-4073-91b2-be629357e759. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG nova.network.neutron [req-0a938a26-c361-43f2-bcd4-56378a7cfecf req-280b50eb-0eff-4d68-8589-eead8b33cef8 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Updating instance_info_cache with network_info: [{"id": "740ef7f8-f8e1-4073-91b2-be629357e759", "address": "fa:16:3e:e2:8e:cf", "network": {"id": "a4fcd825-5e74-4c22-8c62-912833bd4848", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d462191b18242ee876eccb74d204f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740ef7f8-f8", "ovs_interfaceid": "740ef7f8-f8e1-4073-91b2-be629357e759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:01:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0a938a26-c361-43f2-bcd4-56378a7cfecf req-280b50eb-0eff-4d68-8589-eead8b33cef8 service nova] Releasing lock "refresh_cache-3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:01:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-f8483da9-7209-4b3d-a7b6-37e9ad771978 req-9717f99f-2a12-4621-a094-38000b0bc3d5 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received event network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:01:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8483da9-7209-4b3d-a7b6-37e9ad771978 req-9717f99f-2a12-4621-a094-38000b0bc3d5 service nova] Acquiring lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8483da9-7209-4b3d-a7b6-37e9ad771978 req-9717f99f-2a12-4621-a094-38000b0bc3d5 service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8483da9-7209-4b3d-a7b6-37e9ad771978 req-9717f99f-2a12-4621-a094-38000b0bc3d5 service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-f8483da9-7209-4b3d-a7b6-37e9ad771978 req-9717f99f-2a12-4621-a094-38000b0bc3d5 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] No waiting events found dispatching network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:01:21 user nova-compute[75210]: WARNING nova.compute.manager [req-f8483da9-7209-4b3d-a7b6-37e9ad771978 req-9717f99f-2a12-4621-a094-38000b0bc3d5 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received unexpected event network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 for instance with vm_state building and task_state spawning.
Nov 29 02:01:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-20875ce2-b7a6-46f6-86b7-7805e3b393af req-7c49e24a-71c5-4fc7-990b-27ee66ec850b service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received event network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:01:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-20875ce2-b7a6-46f6-86b7-7805e3b393af req-7c49e24a-71c5-4fc7-990b-27ee66ec850b service nova] Acquiring lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-20875ce2-b7a6-46f6-86b7-7805e3b393af req-7c49e24a-71c5-4fc7-990b-27ee66ec850b service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-20875ce2-b7a6-46f6-86b7-7805e3b393af req-7c49e24a-71c5-4fc7-990b-27ee66ec850b service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-20875ce2-b7a6-46f6-86b7-7805e3b393af req-7c49e24a-71c5-4fc7-990b-27ee66ec850b service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] No waiting events found dispatching network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:01:23 user nova-compute[75210]: WARNING nova.compute.manager [req-20875ce2-b7a6-46f6-86b7-7805e3b393af req-7c49e24a-71c5-4fc7-990b-27ee66ec850b service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received unexpected event network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 for instance with vm_state building and task_state spawning.
Nov 29 02:01:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:01:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:01:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Instance spawned successfully.
Nov 29 02:01:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:01:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:01:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:01:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:01:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:01:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:01:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:01:24 user nova-compute[75210]: INFO nova.compute.manager [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 29 02:01:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:01:24 user nova-compute[75210]: INFO nova.compute.manager [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Took 6.42 seconds to build instance.
Nov 29 02:01:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-275ebcfa-db30-4d55-85ba-a46d06436fb1 tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.511s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:01:30 user nova-compute[75210]: INFO nova.compute.claims [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Claim successful on node user
Nov 29 02:01:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:01:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:01:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG nova.policy [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a388bda7f1454c898a458fc7aa276a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de78c813716a4a3fa74e92b498e9ed2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:01:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Creating image(s)
Nov 29 02:01:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "/opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "/opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.192s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk 1073741824" returned: 0 in 0.055s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG nova.network.neutron [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Successfully created port: 24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.196s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Cannot resize image /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Ensure instance console log exists: /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG nova.network.neutron [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Successfully updated port: 24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquired lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG nova.network.neutron [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-d2958a55-d003-4ccd-93d8-67fb381c7d55 req-65f53c5f-9d99-4ffb-9e91-03b0a2d7cfe6 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-changed-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-d2958a55-d003-4ccd-93d8-67fb381c7d55 req-65f53c5f-9d99-4ffb-9e91-03b0a2d7cfe6 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Refreshing instance network info cache due to event network-changed-24af94e3-44d6-4bd9-8dbb-ded94daa2b62. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d2958a55-d003-4ccd-93d8-67fb381c7d55 req-65f53c5f-9d99-4ffb-9e91-03b0a2d7cfe6 service nova] Acquiring lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:01:31 user nova-compute[75210]: DEBUG nova.network.neutron [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.network.neutron [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updating instance_info_cache with network_info: [{"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Releasing lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.compute.manager [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Instance network_info: |[{"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d2958a55-d003-4ccd-93d8-67fb381c7d55 req-65f53c5f-9d99-4ffb-9e91-03b0a2d7cfe6 service nova] Acquired lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.network.neutron [req-d2958a55-d003-4ccd-93d8-67fb381c7d55 req-65f53c5f-9d99-4ffb-9e91-03b0a2d7cfe6 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Refreshing network info cache for port 24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Start _get_guest_xml network_info=[{"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:01:32 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:01:32 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1135885355',display_name='tempest-ServerStableDeviceRescueTest-server-1135885355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1135885355',id=41,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPSG3qE+VgrQNXmELqi5qSXBwBzUp8vZZBB9/REK7ixhkyDD6falVEmw2R1+zJ071dQTIbR39IgcId6lzef4D9VzKYNeqf+7J8rcwF1girVO8dNsvkXLI7BMPoX9/gWEQ==',key_name='tempest-keypair-376857331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de78c813716a4a3fa74e92b498e9ed2e',ramdisk_id='',reservation_id='r-w40b89pl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-515826915',owner_user_name='tempest-ServerStableDeviceRescueTest-515826915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a388bda7f1454c898a458fc7aa276a1c',uuid=cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Converting VIF {"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:3c:bd,bridge_name='br-int',has_traffic_filtering=True,id=24af94e3-44d6-4bd9-8dbb-ded94daa2b62,network=Network(7a102cdd-460e-4998-aae7-f6d0237ed234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24af94e3-44') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.objects.instance [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lazy-loading 'pci_devices' on Instance uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:01:32 user nova-compute[75210]:   <uuid>cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6</uuid>
Nov 29 02:01:32 user nova-compute[75210]:   <name>instance-00000029</name>
Nov 29 02:01:32 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:01:32 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:01:32 user nova-compute[75210]:   <metadata>
Nov 29 02:01:32 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:01:32 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:01:32 user nova-compute[75210]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1135885355</nova:name>
Nov 29 02:01:32 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:01:32</nova:creationTime>
Nov 29 02:01:32 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:01:32 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:01:32 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:01:32 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:01:32 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:01:32 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:01:32 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:01:32 user nova-compute[75210]:       <nova:owner>
Nov 29 02:01:32 user nova-compute[75210]:         <nova:user uuid="a388bda7f1454c898a458fc7aa276a1c">tempest-ServerStableDeviceRescueTest-515826915-project-member</nova:user>
Nov 29 02:01:32 user nova-compute[75210]:         <nova:project uuid="de78c813716a4a3fa74e92b498e9ed2e">tempest-ServerStableDeviceRescueTest-515826915</nova:project>
Nov 29 02:01:32 user nova-compute[75210]:       </nova:owner>
Nov 29 02:01:32 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 02:01:32 user nova-compute[75210]:       <nova:ports>
Nov 29 02:01:32 user nova-compute[75210]:         <nova:port uuid="24af94e3-44d6-4bd9-8dbb-ded94daa2b62">
Nov 29 02:01:32 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 02:01:32 user nova-compute[75210]:         </nova:port>
Nov 29 02:01:32 user nova-compute[75210]:       </nova:ports>
Nov 29 02:01:32 user nova-compute[75210]:     </nova:instance>
Nov 29 02:01:32 user nova-compute[75210]:   </metadata>
Nov 29 02:01:32 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:01:32 user nova-compute[75210]:     <system>
Nov 29 02:01:32 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:01:32 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:01:32 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:01:32 user nova-compute[75210]:       <entry name="serial">cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6</entry>
Nov 29 02:01:32 user nova-compute[75210]:       <entry name="uuid">cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6</entry>
Nov 29 02:01:32 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:01:32 user nova-compute[75210]:     </system>
Nov 29 02:01:32 user nova-compute[75210]:   </sysinfo>
Nov 29 02:01:32 user nova-compute[75210]:   <os>
Nov 29 02:01:32 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:01:32 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:01:32 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:01:32 user nova-compute[75210]:   </os>
Nov 29 02:01:32 user nova-compute[75210]:   <features>
Nov 29 02:01:32 user nova-compute[75210]:     <acpi/>
Nov 29 02:01:32 user nova-compute[75210]:     <apic/>
Nov 29 02:01:32 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:01:32 user nova-compute[75210]:   </features>
Nov 29 02:01:32 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:01:32 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:01:32 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:01:32 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:01:32 user nova-compute[75210]:   </clock>
Nov 29 02:01:32 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:01:32 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:01:32 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:01:32 user nova-compute[75210]:   </cpu>
Nov 29 02:01:32 user nova-compute[75210]:   <devices>
Nov 29 02:01:32 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:01:32 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:01:32 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk"/>
Nov 29 02:01:32 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:01:32 user nova-compute[75210]:     </disk>
Nov 29 02:01:32 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:01:32 user nova-compute[75210]:       <mac address="fa:16:3e:88:3c:bd"/>
Nov 29 02:01:32 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:01:32 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:01:32 user nova-compute[75210]:       <target dev="tap24af94e3-44"/>
Nov 29 02:01:32 user nova-compute[75210]:     </interface>
Nov 29 02:01:32 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:01:32 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/console.log" append="off"/>
Nov 29 02:01:32 user nova-compute[75210]:     </serial>
Nov 29 02:01:32 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:01:32 user nova-compute[75210]:     <video>
Nov 29 02:01:32 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:01:32 user nova-compute[75210]:     </video>
Nov 29 02:01:32 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:01:32 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:01:32 user nova-compute[75210]:     </rng>
Nov 29 02:01:32 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:01:32 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:01:32 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:01:32 user nova-compute[75210]:     </memballoon>
Nov 29 02:01:32 user nova-compute[75210]:   </devices>
Nov 29 02:01:32 user nova-compute[75210]: </domain>
Nov 29 02:01:32 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1135885355',display_name='tempest-ServerStableDeviceRescueTest-server-1135885355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1135885355',id=41,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPSG3qE+VgrQNXmELqi5qSXBwBzUp8vZZBB9/REK7ixhkyDD6falVEmw2R1+zJ071dQTIbR39IgcId6lzef4D9VzKYNeqf+7J8rcwF1girVO8dNsvkXLI7BMPoX9/gWEQ==',key_name='tempest-keypair-376857331',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de78c813716a4a3fa74e92b498e9ed2e',ramdisk_id='',reservation_id='r-w40b89pl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-515826915',owner_user_name='tempest-ServerStableDeviceRescueTest-515826915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a388bda7f1454c898a458fc7aa276a1c',uuid=cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Converting VIF {"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:3c:bd,bridge_name='br-int',has_traffic_filtering=True,id=24af94e3-44d6-4bd9-8dbb-ded94daa2b62,network=Network(7a102cdd-460e-4998-aae7-f6d0237ed234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24af94e3-44') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG os_vif [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:3c:bd,bridge_name='br-int',has_traffic_filtering=True,id=24af94e3-44d6-4bd9-8dbb-ded94daa2b62,network=Network(7a102cdd-460e-4998-aae7-f6d0237ed234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24af94e3-44') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c8d7613-1653-5f70-966b-423d45244923', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24af94e3-44, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24af94e3-44, col_values=(('qos', UUID('7a2a8d8b-99d3-4c84-bfe3-970573594341')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24af94e3-44, col_values=(('external_ids', {'iface-id': '24af94e3-44d6-4bd9-8dbb-ded94daa2b62', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:3c:bd', 'vm-uuid': 'cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:32 user nova-compute[75210]: INFO os_vif [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:3c:bd,bridge_name='br-int',has_traffic_filtering=True,id=24af94e3-44d6-4bd9-8dbb-ded94daa2b62,network=Network(7a102cdd-460e-4998-aae7-f6d0237ed234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24af94e3-44')
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] No VIF found with MAC fa:16:3e:88:3c:bd, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.network.neutron [req-d2958a55-d003-4ccd-93d8-67fb381c7d55 req-65f53c5f-9d99-4ffb-9e91-03b0a2d7cfe6 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updated VIF entry in instance network info cache for port 24af94e3-44d6-4bd9-8dbb-ded94daa2b62. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG nova.network.neutron [req-d2958a55-d003-4ccd-93d8-67fb381c7d55 req-65f53c5f-9d99-4ffb-9e91-03b0a2d7cfe6 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updating instance_info_cache with network_info: [{"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:01:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d2958a55-d003-4ccd-93d8-67fb381c7d55 req-65f53c5f-9d99-4ffb-9e91-03b0a2d7cfe6 service nova] Releasing lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:01:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-1a34a0a1-3162-4a08-a506-3a2b623da5e0 req-c2c4a570-1ec7-445d-b095-ec4617f72f41 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:01:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a34a0a1-3162-4a08-a506-3a2b623da5e0 req-c2c4a570-1ec7-445d-b095-ec4617f72f41 service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a34a0a1-3162-4a08-a506-3a2b623da5e0 req-c2c4a570-1ec7-445d-b095-ec4617f72f41 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1a34a0a1-3162-4a08-a506-3a2b623da5e0 req-c2c4a570-1ec7-445d-b095-ec4617f72f41 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-1a34a0a1-3162-4a08-a506-3a2b623da5e0 req-c2c4a570-1ec7-445d-b095-ec4617f72f41 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:01:34 user nova-compute[75210]: WARNING nova.compute.manager [req-1a34a0a1-3162-4a08-a506-3a2b623da5e0 req-c2c4a570-1ec7-445d-b095-ec4617f72f41 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state building and task_state spawning.
Nov 29 02:01:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:35 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:01:35 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:01:36 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Instance spawned successfully.
Nov 29 02:01:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-e0dabc94-a6de-4a64-8792-8989b7ed8fc5 req-115c5719-d3c6-45af-b7c8-fe45a8c3f419 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e0dabc94-a6de-4a64-8792-8989b7ed8fc5 req-115c5719-d3c6-45af-b7c8-fe45a8c3f419 service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e0dabc94-a6de-4a64-8792-8989b7ed8fc5 req-115c5719-d3c6-45af-b7c8-fe45a8c3f419 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e0dabc94-a6de-4a64-8792-8989b7ed8fc5 req-115c5719-d3c6-45af-b7c8-fe45a8c3f419 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG nova.compute.manager [req-e0dabc94-a6de-4a64-8792-8989b7ed8fc5 req-115c5719-d3c6-45af-b7c8-fe45a8c3f419 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:01:36 user nova-compute[75210]: WARNING nova.compute.manager [req-e0dabc94-a6de-4a64-8792-8989b7ed8fc5 req-115c5719-d3c6-45af-b7c8-fe45a8c3f419 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state building and task_state spawning.
Nov 29 02:01:36 user nova-compute[75210]: INFO nova.compute.manager [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 29 02:01:36 user nova-compute[75210]: DEBUG nova.compute.manager [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:01:36 user nova-compute[75210]: INFO nova.compute.manager [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Took 6.39 seconds to build instance.
Nov 29 02:01:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4c72b16a-702e-422f-8e0c-02ab2909d71e tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.537s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:37 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:01:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:01:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:01:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:01:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:01:37 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:01:37 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:01:38 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updating instance_info_cache with network_info: [{"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:01:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:01:38 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:01:40 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:01:40 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:01:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:41 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:01:41 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:01:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:01:44 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:01:46 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:01:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:46 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:01:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:01:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:01:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:01:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:01:48 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:01:48 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:01:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8408MB free_disk=25.296653747558594GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:01:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:01:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:01:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:01:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 48c1091b-67d1-4d0f-96e2-b6ccb8567466 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:01:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance fbb4ed42-4fd2-4edb-adcb-85afa3d48672 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:01:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:01:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:01:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:01:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:01:48 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:01:48 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:01:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:01:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:01:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:01:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:02:03 user nova-compute[75210]: INFO nova.compute.claims [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Claim successful on node user
Nov 29 02:02:03 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG nova.network.neutron [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:02:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:02:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG nova.policy [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4f7a67a01104567b3e96f9d150dddd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55934a4b47ab45a4a7f389919225c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:02:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Creating image(s)
Nov 29 02:02:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "/opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "/opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.170s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk 1073741824" returned: 0 in 0.054s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG nova.network.neutron [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Successfully created port: 6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Cannot resize image /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Ensure instance console log exists: /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Successfully updated port: 6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquired lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-1d3816fa-a3cd-4834-835a-f6a29b225972 req-ab385c13-4c01-4877-a0be-7939b4a12da7 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-changed-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-1d3816fa-a3cd-4834-835a-f6a29b225972 req-ab385c13-4c01-4877-a0be-7939b4a12da7 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Refreshing instance network info cache due to event network-changed-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1d3816fa-a3cd-4834-835a-f6a29b225972 req-ab385c13-4c01-4877-a0be-7939b4a12da7 service nova] Acquiring lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updating instance_info_cache with network_info: [{"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Releasing lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Instance network_info: |[{"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1d3816fa-a3cd-4834-835a-f6a29b225972 req-ab385c13-4c01-4877-a0be-7939b4a12da7 service nova] Acquired lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.network.neutron [req-1d3816fa-a3cd-4834-835a-f6a29b225972 req-ab385c13-4c01-4877-a0be-7939b4a12da7 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Refreshing network info cache for port 6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Start _get_guest_xml network_info=[{"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:02:05 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:02:05 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1647236808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1647236808',id=42,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdVWiwc5/SKu6fnoi3dYT1LiowcWPktBHEWHutt6M7BjBMCEx/7qjI8dA26d5mga/+5Ur17Ya2Iw/PaVNqxoVhIUUQMZFzVL8AOmpHosZ7kB+Ok5bzb5xIphm/Xt4BzHQ==',key_name='tempest-keypair-785264678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55934a4b47ab45a4a7f389919225c156',ramdisk_id='',reservation_id='r-ygxad600',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2088736241',owner_user_name='tempest-AttachVolumeShelveTestJSON-2088736241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f7a67a01104567b3e96f9d150dddd2',uuid=b9fabd34-7143-4b40-bca8-15b6d2bde253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converting VIF {"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.objects.instance [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'pci_devices' on Instance uuid b9fabd34-7143-4b40-bca8-15b6d2bde253 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:02:05 user nova-compute[75210]:   <uuid>b9fabd34-7143-4b40-bca8-15b6d2bde253</uuid>
Nov 29 02:02:05 user nova-compute[75210]:   <name>instance-0000002a</name>
Nov 29 02:02:05 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:02:05 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:02:05 user nova-compute[75210]:   <metadata>
Nov 29 02:02:05 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:02:05 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:02:05 user nova-compute[75210]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1647236808</nova:name>
Nov 29 02:02:05 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:02:05</nova:creationTime>
Nov 29 02:02:05 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:02:05 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:02:05 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:02:05 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:02:05 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:02:05 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:02:05 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:02:05 user nova-compute[75210]:       <nova:owner>
Nov 29 02:02:05 user nova-compute[75210]:         <nova:user uuid="f4f7a67a01104567b3e96f9d150dddd2">tempest-AttachVolumeShelveTestJSON-2088736241-project-member</nova:user>
Nov 29 02:02:05 user nova-compute[75210]:         <nova:project uuid="55934a4b47ab45a4a7f389919225c156">tempest-AttachVolumeShelveTestJSON-2088736241</nova:project>
Nov 29 02:02:05 user nova-compute[75210]:       </nova:owner>
Nov 29 02:02:05 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 02:02:05 user nova-compute[75210]:       <nova:ports>
Nov 29 02:02:05 user nova-compute[75210]:         <nova:port uuid="6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7">
Nov 29 02:02:05 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 02:02:05 user nova-compute[75210]:         </nova:port>
Nov 29 02:02:05 user nova-compute[75210]:       </nova:ports>
Nov 29 02:02:05 user nova-compute[75210]:     </nova:instance>
Nov 29 02:02:05 user nova-compute[75210]:   </metadata>
Nov 29 02:02:05 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:02:05 user nova-compute[75210]:     <system>
Nov 29 02:02:05 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:02:05 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:02:05 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:02:05 user nova-compute[75210]:       <entry name="serial">b9fabd34-7143-4b40-bca8-15b6d2bde253</entry>
Nov 29 02:02:05 user nova-compute[75210]:       <entry name="uuid">b9fabd34-7143-4b40-bca8-15b6d2bde253</entry>
Nov 29 02:02:05 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:02:05 user nova-compute[75210]:     </system>
Nov 29 02:02:05 user nova-compute[75210]:   </sysinfo>
Nov 29 02:02:05 user nova-compute[75210]:   <os>
Nov 29 02:02:05 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:02:05 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:02:05 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:02:05 user nova-compute[75210]:   </os>
Nov 29 02:02:05 user nova-compute[75210]:   <features>
Nov 29 02:02:05 user nova-compute[75210]:     <acpi/>
Nov 29 02:02:05 user nova-compute[75210]:     <apic/>
Nov 29 02:02:05 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:02:05 user nova-compute[75210]:   </features>
Nov 29 02:02:05 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:02:05 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:02:05 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:02:05 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:02:05 user nova-compute[75210]:   </clock>
Nov 29 02:02:05 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:02:05 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:02:05 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:02:05 user nova-compute[75210]:   </cpu>
Nov 29 02:02:05 user nova-compute[75210]:   <devices>
Nov 29 02:02:05 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:02:05 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:02:05 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk"/>
Nov 29 02:02:05 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:02:05 user nova-compute[75210]:     </disk>
Nov 29 02:02:05 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:02:05 user nova-compute[75210]:       <mac address="fa:16:3e:16:a1:c9"/>
Nov 29 02:02:05 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:02:05 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:02:05 user nova-compute[75210]:       <target dev="tap6f0dfb9d-2c"/>
Nov 29 02:02:05 user nova-compute[75210]:     </interface>
Nov 29 02:02:05 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:02:05 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/console.log" append="off"/>
Nov 29 02:02:05 user nova-compute[75210]:     </serial>
Nov 29 02:02:05 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:02:05 user nova-compute[75210]:     <video>
Nov 29 02:02:05 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:02:05 user nova-compute[75210]:     </video>
Nov 29 02:02:05 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:02:05 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:02:05 user nova-compute[75210]:     </rng>
Nov 29 02:02:05 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:02:05 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:02:05 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:02:05 user nova-compute[75210]:     </memballoon>
Nov 29 02:02:05 user nova-compute[75210]:   </devices>
Nov 29 02:02:05 user nova-compute[75210]: </domain>
Nov 29 02:02:05 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1647236808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1647236808',id=42,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdVWiwc5/SKu6fnoi3dYT1LiowcWPktBHEWHutt6M7BjBMCEx/7qjI8dA26d5mga/+5Ur17Ya2Iw/PaVNqxoVhIUUQMZFzVL8AOmpHosZ7kB+Ok5bzb5xIphm/Xt4BzHQ==',key_name='tempest-keypair-785264678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55934a4b47ab45a4a7f389919225c156',ramdisk_id='',reservation_id='r-ygxad600',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2088736241',owner_user_name='tempest-AttachVolumeShelveTestJSON-2088736241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f7a67a01104567b3e96f9d150dddd2',uuid=b9fabd34-7143-4b40-bca8-15b6d2bde253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converting VIF {"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG os_vif [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab430f39-9e6c-5553-a90d-c7940070ec7d', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f0dfb9d-2c, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f0dfb9d-2c, col_values=(('qos', UUID('56754134-5f8b-49f8-bf56-24532fa31979')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f0dfb9d-2c, col_values=(('external_ids', {'iface-id': '6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:a1:c9', 'vm-uuid': 'b9fabd34-7143-4b40-bca8-15b6d2bde253'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:05 user nova-compute[75210]: INFO os_vif [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c')
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] No VIF found with MAC fa:16:3e:16:a1:c9, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.network.neutron [req-1d3816fa-a3cd-4834-835a-f6a29b225972 req-ab385c13-4c01-4877-a0be-7939b4a12da7 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updated VIF entry in instance network info cache for port 6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG nova.network.neutron [req-1d3816fa-a3cd-4834-835a-f6a29b225972 req-ab385c13-4c01-4877-a0be-7939b4a12da7 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updating instance_info_cache with network_info: [{"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:02:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1d3816fa-a3cd-4834-835a-f6a29b225972 req-ab385c13-4c01-4877-a0be-7939b4a12da7 service nova] Releasing lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:02:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-2a231414-f8e1-4fa1-9fee-7fbb35396428 req-7063444a-f700-4bb2-9bac-5f5d149bf282 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:02:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2a231414-f8e1-4fa1-9fee-7fbb35396428 req-7063444a-f700-4bb2-9bac-5f5d149bf282 service nova] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2a231414-f8e1-4fa1-9fee-7fbb35396428 req-7063444a-f700-4bb2-9bac-5f5d149bf282 service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2a231414-f8e1-4fa1-9fee-7fbb35396428 req-7063444a-f700-4bb2-9bac-5f5d149bf282 service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-2a231414-f8e1-4fa1-9fee-7fbb35396428 req-7063444a-f700-4bb2-9bac-5f5d149bf282 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] No waiting events found dispatching network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:02:07 user nova-compute[75210]: WARNING nova.compute.manager [req-2a231414-f8e1-4fa1-9fee-7fbb35396428 req-7063444a-f700-4bb2-9bac-5f5d149bf282 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received unexpected event network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 for instance with vm_state building and task_state spawning.
Nov 29 02:02:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:08 user nova-compute[75210]: DEBUG nova.compute.manager [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:02:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:02:08 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Instance spawned successfully.
Nov 29 02:02:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:02:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:02:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:02:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:02:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:02:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:02:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:02:09 user nova-compute[75210]: INFO nova.compute.manager [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 29 02:02:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:02:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e64b419-1242-41e2-b73e-d18ae8dc9856 req-a218e6b1-647b-4e86-afc1-b21fdb703dbf service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:02:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e64b419-1242-41e2-b73e-d18ae8dc9856 req-a218e6b1-647b-4e86-afc1-b21fdb703dbf service nova] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e64b419-1242-41e2-b73e-d18ae8dc9856 req-a218e6b1-647b-4e86-afc1-b21fdb703dbf service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e64b419-1242-41e2-b73e-d18ae8dc9856 req-a218e6b1-647b-4e86-afc1-b21fdb703dbf service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e64b419-1242-41e2-b73e-d18ae8dc9856 req-a218e6b1-647b-4e86-afc1-b21fdb703dbf service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] No waiting events found dispatching network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:02:09 user nova-compute[75210]: WARNING nova.compute.manager [req-8e64b419-1242-41e2-b73e-d18ae8dc9856 req-a218e6b1-647b-4e86-afc1-b21fdb703dbf service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received unexpected event network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 for instance with vm_state building and task_state spawning.
Nov 29 02:02:09 user nova-compute[75210]: INFO nova.compute.manager [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Took 5.70 seconds to build instance.
Nov 29 02:02:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-438d9c85-b82e-4bf5-89bb-81c9fc3f629f tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.800s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:10 user nova-compute[75210]: INFO nova.compute.manager [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Terminating instance
Nov 29 02:02:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-a147231d-4382-453a-a12a-ceee287118b3 req-b88e333a-da89-4c07-b57a-31138e7e7e2a service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Received event network-vif-unplugged-dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a147231d-4382-453a-a12a-ceee287118b3 req-b88e333a-da89-4c07-b57a-31138e7e7e2a service nova] Acquiring lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a147231d-4382-453a-a12a-ceee287118b3 req-b88e333a-da89-4c07-b57a-31138e7e7e2a service nova] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a147231d-4382-453a-a12a-ceee287118b3 req-b88e333a-da89-4c07-b57a-31138e7e7e2a service nova] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-a147231d-4382-453a-a12a-ceee287118b3 req-b88e333a-da89-4c07-b57a-31138e7e7e2a service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] No waiting events found dispatching network-vif-unplugged-dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:02:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-a147231d-4382-453a-a12a-ceee287118b3 req-b88e333a-da89-4c07-b57a-31138e7e7e2a service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Received event network-vif-unplugged-dcc05e13-3504-40d7-a85a-5cd1f2624276 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-76488ba0-be3e-4584-be4b-5d97d2af32e7 req-c51883bd-a2cd-47c1-87f1-ba960288e476 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Received event network-changed-dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-76488ba0-be3e-4584-be4b-5d97d2af32e7 req-c51883bd-a2cd-47c1-87f1-ba960288e476 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Refreshing instance network info cache due to event network-changed-dcc05e13-3504-40d7-a85a-5cd1f2624276. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-76488ba0-be3e-4584-be4b-5d97d2af32e7 req-c51883bd-a2cd-47c1-87f1-ba960288e476 service nova] Acquiring lock "refresh_cache-fbb4ed42-4fd2-4edb-adcb-85afa3d48672" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-76488ba0-be3e-4584-be4b-5d97d2af32e7 req-c51883bd-a2cd-47c1-87f1-ba960288e476 service nova] Acquired lock "refresh_cache-fbb4ed42-4fd2-4edb-adcb-85afa3d48672" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG nova.network.neutron [req-76488ba0-be3e-4584-be4b-5d97d2af32e7 req-c51883bd-a2cd-47c1-87f1-ba960288e476 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Refreshing network info cache for port dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:11 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Instance destroyed successfully.
Nov 29 02:02:11 user nova-compute[75210]: DEBUG nova.objects.instance [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lazy-loading 'resources' on Instance uuid fbb4ed42-4fd2-4edb-adcb-85afa3d48672 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:00:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-25974572',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-25974572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-25974572',id=39,image_ref='24d4fdee-28ab-42ee-afdc-112aae06ec1e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuqwU8c41GAsrSEwILQRdwupCl/Nw1XQwob47iPHMoW4nCkFlYu7kw0SCLla6NsQNOlhLvv3HFoYa2TNvwSLYjmr3HglcHAnmCHIoHVhxTAUQOja6iTJy/xu5yBaXHM+A==',key_name='tempest-keypair-62292304',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:00:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-3mx3x5c6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-670838009',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='080bcd228b454b03995b0f3e116df917',uuid=fbb4ed42-4fd2-4edb-adcb-85afa3d48672,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "address": "fa:16:3e:e5:7c:f6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc05e13-35", "ovs_interfaceid": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "address": "fa:16:3e:e5:7c:f6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc05e13-35", "ovs_interfaceid": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7c:f6,bridge_name='br-int',has_traffic_filtering=True,id=dcc05e13-3504-40d7-a85a-5cd1f2624276,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc05e13-35') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_vif [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7c:f6,bridge_name='br-int',has_traffic_filtering=True,id=dcc05e13-3504-40d7-a85a-5cd1f2624276,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc05e13-35') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcc05e13-35, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3f4d347-27d8-45f2-a039-13b5c2f7e364) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:11 user nova-compute[75210]: INFO os_vif [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:7c:f6,bridge_name='br-int',has_traffic_filtering=True,id=dcc05e13-3504-40d7-a85a-5cd1f2624276,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcc05e13-35')
Nov 29 02:02:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AUbTvIFz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:02:11 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a285d364-1e5c-447f-b6ae-c64a60ddb5ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:02:11 user nova-compute[75210]: No targets found.
Nov 29 02:02:11 user nova-compute[75210]: iSNS:
Nov 29 02:02:11 user nova-compute[75210]: No targets found.
Nov 29 02:02:11 user nova-compute[75210]: STATIC:
Nov 29 02:02:11 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596
Nov 29 02:02:11 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:02:11 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:02:11 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193
Nov 29 02:02:11 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:02:11 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:02:11 user nova-compute[75210]: FIRMWARE:
Nov 29 02:02:11 user nova-compute[75210]: No targets found.
Nov 29 02:02:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:02:11 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:02:11 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c5283c-00fe-429a-8464-e0b90f4968de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9133c063-4e58-49d9-b3b4-cffa05429f66]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 02:02:11 user nova-compute[75210]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 (non-flash)
Nov 29 02:02:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 02:02:11 user nova-compute[75210]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 (non-flash)
Nov 29 02:02:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2408428820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c60135-3006-4159-bc66-fae099a066ac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7bf0b1-1c9a-4a6d-b830-29ef309d430d]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG nova.network.neutron [req-76488ba0-be3e-4584-be4b-5d97d2af32e7 req-c51883bd-a2cd-47c1-87f1-ba960288e476 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Updated VIF entry in instance network info cache for port dcc05e13-3504-40d7-a85a-5cd1f2624276. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG nova.network.neutron [req-76488ba0-be3e-4584-be4b-5d97d2af32e7 req-c51883bd-a2cd-47c1-87f1-ba960288e476 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Updating instance_info_cache with network_info: [{"id": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "address": "fa:16:3e:e5:7c:f6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcc05e13-35", "ovs_interfaceid": "dcc05e13-3504-40d7-a85a-5cd1f2624276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5045f7d-31ce-4f74-a7d7-5acbe9c513a0]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-76488ba0-be3e-4584-be4b-5d97d2af32e7 req-c51883bd-a2cd-47c1-87f1-ba960288e476 service nova] Releasing lock "refresh_cache-fbb4ed42-4fd2-4edb-adcb-85afa3d48672" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[874e78e4-317e-4d0c-8062-00402fb44f1a]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2911bbf4', '/dev/disk/by-id/scsi-1SCST_BIO2911bbf4-85c589d8fb39d648', '/dev/disk/by-id/scsi-23835633538396438') {{(pid=85542) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c8c920-8858-491e-8d7f-7423a204a8c9]: (4, None) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe253d51-522c-4959-a68c-1625ff2bd929]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abcde35-e599-41a5-8852-dc45aa84d42c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596, portal: 172.16.0.220,3260]
Nov 29 02:02:11 user nova-compute[75210]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596, portal: 172.16.0.220,3260] successful.
Nov 29 02:02:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb7deae5-0b8a-49ae-831e-238e56a33596 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[29140661-7d88-4e07-a119-47202aa7f34b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== disconnect_volume: return (327ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:02:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:02:11 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Deleting instance files /opt/stack/data/nova/instances/fbb4ed42-4fd2-4edb-adcb-85afa3d48672_del
Nov 29 02:02:11 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Deletion of /opt/stack/data/nova/instances/fbb4ed42-4fd2-4edb-adcb-85afa3d48672_del complete
Nov 29 02:02:12 user nova-compute[75210]: INFO nova.compute.manager [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 29 02:02:12 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:02:12 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:02:12 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:02:12 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:02:12 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Took 0.67 seconds to deallocate network for instance.
Nov 29 02:02:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-a0fe113a-8ae3-4cfd-947e-7d33df778765 req-590e7822-ca9f-4980-ba19-db1a70f75458 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Received event network-vif-plugged-dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:02:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a0fe113a-8ae3-4cfd-947e-7d33df778765 req-590e7822-ca9f-4980-ba19-db1a70f75458 service nova] Acquiring lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a0fe113a-8ae3-4cfd-947e-7d33df778765 req-590e7822-ca9f-4980-ba19-db1a70f75458 service nova] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a0fe113a-8ae3-4cfd-947e-7d33df778765 req-590e7822-ca9f-4980-ba19-db1a70f75458 service nova] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-a0fe113a-8ae3-4cfd-947e-7d33df778765 req-590e7822-ca9f-4980-ba19-db1a70f75458 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] No waiting events found dispatching network-vif-plugged-dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:02:13 user nova-compute[75210]: WARNING nova.compute.manager [req-a0fe113a-8ae3-4cfd-947e-7d33df778765 req-590e7822-ca9f-4980-ba19-db1a70f75458 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Received unexpected event network-vif-plugged-dcc05e13-3504-40d7-a85a-5cd1f2624276 for instance with vm_state active and task_state deleting.
Nov 29 02:02:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-a0fe113a-8ae3-4cfd-947e-7d33df778765 req-590e7822-ca9f-4980-ba19-db1a70f75458 service nova] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Received event network-vif-deleted-dcc05e13-3504-40d7-a85a-5cd1f2624276 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:02:13 user nova-compute[75210]: INFO nova.compute.manager [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Took 0.82 seconds to detach 1 volumes for instance.
Nov 29 02:02:13 user nova-compute[75210]: DEBUG nova.compute.manager [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: fbb4ed42-4fd2-4edb-adcb-85afa3d48672] Deleting volume: bb7deae5-0b8a-49ae-831e-238e56a33596 {{(pid=75210) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 02:02:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:13 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:02:13 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:02:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:13 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Deleted allocations for instance fbb4ed42-4fd2-4edb-adcb-85afa3d48672
Nov 29 02:02:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-3e2e2ef1-3b86-479c-8296-a02cf4896559 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "fbb4ed42-4fd2-4edb-adcb-85afa3d48672" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.344s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:02:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:36 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:38 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:38 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:02:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-48c1091b-67d1-4d0f-96e2-b6ccb8567466" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:02:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-48c1091b-67d1-4d0f-96e2-b6ccb8567466" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:02:38 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:02:39 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Updating instance_info_cache with network_info: [{"id": "a00c75af-2d11-4e42-a2bf-c22357008629", "address": "fa:16:3e:ea:a3:85", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c75af-2d", "ovs_interfaceid": "a00c75af-2d11-4e42-a2bf-c22357008629", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:02:39 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-48c1091b-67d1-4d0f-96e2-b6ccb8567466" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:02:39 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:02:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:02:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:02:44 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:46 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:02:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:48 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:02:48 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:02:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8456MB free_disk=25.23684310913086GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 48c1091b-67d1-4d0f-96e2-b6ccb8567466 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance b9fabd34-7143-4b40-bca8-15b6d2bde253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing inventories for resource provider 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating ProviderTree inventory for provider 28871a06-d5c8-43d0-87af-3689cd143011 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating inventory in ProviderTree for provider 28871a06-d5c8-43d0-87af-3689cd143011 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing aggregate associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, aggregates: None {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 02:02:48 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing trait associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, traits: HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 02:02:49 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:02:49 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:02:49 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:02:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.789s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:02:51 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:51 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances with incomplete migration  {{(pid=75210) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 02:02:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:02:55 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:57 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:02:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 02:02:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] There are 0 instances to clean {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.objects.instance [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'flavor' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquired lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.network.neutron [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.objects.instance [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'info_cache' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.objects.base [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.network.neutron [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updating instance_info_cache with network_info: [{"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Releasing lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:02:58 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Instance destroyed successfully.
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.objects.instance [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'resources' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.objects.base [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1654971335',display_name='tempest-AttachVolumeTestJSON-server-1654971335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1654971335',id=36,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGnqdmpBzYm6z7oGTNZRg+k46dT8ozTAGc/Jui4Cyn5xsrA9EzCgjJ4vksQkVJRWqNU8LRGswNNFzJWUQNeBPWWN26oJbHGu7RqD4PfAoZzP7e8c5Cd769h3F8sF6e9zg==',key_name='tempest-keypair-2129640759',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='64aac75090884257a9c33f94ec9aa367',ramdisk_id='',reservation_id='r-c673118l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-91454133',owner_user_name='tempest-AttachVolumeTestJSON-91454133-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee2d9a0f7574bad97338a59b8ce8968',uuid=34309f2a-e58e-4c00-a80d-0fc86e72e4fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converting VIF {"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG os_vif [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2989e5b-84, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=edff51d1-6504-447b-8c8f-7627285e6b18) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:58 user nova-compute[75210]: INFO os_vif [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84')
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Start _get_guest_xml network_info=[{"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.objects.instance [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'numa_topology' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.objects.base [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:02:58 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:02:58 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.objects.instance [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'vcpu_model' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.objects.base [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1654971335',display_name='tempest-AttachVolumeTestJSON-server-1654971335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1654971335',id=36,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGnqdmpBzYm6z7oGTNZRg+k46dT8ozTAGc/Jui4Cyn5xsrA9EzCgjJ4vksQkVJRWqNU8LRGswNNFzJWUQNeBPWWN26oJbHGu7RqD4PfAoZzP7e8c5Cd769h3F8sF6e9zg==',key_name='tempest-keypair-2129640759',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='64aac75090884257a9c33f94ec9aa367',ramdisk_id='',reservation_id='r-c673118l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-91454133',owner_user_name='tempest-AttachVolumeTestJSON-91454133-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee2d9a0f7574bad97338a59b8ce8968',uuid=34309f2a-e58e-4c00-a80d-0fc86e72e4fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converting VIF {"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.objects.instance [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'pci_devices' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.objects.base [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:02:58 user nova-compute[75210]:   <uuid>34309f2a-e58e-4c00-a80d-0fc86e72e4fa</uuid>
Nov 29 02:02:58 user nova-compute[75210]:   <name>instance-00000024</name>
Nov 29 02:02:58 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:02:58 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:02:58 user nova-compute[75210]:   <metadata>
Nov 29 02:02:58 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:02:58 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:02:58 user nova-compute[75210]:       <nova:name>tempest-AttachVolumeTestJSON-server-1654971335</nova:name>
Nov 29 02:02:58 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:02:58</nova:creationTime>
Nov 29 02:02:58 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:02:58 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:02:58 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:02:58 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:02:58 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:02:58 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:02:58 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:02:58 user nova-compute[75210]:       <nova:owner>
Nov 29 02:02:58 user nova-compute[75210]:         <nova:user uuid="3ee2d9a0f7574bad97338a59b8ce8968">tempest-AttachVolumeTestJSON-91454133-project-member</nova:user>
Nov 29 02:02:58 user nova-compute[75210]:         <nova:project uuid="64aac75090884257a9c33f94ec9aa367">tempest-AttachVolumeTestJSON-91454133</nova:project>
Nov 29 02:02:58 user nova-compute[75210]:       </nova:owner>
Nov 29 02:02:58 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 02:02:58 user nova-compute[75210]:       <nova:ports>
Nov 29 02:02:58 user nova-compute[75210]:         <nova:port uuid="c2989e5b-8405-458d-8862-86a28f95bb38">
Nov 29 02:02:58 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 02:02:58 user nova-compute[75210]:         </nova:port>
Nov 29 02:02:58 user nova-compute[75210]:       </nova:ports>
Nov 29 02:02:58 user nova-compute[75210]:     </nova:instance>
Nov 29 02:02:58 user nova-compute[75210]:   </metadata>
Nov 29 02:02:58 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:02:58 user nova-compute[75210]:     <system>
Nov 29 02:02:58 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:02:58 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:02:58 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:02:58 user nova-compute[75210]:       <entry name="serial">34309f2a-e58e-4c00-a80d-0fc86e72e4fa</entry>
Nov 29 02:02:58 user nova-compute[75210]:       <entry name="uuid">34309f2a-e58e-4c00-a80d-0fc86e72e4fa</entry>
Nov 29 02:02:58 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:02:58 user nova-compute[75210]:     </system>
Nov 29 02:02:58 user nova-compute[75210]:   </sysinfo>
Nov 29 02:02:58 user nova-compute[75210]:   <os>
Nov 29 02:02:58 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:02:58 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:02:58 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:02:58 user nova-compute[75210]:   </os>
Nov 29 02:02:58 user nova-compute[75210]:   <features>
Nov 29 02:02:58 user nova-compute[75210]:     <acpi/>
Nov 29 02:02:58 user nova-compute[75210]:     <apic/>
Nov 29 02:02:58 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:02:58 user nova-compute[75210]:   </features>
Nov 29 02:02:58 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:02:58 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:02:58 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:02:58 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:02:58 user nova-compute[75210]:   </clock>
Nov 29 02:02:58 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:02:58 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:02:58 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:02:58 user nova-compute[75210]:   </cpu>
Nov 29 02:02:58 user nova-compute[75210]:   <devices>
Nov 29 02:02:58 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:02:58 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:02:58 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk"/>
Nov 29 02:02:58 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:02:58 user nova-compute[75210]:     </disk>
Nov 29 02:02:58 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:02:58 user nova-compute[75210]:       <mac address="fa:16:3e:7b:b4:90"/>
Nov 29 02:02:58 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:02:58 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:02:58 user nova-compute[75210]:       <target dev="tapc2989e5b-84"/>
Nov 29 02:02:58 user nova-compute[75210]:     </interface>
Nov 29 02:02:58 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:02:58 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/console.log" append="off"/>
Nov 29 02:02:58 user nova-compute[75210]:     </serial>
Nov 29 02:02:58 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:02:58 user nova-compute[75210]:     <video>
Nov 29 02:02:58 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:02:58 user nova-compute[75210]:     </video>
Nov 29 02:02:58 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:02:58 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:02:58 user nova-compute[75210]:     </rng>
Nov 29 02:02:58 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:02:58 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:02:58 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:02:58 user nova-compute[75210]:     </memballoon>
Nov 29 02:02:58 user nova-compute[75210]:   </devices>
Nov 29 02:02:58 user nova-compute[75210]: </domain>
Nov 29 02:02:58 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:02:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG nova.objects.instance [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'trusted_certs' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG nova.objects.base [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.201s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Cannot resize image /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG nova.objects.instance [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'migration_context' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG nova.objects.base [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Object Instance<34309f2a-e58e-4c00-a80d-0fc86e72e4fa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1654971335',display_name='tempest-AttachVolumeTestJSON-server-1654971335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1654971335',id=36,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGnqdmpBzYm6z7oGTNZRg+k46dT8ozTAGc/Jui4Cyn5xsrA9EzCgjJ4vksQkVJRWqNU8LRGswNNFzJWUQNeBPWWN26oJbHGu7RqD4PfAoZzP7e8c5Cd769h3F8sF6e9zg==',key_name='tempest-keypair-2129640759',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='64aac75090884257a9c33f94ec9aa367',ramdisk_id='',reservation_id='r-c673118l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-91454133',owner_user_name='tempest-AttachVolumeTestJSON-91454133-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee2d9a0f7574bad97338a59b8ce8968',uuid=34309f2a-e58e-4c00-a80d-0fc86e72e4fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converting VIF {"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG os_vif [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecc1b33f-62e6-5db9-82a7-66e573da2219', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2989e5b-84, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2989e5b-84, col_values=(('qos', UUID('a0c10a6b-750f-4018-9843-5ee40a3d55d6')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2989e5b-84, col_values=(('external_ids', {'iface-id': 'c2989e5b-8405-458d-8862-86a28f95bb38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:b4:90', 'vm-uuid': '34309f2a-e58e-4c00-a80d-0fc86e72e4fa'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:02:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:02:59 user nova-compute[75210]: INFO os_vif [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84')
Nov 29 02:03:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-f07c38ab-818f-4227-8fca-a8ed121073ab req-737b40dc-7288-4140-a6a3-beaa40b2b36d service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f07c38ab-818f-4227-8fca-a8ed121073ab req-737b40dc-7288-4140-a6a3-beaa40b2b36d service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f07c38ab-818f-4227-8fca-a8ed121073ab req-737b40dc-7288-4140-a6a3-beaa40b2b36d service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f07c38ab-818f-4227-8fca-a8ed121073ab req-737b40dc-7288-4140-a6a3-beaa40b2b36d service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-f07c38ab-818f-4227-8fca-a8ed121073ab req-737b40dc-7288-4140-a6a3-beaa40b2b36d service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:03:01 user nova-compute[75210]: WARNING nova.compute.manager [req-f07c38ab-818f-4227-8fca-a8ed121073ab req-737b40dc-7288-4140-a6a3-beaa40b2b36d service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state stopped and task_state powering-on.
Nov 29 02:03:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:03:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Instance rebooted successfully.
Nov 29 02:03:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-07bab415-3aae-4c5f-acf9-e0621d1b39da tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:03:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-cd176f7f-e538-4431-8300-161779b7d191 req-7a6988d6-3aed-4b5b-8f01-597b2020ae4a service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cd176f7f-e538-4431-8300-161779b7d191 req-7a6988d6-3aed-4b5b-8f01-597b2020ae4a service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cd176f7f-e538-4431-8300-161779b7d191 req-7a6988d6-3aed-4b5b-8f01-597b2020ae4a service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cd176f7f-e538-4431-8300-161779b7d191 req-7a6988d6-3aed-4b5b-8f01-597b2020ae4a service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-cd176f7f-e538-4431-8300-161779b7d191 req-7a6988d6-3aed-4b5b-8f01-597b2020ae4a service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:03:03 user nova-compute[75210]: WARNING nova.compute.manager [req-cd176f7f-e538-4431-8300-161779b7d191 req-7a6988d6-3aed-4b5b-8f01-597b2020ae4a service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state active and task_state None.
Nov 29 02:03:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:04 user nova-compute[75210]: INFO nova.compute.manager [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Terminating instance
Nov 29 02:03:04 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-1d3a19f6-733d-4b13-9000-d295a6fb7ff2 req-90ab2e87-7c85-4bc2-b6f1-79391e215696 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Received event network-vif-unplugged-a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1d3a19f6-733d-4b13-9000-d295a6fb7ff2 req-90ab2e87-7c85-4bc2-b6f1-79391e215696 service nova] Acquiring lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1d3a19f6-733d-4b13-9000-d295a6fb7ff2 req-90ab2e87-7c85-4bc2-b6f1-79391e215696 service nova] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1d3a19f6-733d-4b13-9000-d295a6fb7ff2 req-90ab2e87-7c85-4bc2-b6f1-79391e215696 service nova] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-1d3a19f6-733d-4b13-9000-d295a6fb7ff2 req-90ab2e87-7c85-4bc2-b6f1-79391e215696 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] No waiting events found dispatching network-vif-unplugged-a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:03:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-1d3a19f6-733d-4b13-9000-d295a6fb7ff2 req-90ab2e87-7c85-4bc2-b6f1-79391e215696 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Received event network-vif-unplugged-a00c75af-2d11-4e42-a2bf-c22357008629 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:03:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Instance destroyed successfully.
Nov 29 02:03:05 user nova-compute[75210]: DEBUG nova.objects.instance [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lazy-loading 'resources' on Instance uuid 48c1091b-67d1-4d0f-96e2-b6ccb8567466 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1973726846',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1973726846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1973726846',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwwuA5a70S+FTZlwrGrzGJAtV9oKYVfIVumFnyEW56EnaqgwmTgWBQc4gZ8eZlvi8V5ju8DZk8PQhGhBrH45y72K4krpbUPM/VIHel3DwCxp8ScqU2UQqW2GNb9MzSsww==',key_name='tempest-keypair-458397239',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:58:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-ykci4t2o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T01:58:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='080bcd228b454b03995b0f3e116df917',uuid=48c1091b-67d1-4d0f-96e2-b6ccb8567466,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a00c75af-2d11-4e42-a2bf-c22357008629", "address": "fa:16:3e:ea:a3:85", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c75af-2d", "ovs_interfaceid": "a00c75af-2d11-4e42-a2bf-c22357008629", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "a00c75af-2d11-4e42-a2bf-c22357008629", "address": "fa:16:3e:ea:a3:85", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa00c75af-2d", "ovs_interfaceid": "a00c75af-2d11-4e42-a2bf-c22357008629", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=a00c75af-2d11-4e42-a2bf-c22357008629,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c75af-2d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_vif [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=a00c75af-2d11-4e42-a2bf-c22357008629,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c75af-2d') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa00c75af-2d, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1999484-8d84-487f-9be2-3661ddbb6b21) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:05 user nova-compute[75210]: INFO os_vif [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a3:85,bridge_name='br-int',has_traffic_filtering=True,id=a00c75af-2d11-4e42-a2bf-c22357008629,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa00c75af-2d')
Nov 29 02:03:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQUJrDZz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:03:05 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1002044-6995-4d58-ae75-161a65da4ac5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:03:05 user nova-compute[75210]: No targets found.
Nov 29 02:03:05 user nova-compute[75210]: iSNS:
Nov 29 02:03:05 user nova-compute[75210]: No targets found.
Nov 29 02:03:05 user nova-compute[75210]: STATIC:
Nov 29 02:03:05 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193
Nov 29 02:03:05 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:03:05 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:03:05 user nova-compute[75210]: FIRMWARE:
Nov 29 02:03:05 user nova-compute[75210]: No targets found.
Nov 29 02:03:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:03:05 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:03:05 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[72aabb12-b636-4dbd-bd76-4503276e221d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6825a1-8ff7-4125-a92c-99a3f6eb9673]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 02:03:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 (non-flash)
Nov 29 02:03:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e81b7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193'): ({'sdd'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Removing single pathed devices sdd {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d67ac3-d145-46f2-ac65-756017936290]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[feacbdb3-b68c-4234-b988-c247649cc759]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flushing IO for device /dev/sdd {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36043d1-d2f8-4f44-bec5-f66572ff408b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa397883-c17b-4551-97ba-828c0ff0a70e]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5f2acb48', '/dev/disk/by-id/scsi-26535633935336639', '/dev/disk/by-id/scsi-1SCST_BIO5f2acb48-e5c953f9d0c33d6c') {{(pid=85542) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a763dcd1-782e-4980-a66f-c5a0f19dc529]: (4, None) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[96008847-d2cf-4b9c-ac6c-1192bf342764]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3e820e-ca98-4d4a-bca7-fe07f1453f50]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193, portal: 172.16.0.220,3260]
Nov 29 02:03:05 user nova-compute[75210]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193, portal: 172.16.0.220,3260] successful.
Nov 29 02:03:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f56805d-79ba-4c98-b5d7-0d4157812193 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c52338e-5053-49cd-94ca-2de37d8c0191]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== disconnect_volume: return (307ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:03:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Deleting instance files /opt/stack/data/nova/instances/48c1091b-67d1-4d0f-96e2-b6ccb8567466_del
Nov 29 02:03:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Deletion of /opt/stack/data/nova/instances/48c1091b-67d1-4d0f-96e2-b6ccb8567466_del complete
Nov 29 02:03:05 user nova-compute[75210]: INFO nova.compute.manager [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 29 02:03:05 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:03:05 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:03:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:06 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:03:06 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Took 1.09 seconds to deallocate network for instance.
Nov 29 02:03:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-c8671a9e-746d-4105-8bfd-1de14ce26164 req-6de4149d-6970-4205-9aa4-de660c4a07d7 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Received event network-vif-plugged-a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c8671a9e-746d-4105-8bfd-1de14ce26164 req-6de4149d-6970-4205-9aa4-de660c4a07d7 service nova] Acquiring lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c8671a9e-746d-4105-8bfd-1de14ce26164 req-6de4149d-6970-4205-9aa4-de660c4a07d7 service nova] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c8671a9e-746d-4105-8bfd-1de14ce26164 req-6de4149d-6970-4205-9aa4-de660c4a07d7 service nova] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-c8671a9e-746d-4105-8bfd-1de14ce26164 req-6de4149d-6970-4205-9aa4-de660c4a07d7 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] No waiting events found dispatching network-vif-plugged-a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:03:06 user nova-compute[75210]: WARNING nova.compute.manager [req-c8671a9e-746d-4105-8bfd-1de14ce26164 req-6de4149d-6970-4205-9aa4-de660c4a07d7 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Received unexpected event network-vif-plugged-a00c75af-2d11-4e42-a2bf-c22357008629 for instance with vm_state active and task_state deleting.
Nov 29 02:03:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-c8671a9e-746d-4105-8bfd-1de14ce26164 req-6de4149d-6970-4205-9aa4-de660c4a07d7 service nova] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Received event network-vif-deleted-a00c75af-2d11-4e42-a2bf-c22357008629 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:07 user nova-compute[75210]: INFO nova.compute.manager [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Took 0.79 seconds to detach 1 volumes for instance.
Nov 29 02:03:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 48c1091b-67d1-4d0f-96e2-b6ccb8567466] Deleting volume: 9f56805d-79ba-4c98-b5d7-0d4157812193 {{(pid=75210) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 29 02:03:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:07 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:03:07 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:03:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:07 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Deleted allocations for instance 48c1091b-67d1-4d0f-96e2-b6ccb8567466
Nov 29 02:03:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Acquiring lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Acquiring lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:07 user nova-compute[75210]: INFO nova.compute.manager [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Terminating instance
Nov 29 02:03:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:03:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ced5112-193d-445c-ab99-7bbd1db06c6f tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "48c1091b-67d1-4d0f-96e2-b6ccb8567466" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.540s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-022cad45-be54-435a-b891-0c1d37f6367f req-58cf6b70-fc5a-4bee-8a99-05ee3bdbde5a service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received event network-vif-unplugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-022cad45-be54-435a-b891-0c1d37f6367f req-58cf6b70-fc5a-4bee-8a99-05ee3bdbde5a service nova] Acquiring lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-022cad45-be54-435a-b891-0c1d37f6367f req-58cf6b70-fc5a-4bee-8a99-05ee3bdbde5a service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-022cad45-be54-435a-b891-0c1d37f6367f req-58cf6b70-fc5a-4bee-8a99-05ee3bdbde5a service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-022cad45-be54-435a-b891-0c1d37f6367f req-58cf6b70-fc5a-4bee-8a99-05ee3bdbde5a service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] No waiting events found dispatching network-vif-unplugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-022cad45-be54-435a-b891-0c1d37f6367f req-58cf6b70-fc5a-4bee-8a99-05ee3bdbde5a service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received event network-vif-unplugged-740ef7f8-f8e1-4073-91b2-be629357e759 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:08 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Instance destroyed successfully.
Nov 29 02:03:08 user nova-compute[75210]: DEBUG nova.objects.instance [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lazy-loading 'resources' on Instance uuid 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-973240312',display_name='tempest-VolumesNegativeTest-instance-973240312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-973240312',id=40,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:01:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa47c61b2426455e96936aae51d3ad74',ramdisk_id='',reservation_id='r-1xm2vug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-632785540',owner_user_name='tempest-VolumesNegativeTest-632785540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:01:24Z,user_data=None,user_id='20b0e8774de54c108f39ad3e56175d2b',uuid=3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "740ef7f8-f8e1-4073-91b2-be629357e759", "address": "fa:16:3e:e2:8e:cf", "network": {"id": "a4fcd825-5e74-4c22-8c62-912833bd4848", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d462191b18242ee876eccb74d204f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740ef7f8-f8", "ovs_interfaceid": "740ef7f8-f8e1-4073-91b2-be629357e759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Converting VIF {"id": "740ef7f8-f8e1-4073-91b2-be629357e759", "address": "fa:16:3e:e2:8e:cf", "network": {"id": "a4fcd825-5e74-4c22-8c62-912833bd4848", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d462191b18242ee876eccb74d204f68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap740ef7f8-f8", "ovs_interfaceid": "740ef7f8-f8e1-4073-91b2-be629357e759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:cf,bridge_name='br-int',has_traffic_filtering=True,id=740ef7f8-f8e1-4073-91b2-be629357e759,network=Network(a4fcd825-5e74-4c22-8c62-912833bd4848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740ef7f8-f8') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG os_vif [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:cf,bridge_name='br-int',has_traffic_filtering=True,id=740ef7f8-f8e1-4073-91b2-be629357e759,network=Network(a4fcd825-5e74-4c22-8c62-912833bd4848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740ef7f8-f8') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap740ef7f8-f8, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f092340e-9b23-4e3b-a13f-2e4644e1abfa) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:08 user nova-compute[75210]: INFO os_vif [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:8e:cf,bridge_name='br-int',has_traffic_filtering=True,id=740ef7f8-f8e1-4073-91b2-be629357e759,network=Network(a4fcd825-5e74-4c22-8c62-912833bd4848),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap740ef7f8-f8')
Nov 29 02:03:08 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Deleting instance files /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f_del
Nov 29 02:03:08 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Deletion of /opt/stack/data/nova/instances/3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f_del complete
Nov 29 02:03:08 user nova-compute[75210]: INFO nova.compute.manager [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 29 02:03:08 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:03:08 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:03:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:09 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:03:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:09 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Took 0.47 seconds to deallocate network for instance.
Nov 29 02:03:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-2fa6d753-be05-417b-98e8-6a072bc31af8 req-3ef303e0-7e58-4bbe-b0cf-c87eae72203f service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received event network-vif-deleted-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:09 user nova-compute[75210]: INFO nova.compute.manager [req-2fa6d753-be05-417b-98e8-6a072bc31af8 req-3ef303e0-7e58-4bbe-b0cf-c87eae72203f service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Neutron deleted interface 740ef7f8-f8e1-4073-91b2-be629357e759; detaching it from the instance and deleting it from the info cache
Nov 29 02:03:09 user nova-compute[75210]: DEBUG nova.network.neutron [req-2fa6d753-be05-417b-98e8-6a072bc31af8 req-3ef303e0-7e58-4bbe-b0cf-c87eae72203f service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:03:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-2fa6d753-be05-417b-98e8-6a072bc31af8 req-3ef303e0-7e58-4bbe-b0cf-c87eae72203f service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Detach interface failed, port_id=740ef7f8-f8e1-4073-91b2-be629357e759, reason: Instance 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 02:03:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:09 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:03:09 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:03:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:09 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Deleted allocations for instance 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f
Nov 29 02:03:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-df20b10c-b3bb-4924-bb86-a39a3c5ee03c tempest-VolumesNegativeTest-632785540 tempest-VolumesNegativeTest-632785540-project-member] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.871s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received event network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] Acquiring lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] No waiting events found dispatching network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:03:10 user nova-compute[75210]: WARNING nova.compute.manager [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received unexpected event network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 for instance with vm_state deleted and task_state None.
Nov 29 02:03:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received event network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] Acquiring lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] No waiting events found dispatching network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:03:10 user nova-compute[75210]: WARNING nova.compute.manager [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received unexpected event network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 for instance with vm_state deleted and task_state None.
Nov 29 02:03:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received event network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] Acquiring lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] No waiting events found dispatching network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:03:10 user nova-compute[75210]: WARNING nova.compute.manager [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received unexpected event network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 for instance with vm_state deleted and task_state None.
Nov 29 02:03:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received event network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] Acquiring lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] Lock "3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] No waiting events found dispatching network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:03:10 user nova-compute[75210]: WARNING nova.compute.manager [req-705d87cc-0c60-4001-a29d-1f7a3d880af1 req-9b6e215f-945f-4cc2-b0e1-63f789fbf038 service nova] [instance: 3f111ba6-9ca4-4c79-acb4-4a3d8f93c91f] Received unexpected event network-vif-plugged-740ef7f8-f8e1-4073-91b2-be629357e759 for instance with vm_state deleted and task_state None.
Nov 29 02:03:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:15 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_power_states {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:03:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 02:03:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 02:03:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid b9fabd34-7143-4b40-bca8-15b6d2bde253 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 02:03:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:03:20 user nova-compute[75210]: DEBUG nova.compute.manager [req-6104930d-d4e1-4880-9859-1a9d35cc1163 req-4f3c4796-0331-4c09-9a96-ce19ffe3c394 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-changed-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:20 user nova-compute[75210]: DEBUG nova.compute.manager [req-6104930d-d4e1-4880-9859-1a9d35cc1163 req-4f3c4796-0331-4c09-9a96-ce19ffe3c394 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Refreshing instance network info cache due to event network-changed-24af94e3-44d6-4bd9-8dbb-ded94daa2b62. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:03:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6104930d-d4e1-4880-9859-1a9d35cc1163 req-4f3c4796-0331-4c09-9a96-ce19ffe3c394 service nova] Acquiring lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:03:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6104930d-d4e1-4880-9859-1a9d35cc1163 req-4f3c4796-0331-4c09-9a96-ce19ffe3c394 service nova] Acquired lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:03:20 user nova-compute[75210]: DEBUG nova.network.neutron [req-6104930d-d4e1-4880-9859-1a9d35cc1163 req-4f3c4796-0331-4c09-9a96-ce19ffe3c394 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Refreshing network info cache for port 24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:03:21 user nova-compute[75210]: DEBUG nova.network.neutron [req-6104930d-d4e1-4880-9859-1a9d35cc1163 req-4f3c4796-0331-4c09-9a96-ce19ffe3c394 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updated VIF entry in instance network info cache for port 24af94e3-44d6-4bd9-8dbb-ded94daa2b62. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:03:21 user nova-compute[75210]: DEBUG nova.network.neutron [req-6104930d-d4e1-4880-9859-1a9d35cc1163 req-4f3c4796-0331-4c09-9a96-ce19ffe3c394 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updating instance_info_cache with network_info: [{"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:03:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6104930d-d4e1-4880-9859-1a9d35cc1163 req-4f3c4796-0331-4c09-9a96-ce19ffe3c394 service nova] Releasing lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:03:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:21 user nova-compute[75210]: DEBUG nova.compute.manager [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:03:21 user nova-compute[75210]: INFO nova.compute.manager [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] instance snapshotting
Nov 29 02:03:21 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Beginning live snapshot process
Nov 29 02:03:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json -f qcow2 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json -f qcow2 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfwlp75qs/4d7f78a6479540cfbfc8be865a494edb.delta 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfwlp75qs/4d7f78a6479540cfbfc8be865a494edb.delta 1073741824" returned: 0 in 0.055s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:22 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 29 02:03:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 02:03:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75210) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 29 02:03:23 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 29 02:03:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:23 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 02:03:23 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfwlp75qs/4d7f78a6479540cfbfc8be865a494edb.delta /opt/stack/data/nova/instances/snapshots/tmpfwlp75qs/4d7f78a6479540cfbfc8be865a494edb {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfwlp75qs/4d7f78a6479540cfbfc8be865a494edb.delta /opt/stack/data/nova/instances/snapshots/tmpfwlp75qs/4d7f78a6479540cfbfc8be865a494edb" returned: 0 in 0.652s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Snapshot extracted, beginning image upload
Nov 29 02:03:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:27 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Snapshot image upload complete
Nov 29 02:03:27 user nova-compute[75210]: INFO nova.compute.manager [None req-31339961-544e-4e05-911e-d24e45018bd3 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Took 5.43 seconds to snapshot the instance on the hypervisor.
Nov 29 02:03:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:35 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:03:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:37 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:03:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:40 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:03:40 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:03:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:03:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:03:40 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:03:40 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updating instance_info_cache with network_info: [{"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:03:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:03:41 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:03:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:03:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:03:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:03:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:03:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:03:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:03:46 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:03:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:03:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:47 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:03:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:47 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:49 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:03:49 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:03:49 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8609MB free_disk=25.213775634765625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:03:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:49 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:03:49 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:03:49 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance b9fabd34-7143-4b40-bca8-15b6d2bde253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:03:49 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:03:49 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:03:49 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:03:49 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:03:49 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:03:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:03:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:03:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:03:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:03:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:03:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-d2745a33-2c25-43cc-857a-0362c1eb5db3 req-e2ecf29f-8240-40d6-93ed-6a1379f321f8 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-changed-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:54 user nova-compute[75210]: DEBUG nova.compute.manager [req-d2745a33-2c25-43cc-857a-0362c1eb5db3 req-e2ecf29f-8240-40d6-93ed-6a1379f321f8 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Refreshing instance network info cache due to event network-changed-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:03:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d2745a33-2c25-43cc-857a-0362c1eb5db3 req-e2ecf29f-8240-40d6-93ed-6a1379f321f8 service nova] Acquiring lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:03:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d2745a33-2c25-43cc-857a-0362c1eb5db3 req-e2ecf29f-8240-40d6-93ed-6a1379f321f8 service nova] Acquired lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:03:54 user nova-compute[75210]: DEBUG nova.network.neutron [req-d2745a33-2c25-43cc-857a-0362c1eb5db3 req-e2ecf29f-8240-40d6-93ed-6a1379f321f8 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Refreshing network info cache for port 6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:03:55 user nova-compute[75210]: DEBUG nova.network.neutron [req-d2745a33-2c25-43cc-857a-0362c1eb5db3 req-e2ecf29f-8240-40d6-93ed-6a1379f321f8 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updated VIF entry in instance network info cache for port 6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:03:55 user nova-compute[75210]: DEBUG nova.network.neutron [req-d2745a33-2c25-43cc-857a-0362c1eb5db3 req-e2ecf29f-8240-40d6-93ed-6a1379f321f8 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updating instance_info_cache with network_info: [{"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:03:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d2745a33-2c25-43cc-857a-0362c1eb5db3 req-e2ecf29f-8240-40d6-93ed-6a1379f321f8 service nova] Releasing lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:03:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:58 user nova-compute[75210]: INFO nova.compute.manager [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Shelving
Nov 29 02:03:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-66e5c9a5-7dbd-45ff-a068-c2fc46eb2d2b req-16485092-6782-4aa4-aa93-644465896a37 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-vif-unplugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:03:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-66e5c9a5-7dbd-45ff-a068-c2fc46eb2d2b req-16485092-6782-4aa4-aa93-644465896a37 service nova] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:03:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-66e5c9a5-7dbd-45ff-a068-c2fc46eb2d2b req-16485092-6782-4aa4-aa93-644465896a37 service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:03:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-66e5c9a5-7dbd-45ff-a068-c2fc46eb2d2b req-16485092-6782-4aa4-aa93-644465896a37 service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:03:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-66e5c9a5-7dbd-45ff-a068-c2fc46eb2d2b req-16485092-6782-4aa4-aa93-644465896a37 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] No waiting events found dispatching network-vif-unplugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:03:58 user nova-compute[75210]: WARNING nova.compute.manager [req-66e5c9a5-7dbd-45ff-a068-c2fc46eb2d2b req-16485092-6782-4aa4-aa93-644465896a37 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received unexpected event network-vif-unplugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 for instance with vm_state active and task_state shelving.
Nov 29 02:03:58 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Instance destroyed successfully.
Nov 29 02:03:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:03:59 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Beginning cold snapshot process
Nov 29 02:03:59 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 02:03:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk /opt/stack/data/nova/instances/snapshots/tmp1d1kjtxn/2a4508fa637f45de977eddeec685b7ab {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:03:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk /opt/stack/data/nova/instances/snapshots/tmp1d1kjtxn/2a4508fa637f45de977eddeec685b7ab" returned: 0 in 0.494s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:03:59 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Snapshot extracted, beginning image upload
Nov 29 02:04:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ab9c4c9-1aaf-4f65-9a91-2fdd621a4138 req-56bd759b-66af-4401-b868-c73b2cb62990 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:04:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ab9c4c9-1aaf-4f65-9a91-2fdd621a4138 req-56bd759b-66af-4401-b868-c73b2cb62990 service nova] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ab9c4c9-1aaf-4f65-9a91-2fdd621a4138 req-56bd759b-66af-4401-b868-c73b2cb62990 service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ab9c4c9-1aaf-4f65-9a91-2fdd621a4138 req-56bd759b-66af-4401-b868-c73b2cb62990 service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ab9c4c9-1aaf-4f65-9a91-2fdd621a4138 req-56bd759b-66af-4401-b868-c73b2cb62990 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] No waiting events found dispatching network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:04:00 user nova-compute[75210]: WARNING nova.compute.manager [req-5ab9c4c9-1aaf-4f65-9a91-2fdd621a4138 req-56bd759b-66af-4401-b868-c73b2cb62990 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received unexpected event network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 02:04:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Snapshot image upload complete
Nov 29 02:04:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:04:02 user nova-compute[75210]: INFO nova.compute.manager [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Shelve offloading
Nov 29 02:04:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Instance destroyed successfully.
Nov 29 02:04:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:04:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:04:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquired lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:04:02 user nova-compute[75210]: DEBUG nova.network.neutron [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:04:02 user nova-compute[75210]: DEBUG nova.network.neutron [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updating instance_info_cache with network_info: [{"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:04:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Releasing lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:04:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Instance destroyed successfully.
Nov 29 02:04:03 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'resources' on Instance uuid b9fabd34-7143-4b40-bca8-15b6d2bde253 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1647236808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1647236808',id=42,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdVWiwc5/SKu6fnoi3dYT1LiowcWPktBHEWHutt6M7BjBMCEx/7qjI8dA26d5mga/+5Ur17Ya2Iw/PaVNqxoVhIUUQMZFzVL8AOmpHosZ7kB+Ok5bzb5xIphm/Xt4BzHQ==',key_name='tempest-keypair-785264678',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:02:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='55934a4b47ab45a4a7f389919225c156',ramdisk_id='',reservation_id='r-ygxad600',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2088736241',owner_user_name='tempest-AttachVolumeShelveTestJSON-2088736241-project-member',shelved_at='2023-11-29T02:04:02.266973',shelved_host='user',shelved_image_id='3083fe68-5446-46b3-971c-019dcf3df086'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f7a67a01104567b3e96f9d150dddd2',uuid=b9fabd34-7143-4b40-bca8-15b6d2bde253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converting VIF {"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG os_vif [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f0dfb9d-2c, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-e809d317-65ec-4674-b013-47edc777a415 req-a02f19bc-3b78-46d0-8265-36b8de523b02 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-changed-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-e809d317-65ec-4674-b013-47edc777a415 req-a02f19bc-3b78-46d0-8265-36b8de523b02 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Refreshing instance network info cache due to event network-changed-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e809d317-65ec-4674-b013-47edc777a415 req-a02f19bc-3b78-46d0-8265-36b8de523b02 service nova] Acquiring lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e809d317-65ec-4674-b013-47edc777a415 req-a02f19bc-3b78-46d0-8265-36b8de523b02 service nova] Acquired lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG nova.network.neutron [req-e809d317-65ec-4674-b013-47edc777a415 req-a02f19bc-3b78-46d0-8265-36b8de523b02 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Refreshing network info cache for port 6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56754134-5f8b-49f8-bf56-24532fa31979) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:03 user nova-compute[75210]: INFO os_vif [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c')
Nov 29 02:04:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Deleting instance files /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253_del
Nov 29 02:04:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Deletion of /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253_del complete
Nov 29 02:04:03 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Deleted allocations for instance b9fabd34-7143-4b40-bca8-15b6d2bde253
Nov 29 02:04:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'numa_topology' on Instance uuid b9fabd34-7143-4b40-bca8-15b6d2bde253 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG nova.objects.base [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Object Instance<b9fabd34-7143-4b40-bca8-15b6d2bde253> lazy-loaded attributes: resources,numa_topology {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2eb24522-3792-470c-8001-940e204e3ba4 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.358s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG nova.network.neutron [req-e809d317-65ec-4674-b013-47edc777a415 req-a02f19bc-3b78-46d0-8265-36b8de523b02 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updated VIF entry in instance network info cache for port 6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG nova.network.neutron [req-e809d317-65ec-4674-b013-47edc777a415 req-a02f19bc-3b78-46d0-8265-36b8de523b02 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updating instance_info_cache with network_info: [{"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:04:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e809d317-65ec-4674-b013-47edc777a415 req-a02f19bc-3b78-46d0-8265-36b8de523b02 service nova] Releasing lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:04:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:04 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:04:05 user nova-compute[75210]: INFO nova.compute.claims [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Claim successful on node user
Nov 29 02:04:05 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:04:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:04:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG nova.policy [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '080bcd228b454b03995b0f3e116df917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70d8cbb4232433cbd0db9e9448d897f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:04:05 user nova-compute[75210]: INFO nova.virt.block_device [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Booting with volume 85345339-62fb-4ea2-93e5-5ece2bae3b18 at /dev/vda
Nov 29 02:04:05 user nova-compute[75210]: DEBUG os_brick.utils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9c6d68-6c96-4967-8cfa-d3065c1c8a63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[43456703-b838-40c6-ba6c-afb0641aaf0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6025eff8-f93f-4592-80f7-b9f8103d068f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[622344f4-d082-4469-968d-f000f4d6966f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:04:05 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:04:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a4fe2c-98b5-4359-b29c-84729af8d8d2]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG os_brick.utils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== get_connector_properties: return (207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:04:05 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Updating existing volume attachment record: 14de8db8-99bd-4c9e-810f-1773580ec13a {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:04:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:06 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Successfully created port: 331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:04:06 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Successfully updated port: 331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:04:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "refresh_cache-8d971e56-00ad-4c02-8cfc-98a04ae8f528" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:04:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquired lock "refresh_cache-8d971e56-00ad-4c02-8cfc-98a04ae8f528" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:04:06 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:04:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-8210a294-b4f5-4bf5-a079-5e8f61cb4446 req-83797d10-4c9f-4bbc-b21f-71b5826289e0 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Received event network-changed-331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:04:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-8210a294-b4f5-4bf5-a079-5e8f61cb4446 req-83797d10-4c9f-4bbc-b21f-71b5826289e0 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Refreshing instance network info cache due to event network-changed-331dcb66-bd77-4e4b-9962-6742ebf5f82b. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:04:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8210a294-b4f5-4bf5-a079-5e8f61cb4446 req-83797d10-4c9f-4bbc-b21f-71b5826289e0 service nova] Acquiring lock "refresh_cache-8d971e56-00ad-4c02-8cfc-98a04ae8f528" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:04:07 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:04:07 user nova-compute[75210]: DEBUG nova.network.neutron [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Updating instance_info_cache with network_info: [{"id": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "address": "fa:16:3e:61:4d:19", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331dcb66-bd", "ovs_interfaceid": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:04:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Releasing lock "refresh_cache-8d971e56-00ad-4c02-8cfc-98a04ae8f528" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:04:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Instance network_info: |[{"id": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "address": "fa:16:3e:61:4d:19", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331dcb66-bd", "ovs_interfaceid": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:04:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8210a294-b4f5-4bf5-a079-5e8f61cb4446 req-83797d10-4c9f-4bbc-b21f-71b5826289e0 service nova] Acquired lock "refresh_cache-8d971e56-00ad-4c02-8cfc-98a04ae8f528" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:04:07 user nova-compute[75210]: DEBUG nova.network.neutron [req-8210a294-b4f5-4bf5-a079-5e8f61cb4446 req-83797d10-4c9f-4bbc-b21f-71b5826289e0 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Refreshing network info cache for port 331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:04:07 user nova-compute[75210]: DEBUG nova.network.neutron [req-8210a294-b4f5-4bf5-a079-5e8f61cb4446 req-83797d10-4c9f-4bbc-b21f-71b5826289e0 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Updated VIF entry in instance network info cache for port 331dcb66-bd77-4e4b-9962-6742ebf5f82b. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:04:07 user nova-compute[75210]: DEBUG nova.network.neutron [req-8210a294-b4f5-4bf5-a079-5e8f61cb4446 req-83797d10-4c9f-4bbc-b21f-71b5826289e0 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Updating instance_info_cache with network_info: [{"id": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "address": "fa:16:3e:61:4d:19", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331dcb66-bd", "ovs_interfaceid": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:04:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8210a294-b4f5-4bf5-a079-5e8f61cb4446 req-83797d10-4c9f-4bbc-b21f-71b5826289e0 service nova] Releasing lock "refresh_cache-8d971e56-00ad-4c02-8cfc-98a04ae8f528" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:04:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:04:13 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Creating image(s)
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Ensure instance console log exists: /opt/stack/data/nova/instances/8d971e56-00ad-4c02-8cfc-98a04ae8f528/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Start _get_guest_xml network_info=[{"id": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "address": "fa:16:3e:61:4d:19", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331dcb66-bd", "ovs_interfaceid": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '14de8db8-99bd-4c9e-810f-1773580ec13a', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpNytGVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d971e56-00ad-4c02-8cfc-98a04ae8f528', 'attached_at': '', 'detached_at': '', 'volume_id': '85345339-62fb-4ea2-93e5-5ece2bae3b18', 'serial': '85345339-62fb-4ea2-93e5-5ece2bae3b18'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:04:13 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:04:13 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpNytGVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:04:13 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:04:13 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:04:13 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2115a0cf-458f-492c-aeff-d2d0779d314d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:04:13 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd6eaa8-38dc-41ea-8a06-641f4f0c8374]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18] added
Nov 29 02:04:13 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c372128e-e2ef-40a8-a641-ac21db8c9b06]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c6ed25-84fd-40f3-aefe-1a5043de0171]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CpNytGVo {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CpNytGVo" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1665fd92-683c-440d-b2cd-17e2596d481f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CpNytGVo'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8359300b-a0f8-472f-b276-c12e3a30325f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb4f0e1-f7da-4376-b9cc-98297a860da6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:04:13 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:04:13 user nova-compute[75210]:  {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:04:13 user nova-compute[75210]: WARNING os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 02:04:13 user nova-compute[75210]: 
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad982ca-d45b-48c0-a3ef-3cfebb5cc1f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260]
Nov 29 02:04:13 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260] successful.
Nov 29 02:04:13 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8920adb-94b0-434a-97bd-fb6580da006b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[21db63b4-6d70-49c6-aaa7-44b0c36eb70b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:04:13 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:04:13 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[205e7f2f-846c-4607-bdb1-fe3bec44a374]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:04:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpNytGVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23937613765633764', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937613765633764', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1245055753',display_name='tempest-TestVolumeBootPattern-server-1245055753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1245055753',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbeEJ035qedgw6ffpy9AgBMNgjtmpEug1BnI4ukxa+OzSVx7eUZOgpnD5Ot84IR7Q55P3We053ESM83PfYsrIt51L3Ie8cNeSPyWbkxkw4BsGC2WohQHJL8Q1MriTltHA==',key_name='tempest-TestVolumeBootPattern-274321318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-uobe9bow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:04:05Z,user_data=None,user_id='080bcd228b454b03995b0f3e116df917',uuid=8d971e56-00ad-4c02-8cfc-98a04ae8f528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "address": "fa:16:3e:61:4d:19", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331dcb66-bd", "ovs_interfaceid": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "address": "fa:16:3e:61:4d:19", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331dcb66-bd", "ovs_interfaceid": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:4d:19,bridge_name='br-int',has_traffic_filtering=True,id=331dcb66-bd77-4e4b-9962-6742ebf5f82b,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331dcb66-bd') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG nova.objects.instance [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d971e56-00ad-4c02-8cfc-98a04ae8f528 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:04:14 user nova-compute[75210]:   <uuid>8d971e56-00ad-4c02-8cfc-98a04ae8f528</uuid>
Nov 29 02:04:14 user nova-compute[75210]:   <name>instance-0000002b</name>
Nov 29 02:04:14 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:04:14 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:04:14 user nova-compute[75210]:   <metadata>
Nov 29 02:04:14 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:04:14 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:04:14 user nova-compute[75210]:       <nova:name>tempest-TestVolumeBootPattern-server-1245055753</nova:name>
Nov 29 02:04:14 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:04:13</nova:creationTime>
Nov 29 02:04:14 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:04:14 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:04:14 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:04:14 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:04:14 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:04:14 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:04:14 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:04:14 user nova-compute[75210]:       <nova:owner>
Nov 29 02:04:14 user nova-compute[75210]:         <nova:user uuid="080bcd228b454b03995b0f3e116df917">tempest-TestVolumeBootPattern-670838009-project-member</nova:user>
Nov 29 02:04:14 user nova-compute[75210]:         <nova:project uuid="f70d8cbb4232433cbd0db9e9448d897f">tempest-TestVolumeBootPattern-670838009</nova:project>
Nov 29 02:04:14 user nova-compute[75210]:       </nova:owner>
Nov 29 02:04:14 user nova-compute[75210]:       <nova:ports>
Nov 29 02:04:14 user nova-compute[75210]:         <nova:port uuid="331dcb66-bd77-4e4b-9962-6742ebf5f82b">
Nov 29 02:04:14 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 29 02:04:14 user nova-compute[75210]:         </nova:port>
Nov 29 02:04:14 user nova-compute[75210]:       </nova:ports>
Nov 29 02:04:14 user nova-compute[75210]:     </nova:instance>
Nov 29 02:04:14 user nova-compute[75210]:   </metadata>
Nov 29 02:04:14 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:04:14 user nova-compute[75210]:     <system>
Nov 29 02:04:14 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:04:14 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:04:14 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:04:14 user nova-compute[75210]:       <entry name="serial">8d971e56-00ad-4c02-8cfc-98a04ae8f528</entry>
Nov 29 02:04:14 user nova-compute[75210]:       <entry name="uuid">8d971e56-00ad-4c02-8cfc-98a04ae8f528</entry>
Nov 29 02:04:14 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:04:14 user nova-compute[75210]:     </system>
Nov 29 02:04:14 user nova-compute[75210]:   </sysinfo>
Nov 29 02:04:14 user nova-compute[75210]:   <os>
Nov 29 02:04:14 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:04:14 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:04:14 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:04:14 user nova-compute[75210]:   </os>
Nov 29 02:04:14 user nova-compute[75210]:   <features>
Nov 29 02:04:14 user nova-compute[75210]:     <acpi/>
Nov 29 02:04:14 user nova-compute[75210]:     <apic/>
Nov 29 02:04:14 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:04:14 user nova-compute[75210]:   </features>
Nov 29 02:04:14 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:04:14 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:04:14 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:04:14 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:04:14 user nova-compute[75210]:   </clock>
Nov 29 02:04:14 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:04:14 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:04:14 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:04:14 user nova-compute[75210]:   </cpu>
Nov 29 02:04:14 user nova-compute[75210]:   <devices>
Nov 29 02:04:14 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 02:04:14 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:04:14 user nova-compute[75210]:       <source dev="/dev/sdb"/>
Nov 29 02:04:14 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:04:14 user nova-compute[75210]:       <serial>85345339-62fb-4ea2-93e5-5ece2bae3b18</serial>
Nov 29 02:04:14 user nova-compute[75210]:     </disk>
Nov 29 02:04:14 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:04:14 user nova-compute[75210]:       <mac address="fa:16:3e:61:4d:19"/>
Nov 29 02:04:14 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:04:14 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:04:14 user nova-compute[75210]:       <target dev="tap331dcb66-bd"/>
Nov 29 02:04:14 user nova-compute[75210]:     </interface>
Nov 29 02:04:14 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:04:14 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/8d971e56-00ad-4c02-8cfc-98a04ae8f528/console.log" append="off"/>
Nov 29 02:04:14 user nova-compute[75210]:     </serial>
Nov 29 02:04:14 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:04:14 user nova-compute[75210]:     <video>
Nov 29 02:04:14 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:04:14 user nova-compute[75210]:     </video>
Nov 29 02:04:14 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:04:14 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:04:14 user nova-compute[75210]:     </rng>
Nov 29 02:04:14 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:04:14 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:04:14 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:04:14 user nova-compute[75210]:     </memballoon>
Nov 29 02:04:14 user nova-compute[75210]:   </devices>
Nov 29 02:04:14 user nova-compute[75210]: </domain>
Nov 29 02:04:14 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1245055753',display_name='tempest-TestVolumeBootPattern-server-1245055753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1245055753',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbeEJ035qedgw6ffpy9AgBMNgjtmpEug1BnI4ukxa+OzSVx7eUZOgpnD5Ot84IR7Q55P3We053ESM83PfYsrIt51L3Ie8cNeSPyWbkxkw4BsGC2WohQHJL8Q1MriTltHA==',key_name='tempest-TestVolumeBootPattern-274321318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-uobe9bow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:04:05Z,user_data=None,user_id='080bcd228b454b03995b0f3e116df917',uuid=8d971e56-00ad-4c02-8cfc-98a04ae8f528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "address": "fa:16:3e:61:4d:19", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331dcb66-bd", "ovs_interfaceid": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "address": "fa:16:3e:61:4d:19", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331dcb66-bd", "ovs_interfaceid": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:4d:19,bridge_name='br-int',has_traffic_filtering=True,id=331dcb66-bd77-4e4b-9962-6742ebf5f82b,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331dcb66-bd') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG os_vif [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:4d:19,bridge_name='br-int',has_traffic_filtering=True,id=331dcb66-bd77-4e4b-9962-6742ebf5f82b,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331dcb66-bd') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e8e0792-e6b4-5dbf-b7a7-05a5e3b333ab', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap331dcb66-bd, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap331dcb66-bd, col_values=(('qos', UUID('89ea18e0-ca4f-41e3-aae5-7716b6c1f1a6')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap331dcb66-bd, col_values=(('external_ids', {'iface-id': '331dcb66-bd77-4e4b-9962-6742ebf5f82b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:4d:19', 'vm-uuid': '8d971e56-00ad-4c02-8cfc-98a04ae8f528'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:14 user nova-compute[75210]: INFO os_vif [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:4d:19,bridge_name='br-int',has_traffic_filtering=True,id=331dcb66-bd77-4e4b-9962-6742ebf5f82b,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331dcb66-bd')
Nov 29 02:04:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:04:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] No VIF found with MAC fa:16:3e:61:4d:19, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:04:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:18 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:04:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:04:18 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Instance spawned successfully.
Nov 29 02:04:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:04:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:04:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:04:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:04:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:04:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:04:18 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:04:18 user nova-compute[75210]: INFO nova.compute.manager [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 29 02:04:18 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:04:18 user nova-compute[75210]: INFO nova.compute.manager [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Took 13.53 seconds to build instance.
Nov 29 02:04:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ebd3028b-bad9-42b9-828b-d94fc1874b73 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.624s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-83eb5ae1-4eef-4ca5-b341-d16099fea8f8 req-8c727dd1-ea02-491d-b225-f75cbf975d66 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Received event network-vif-plugged-331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:04:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-83eb5ae1-4eef-4ca5-b341-d16099fea8f8 req-8c727dd1-ea02-491d-b225-f75cbf975d66 service nova] Acquiring lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-83eb5ae1-4eef-4ca5-b341-d16099fea8f8 req-8c727dd1-ea02-491d-b225-f75cbf975d66 service nova] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-83eb5ae1-4eef-4ca5-b341-d16099fea8f8 req-8c727dd1-ea02-491d-b225-f75cbf975d66 service nova] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-83eb5ae1-4eef-4ca5-b341-d16099fea8f8 req-8c727dd1-ea02-491d-b225-f75cbf975d66 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] No waiting events found dispatching network-vif-plugged-331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:04:21 user nova-compute[75210]: WARNING nova.compute.manager [req-83eb5ae1-4eef-4ca5-b341-d16099fea8f8 req-8c727dd1-ea02-491d-b225-f75cbf975d66 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Received unexpected event network-vif-plugged-331dcb66-bd77-4e4b-9962-6742ebf5f82b for instance with vm_state active and task_state None.
Nov 29 02:04:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-be534431-209b-4b8c-a3a3-b5987c12ae4a req-abbe7075-b085-420d-b774-fdcc6af19ad6 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Received event network-vif-plugged-331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:04:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be534431-209b-4b8c-a3a3-b5987c12ae4a req-abbe7075-b085-420d-b774-fdcc6af19ad6 service nova] Acquiring lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be534431-209b-4b8c-a3a3-b5987c12ae4a req-abbe7075-b085-420d-b774-fdcc6af19ad6 service nova] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be534431-209b-4b8c-a3a3-b5987c12ae4a req-abbe7075-b085-420d-b774-fdcc6af19ad6 service nova] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-be534431-209b-4b8c-a3a3-b5987c12ae4a req-abbe7075-b085-420d-b774-fdcc6af19ad6 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] No waiting events found dispatching network-vif-plugged-331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:04:23 user nova-compute[75210]: WARNING nova.compute.manager [req-be534431-209b-4b8c-a3a3-b5987c12ae4a req-abbe7075-b085-420d-b774-fdcc6af19ad6 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Received unexpected event network-vif-plugged-331dcb66-bd77-4e4b-9962-6742ebf5f82b for instance with vm_state active and task_state None.
Nov 29 02:04:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "86e93036-8370-46a9-bea4-48c43b372fb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "86e93036-8370-46a9-bea4-48c43b372fb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:04:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:23 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:04:23 user nova-compute[75210]: INFO nova.compute.claims [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Claim successful on node user
Nov 29 02:04:24 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG nova.network.neutron [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:04:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:04:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG nova.policy [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b3e05194fce4b2d865ca10a13e4d1da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e854d353630b499b84ffee7b89f1c7bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:04:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Creating image(s)
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "/opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "/opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "/opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk 1073741824" returned: 0 in 0.048s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 02:04:24 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG nova.network.neutron [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Successfully created port: 0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Cannot resize image /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Ensure instance console log exists: /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG nova.network.neutron [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Successfully updated port: 0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "refresh_cache-86e93036-8370-46a9-bea4-48c43b372fb3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquired lock "refresh_cache-86e93036-8370-46a9-bea4-48c43b372fb3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG nova.network.neutron [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG nova.compute.manager [req-b6a46498-7fbd-432c-9d88-f083c2599f95 req-7db578b7-eba0-43fc-a5fe-d4b5a3d5c398 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Received event network-changed-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG nova.compute.manager [req-b6a46498-7fbd-432c-9d88-f083c2599f95 req-7db578b7-eba0-43fc-a5fe-d4b5a3d5c398 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Refreshing instance network info cache due to event network-changed-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b6a46498-7fbd-432c-9d88-f083c2599f95 req-7db578b7-eba0-43fc-a5fe-d4b5a3d5c398 service nova] Acquiring lock "refresh_cache-86e93036-8370-46a9-bea4-48c43b372fb3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG nova.network.neutron [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG nova.network.neutron [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Updating instance_info_cache with network_info: [{"id": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "address": "fa:16:3e:68:f0:20", "network": {"id": "592e6292-5cff-47e9-a721-6d783a66ba5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2045737211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e854d353630b499b84ffee7b89f1c7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f36b7c3-43", "ovs_interfaceid": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Releasing lock "refresh_cache-86e93036-8370-46a9-bea4-48c43b372fb3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG nova.compute.manager [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Instance network_info: |[{"id": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "address": "fa:16:3e:68:f0:20", "network": {"id": "592e6292-5cff-47e9-a721-6d783a66ba5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2045737211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e854d353630b499b84ffee7b89f1c7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f36b7c3-43", "ovs_interfaceid": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b6a46498-7fbd-432c-9d88-f083c2599f95 req-7db578b7-eba0-43fc-a5fe-d4b5a3d5c398 service nova] Acquired lock "refresh_cache-86e93036-8370-46a9-bea4-48c43b372fb3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG nova.network.neutron [req-b6a46498-7fbd-432c-9d88-f083c2599f95 req-7db578b7-eba0-43fc-a5fe-d4b5a3d5c398 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Refreshing network info cache for port 0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:04:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Start _get_guest_xml network_info=[{"id": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "address": "fa:16:3e:68:f0:20", "network": {"id": "592e6292-5cff-47e9-a721-6d783a66ba5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2045737211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e854d353630b499b84ffee7b89f1c7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f36b7c3-43", "ovs_interfaceid": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:04:25 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:04:26 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-401979044',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-401979044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4019790',id=44,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSpHuZJXdXhr7Wk5TcXjFvrE/jJmo+7Io085WxJ0D0x/+u7O0bc73LsuFaSMb/b1a+toh1nUxxrC+s2JjZwuoWAGaM67j8qkQcjawRLQFSlOmKXG9mgxTxdhvONwGUZzg==',key_name='tempest-keypair-2068651168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e854d353630b499b84ffee7b89f1c7bf',ramdisk_id='',reservation_id='r-tsu23mw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2042911204',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3e05194fce4b2d865ca10a13e4d1da',uuid=86e93036-8370-46a9-bea4-48c43b372fb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "address": "fa:16:3e:68:f0:20", "network": {"id": "592e6292-5cff-47e9-a721-6d783a66ba5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2045737211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e854d353630b499b84ffee7b89f1c7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f36b7c3-43", "ovs_interfaceid": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Converting VIF {"id": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "address": "fa:16:3e:68:f0:20", "network": {"id": "592e6292-5cff-47e9-a721-6d783a66ba5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2045737211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e854d353630b499b84ffee7b89f1c7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f36b7c3-43", "ovs_interfaceid": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=0f36b7c3-433c-4c8f-b14e-86a4f9a05c34,network=Network(592e6292-5cff-47e9-a721-6d783a66ba5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f36b7c3-43') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.objects.instance [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lazy-loading 'pci_devices' on Instance uuid 86e93036-8370-46a9-bea4-48c43b372fb3 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:04:26 user nova-compute[75210]:   <uuid>86e93036-8370-46a9-bea4-48c43b372fb3</uuid>
Nov 29 02:04:26 user nova-compute[75210]:   <name>instance-0000002c</name>
Nov 29 02:04:26 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:04:26 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:04:26 user nova-compute[75210]:   <metadata>
Nov 29 02:04:26 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:04:26 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:04:26 user nova-compute[75210]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-401979044</nova:name>
Nov 29 02:04:26 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:04:26</nova:creationTime>
Nov 29 02:04:26 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:04:26 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:04:26 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:04:26 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:04:26 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:04:26 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:04:26 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:04:26 user nova-compute[75210]:       <nova:owner>
Nov 29 02:04:26 user nova-compute[75210]:         <nova:user uuid="1b3e05194fce4b2d865ca10a13e4d1da">tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member</nova:user>
Nov 29 02:04:26 user nova-compute[75210]:         <nova:project uuid="e854d353630b499b84ffee7b89f1c7bf">tempest-TestServerVolumeAttachScenarioOldVersion-2042911204</nova:project>
Nov 29 02:04:26 user nova-compute[75210]:       </nova:owner>
Nov 29 02:04:26 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 02:04:26 user nova-compute[75210]:       <nova:ports>
Nov 29 02:04:26 user nova-compute[75210]:         <nova:port uuid="0f36b7c3-433c-4c8f-b14e-86a4f9a05c34">
Nov 29 02:04:26 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 29 02:04:26 user nova-compute[75210]:         </nova:port>
Nov 29 02:04:26 user nova-compute[75210]:       </nova:ports>
Nov 29 02:04:26 user nova-compute[75210]:     </nova:instance>
Nov 29 02:04:26 user nova-compute[75210]:   </metadata>
Nov 29 02:04:26 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:04:26 user nova-compute[75210]:     <system>
Nov 29 02:04:26 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:04:26 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:04:26 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:04:26 user nova-compute[75210]:       <entry name="serial">86e93036-8370-46a9-bea4-48c43b372fb3</entry>
Nov 29 02:04:26 user nova-compute[75210]:       <entry name="uuid">86e93036-8370-46a9-bea4-48c43b372fb3</entry>
Nov 29 02:04:26 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:04:26 user nova-compute[75210]:     </system>
Nov 29 02:04:26 user nova-compute[75210]:   </sysinfo>
Nov 29 02:04:26 user nova-compute[75210]:   <os>
Nov 29 02:04:26 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:04:26 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:04:26 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:04:26 user nova-compute[75210]:   </os>
Nov 29 02:04:26 user nova-compute[75210]:   <features>
Nov 29 02:04:26 user nova-compute[75210]:     <acpi/>
Nov 29 02:04:26 user nova-compute[75210]:     <apic/>
Nov 29 02:04:26 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:04:26 user nova-compute[75210]:   </features>
Nov 29 02:04:26 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:04:26 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:04:26 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:04:26 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:04:26 user nova-compute[75210]:   </clock>
Nov 29 02:04:26 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:04:26 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:04:26 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:04:26 user nova-compute[75210]:   </cpu>
Nov 29 02:04:26 user nova-compute[75210]:   <devices>
Nov 29 02:04:26 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:04:26 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:04:26 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk"/>
Nov 29 02:04:26 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:04:26 user nova-compute[75210]:     </disk>
Nov 29 02:04:26 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:04:26 user nova-compute[75210]:       <mac address="fa:16:3e:68:f0:20"/>
Nov 29 02:04:26 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:04:26 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:04:26 user nova-compute[75210]:       <target dev="tap0f36b7c3-43"/>
Nov 29 02:04:26 user nova-compute[75210]:     </interface>
Nov 29 02:04:26 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:04:26 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/console.log" append="off"/>
Nov 29 02:04:26 user nova-compute[75210]:     </serial>
Nov 29 02:04:26 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:04:26 user nova-compute[75210]:     <video>
Nov 29 02:04:26 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:04:26 user nova-compute[75210]:     </video>
Nov 29 02:04:26 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:04:26 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:04:26 user nova-compute[75210]:     </rng>
Nov 29 02:04:26 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:04:26 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:04:26 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:04:26 user nova-compute[75210]:     </memballoon>
Nov 29 02:04:26 user nova-compute[75210]:   </devices>
Nov 29 02:04:26 user nova-compute[75210]: </domain>
Nov 29 02:04:26 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-401979044',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-401979044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4019790',id=44,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSpHuZJXdXhr7Wk5TcXjFvrE/jJmo+7Io085WxJ0D0x/+u7O0bc73LsuFaSMb/b1a+toh1nUxxrC+s2JjZwuoWAGaM67j8qkQcjawRLQFSlOmKXG9mgxTxdhvONwGUZzg==',key_name='tempest-keypair-2068651168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e854d353630b499b84ffee7b89f1c7bf',ramdisk_id='',reservation_id='r-tsu23mw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2042911204',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3e05194fce4b2d865ca10a13e4d1da',uuid=86e93036-8370-46a9-bea4-48c43b372fb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "address": "fa:16:3e:68:f0:20", "network": {"id": "592e6292-5cff-47e9-a721-6d783a66ba5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2045737211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e854d353630b499b84ffee7b89f1c7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f36b7c3-43", "ovs_interfaceid": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Converting VIF {"id": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "address": "fa:16:3e:68:f0:20", "network": {"id": "592e6292-5cff-47e9-a721-6d783a66ba5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2045737211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e854d353630b499b84ffee7b89f1c7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f36b7c3-43", "ovs_interfaceid": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=0f36b7c3-433c-4c8f-b14e-86a4f9a05c34,network=Network(592e6292-5cff-47e9-a721-6d783a66ba5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f36b7c3-43') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG os_vif [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=0f36b7c3-433c-4c8f-b14e-86a4f9a05c34,network=Network(592e6292-5cff-47e9-a721-6d783a66ba5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f36b7c3-43') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f13fccd-892f-59bf-af3f-f57b1724152f', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f36b7c3-43, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f36b7c3-43, col_values=(('qos', UUID('28267efb-7f2f-437b-80de-36b680c5116b')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f36b7c3-43, col_values=(('external_ids', {'iface-id': '0f36b7c3-433c-4c8f-b14e-86a4f9a05c34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:f0:20', 'vm-uuid': '86e93036-8370-46a9-bea4-48c43b372fb3'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:26 user nova-compute[75210]: INFO os_vif [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=0f36b7c3-433c-4c8f-b14e-86a4f9a05c34,network=Network(592e6292-5cff-47e9-a721-6d783a66ba5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f36b7c3-43')
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] No VIF found with MAC fa:16:3e:68:f0:20, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.network.neutron [req-b6a46498-7fbd-432c-9d88-f083c2599f95 req-7db578b7-eba0-43fc-a5fe-d4b5a3d5c398 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Updated VIF entry in instance network info cache for port 0f36b7c3-433c-4c8f-b14e-86a4f9a05c34. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG nova.network.neutron [req-b6a46498-7fbd-432c-9d88-f083c2599f95 req-7db578b7-eba0-43fc-a5fe-d4b5a3d5c398 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Updating instance_info_cache with network_info: [{"id": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "address": "fa:16:3e:68:f0:20", "network": {"id": "592e6292-5cff-47e9-a721-6d783a66ba5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2045737211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e854d353630b499b84ffee7b89f1c7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f36b7c3-43", "ovs_interfaceid": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b6a46498-7fbd-432c-9d88-f083c2599f95 req-7db578b7-eba0-43fc-a5fe-d4b5a3d5c398 service nova] Releasing lock "refresh_cache-86e93036-8370-46a9-bea4-48c43b372fb3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:04:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-7d9be94b-33d7-4d80-bd2a-80922e16fc8c req-089522b4-d14d-4ba8-b4f5-2738ebc18bee service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Received event network-vif-plugged-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:04:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7d9be94b-33d7-4d80-bd2a-80922e16fc8c req-089522b4-d14d-4ba8-b4f5-2738ebc18bee service nova] Acquiring lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7d9be94b-33d7-4d80-bd2a-80922e16fc8c req-089522b4-d14d-4ba8-b4f5-2738ebc18bee service nova] Lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7d9be94b-33d7-4d80-bd2a-80922e16fc8c req-089522b4-d14d-4ba8-b4f5-2738ebc18bee service nova] Lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:27 user nova-compute[75210]: DEBUG nova.compute.manager [req-7d9be94b-33d7-4d80-bd2a-80922e16fc8c req-089522b4-d14d-4ba8-b4f5-2738ebc18bee service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] No waiting events found dispatching network-vif-plugged-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:04:27 user nova-compute[75210]: WARNING nova.compute.manager [req-7d9be94b-33d7-4d80-bd2a-80922e16fc8c req-089522b4-d14d-4ba8-b4f5-2738ebc18bee service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Received unexpected event network-vif-plugged-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 for instance with vm_state building and task_state spawning.
Nov 29 02:04:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:04:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:04:29 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Instance spawned successfully.
Nov 29 02:04:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:04:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:04:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:04:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:04:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:04:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:04:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:04:29 user nova-compute[75210]: INFO nova.compute.manager [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 29 02:04:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:04:29 user nova-compute[75210]: DEBUG nova.compute.manager [req-8680ce80-ae3c-4762-8002-a77d7112b743 req-16e4ec70-92a4-4942-8e55-6df2648c1f1e service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Received event network-vif-plugged-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:04:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8680ce80-ae3c-4762-8002-a77d7112b743 req-16e4ec70-92a4-4942-8e55-6df2648c1f1e service nova] Acquiring lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8680ce80-ae3c-4762-8002-a77d7112b743 req-16e4ec70-92a4-4942-8e55-6df2648c1f1e service nova] Lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8680ce80-ae3c-4762-8002-a77d7112b743 req-16e4ec70-92a4-4942-8e55-6df2648c1f1e service nova] Lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:29 user nova-compute[75210]: DEBUG nova.compute.manager [req-8680ce80-ae3c-4762-8002-a77d7112b743 req-16e4ec70-92a4-4942-8e55-6df2648c1f1e service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] No waiting events found dispatching network-vif-plugged-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:04:29 user nova-compute[75210]: WARNING nova.compute.manager [req-8680ce80-ae3c-4762-8002-a77d7112b743 req-16e4ec70-92a4-4942-8e55-6df2648c1f1e service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Received unexpected event network-vif-plugged-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 for instance with vm_state building and task_state spawning.
Nov 29 02:04:29 user nova-compute[75210]: INFO nova.compute.manager [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Took 5.89 seconds to build instance.
Nov 29 02:04:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-af32c01b-9f32-4e94-807d-427130575ed8 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "86e93036-8370-46a9-bea4-48c43b372fb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.990s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:37 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:04:37 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:04:37 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:04:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:41 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:04:41 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:04:41 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:04:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:04:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:04:41 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:04:41 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:04:42 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updating instance_info_cache with network_info: [{"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:04:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-34309f2a-e58e-4c00-a80d-0fc86e72e4fa" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:04:42 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:04:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:04:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:04:44 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:04:45 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:04:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:04:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:49 user nova-compute[75210]: INFO nova.compute.manager [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Terminating instance
Nov 29 02:04:49 user nova-compute[75210]: DEBUG nova.compute.manager [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-2e2812bf-d859-4e05-a9c2-4de6baf6d9e1 req-d8c15d02-742a-4783-a9f5-71c58030d3bc service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-unplugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2e2812bf-d859-4e05-a9c2-4de6baf6d9e1 req-d8c15d02-742a-4783-a9f5-71c58030d3bc service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2e2812bf-d859-4e05-a9c2-4de6baf6d9e1 req-d8c15d02-742a-4783-a9f5-71c58030d3bc service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2e2812bf-d859-4e05-a9c2-4de6baf6d9e1 req-d8c15d02-742a-4783-a9f5-71c58030d3bc service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-2e2812bf-d859-4e05-a9c2-4de6baf6d9e1 req-d8c15d02-742a-4783-a9f5-71c58030d3bc service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-unplugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:04:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-2e2812bf-d859-4e05-a9c2-4de6baf6d9e1 req-d8c15d02-742a-4783-a9f5-71c58030d3bc service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-unplugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:04:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Instance destroyed successfully.
Nov 29 02:04:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'resources' on Instance uuid 34309f2a-e58e-4c00-a80d-0fc86e72e4fa {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T01:54:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1654971335',display_name='tempest-AttachVolumeTestJSON-server-1654971335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1654971335',id=36,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGnqdmpBzYm6z7oGTNZRg+k46dT8ozTAGc/Jui4Cyn5xsrA9EzCgjJ4vksQkVJRWqNU8LRGswNNFzJWUQNeBPWWN26oJbHGu7RqD4PfAoZzP7e8c5Cd769h3F8sF6e9zg==',key_name='tempest-keypair-2129640759',keypairs=<?>,launch_index=0,launched_at=2023-11-29T01:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64aac75090884257a9c33f94ec9aa367',ramdisk_id='',reservation_id='r-c673118l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-91454133',owner_user_name='tempest-AttachVolumeTestJSON-91454133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:03:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee2d9a0f7574bad97338a59b8ce8968',uuid=34309f2a-e58e-4c00-a80d-0fc86e72e4fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converting VIF {"id": "c2989e5b-8405-458d-8862-86a28f95bb38", "address": "fa:16:3e:7b:b4:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2989e5b-84", "ovs_interfaceid": "c2989e5b-8405-458d-8862-86a28f95bb38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG os_vif [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2989e5b-84, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0c10a6b-750f-4018-9843-5ee40a3d55d6) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:04:50 user nova-compute[75210]: INFO os_vif [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:b4:90,bridge_name='br-int',has_traffic_filtering=True,id=c2989e5b-8405-458d-8862-86a28f95bb38,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2989e5b-84')
Nov 29 02:04:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Deleting instance files /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa_del
Nov 29 02:04:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Deletion of /opt/stack/data/nova/instances/34309f2a-e58e-4c00-a80d-0fc86e72e4fa_del complete
Nov 29 02:04:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:50 user nova-compute[75210]: INFO nova.compute.manager [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 29 02:04:50 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:04:50 user nova-compute[75210]: DEBUG nova.compute.manager [req-e79c6d61-f088-415c-a1bb-ea408cdafdc8 req-c590904e-be64-4da0-b03a-def652134749 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-deleted-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:04:50 user nova-compute[75210]: INFO nova.compute.manager [req-e79c6d61-f088-415c-a1bb-ea408cdafdc8 req-c590904e-be64-4da0-b03a-def652134749 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Neutron deleted interface c2989e5b-8405-458d-8862-86a28f95bb38; detaching it from the instance and deleting it from the info cache
Nov 29 02:04:50 user nova-compute[75210]: DEBUG nova.network.neutron [req-e79c6d61-f088-415c-a1bb-ea408cdafdc8 req-c590904e-be64-4da0-b03a-def652134749 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:04:50 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Took 0.63 seconds to deallocate network for instance.
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-e79c6d61-f088-415c-a1bb-ea408cdafdc8 req-c590904e-be64-4da0-b03a-def652134749 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Detach interface failed, port_id=c2989e5b-8405-458d-8862-86a28f95bb38, reason: Instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:04:51 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Error from libvirt while getting description of instance-00000024: [Error Code 42] Domain not found: no domain with matching uuid '34309f2a-e58e-4c00-a80d-0fc86e72e4fa' (instance-00000024): libvirt.libvirtError: Domain not found: no domain with matching uuid '34309f2a-e58e-4c00-a80d-0fc86e72e4fa' (instance-00000024)
Nov 29 02:04:51 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:04:51 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8532MB free_disk=25.153499603271484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.117s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:51 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Deleted allocations for instance 34309f2a-e58e-4c00-a80d-0fc86e72e4fa
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 8d971e56-00ad-4c02-8cfc-98a04ae8f528 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 86e93036-8370-46a9-bea4-48c43b372fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4af147f2-fa46-401b-bee9-43a84a481ccb tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.263s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-c8c7d087-6a74-4fde-95aa-c9ffa4d90dd9 req-278f5801-7d5b-44c6-a42e-53fb39549fe0 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c8c7d087-6a74-4fde-95aa-c9ffa4d90dd9 req-278f5801-7d5b-44c6-a42e-53fb39549fe0 service nova] Acquiring lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c8c7d087-6a74-4fde-95aa-c9ffa4d90dd9 req-278f5801-7d5b-44c6-a42e-53fb39549fe0 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c8c7d087-6a74-4fde-95aa-c9ffa4d90dd9 req-278f5801-7d5b-44c6-a42e-53fb39549fe0 service nova] Lock "34309f2a-e58e-4c00-a80d-0fc86e72e4fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-c8c7d087-6a74-4fde-95aa-c9ffa4d90dd9 req-278f5801-7d5b-44c6-a42e-53fb39549fe0 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] No waiting events found dispatching network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:04:51 user nova-compute[75210]: WARNING nova.compute.manager [req-c8c7d087-6a74-4fde-95aa-c9ffa4d90dd9 req-278f5801-7d5b-44c6-a42e-53fb39549fe0 service nova] [instance: 34309f2a-e58e-4c00-a80d-0fc86e72e4fa] Received unexpected event network-vif-plugged-c2989e5b-8405-458d-8862-86a28f95bb38 for instance with vm_state deleted and task_state None.
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:04:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:04:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:04:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:05:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:05:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:05:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:05:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG nova.objects.instance [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lazy-loading 'flavor' on Instance uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:13 user nova-compute[75210]: INFO nova.compute.manager [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Attaching volume aacbbd71-3d67-40ae-9a3c-008f778e3e32 to /dev/vdb
Nov 29 02:05:13 user nova-compute[75210]: DEBUG os_brick.utils [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3ae08c-1737-447d-a22f-d40ac3ff3ef4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59eb718-b50f-4493-b14f-8382e9891058]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[507dedfe-aab3-45b5-bfe9-d64bdbb06f22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5187c0e5-df97-4126-ac3d-4d8dc30626eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:05:13 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:05:13 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c8258c-6453-446b-9949-4b995750ffb0]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG os_brick.utils [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:05:13 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updating existing volume attachment record: 9e4674d2-f3f8-4086-83f4-1f2d640b6fa6 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:05:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdYrTybo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:05:20 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:05:20 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:05:20 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af6fb22-98f1-4894-8ecb-d4414ac2c944]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:05:20 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8647011d-b31e-4913-9651-3dddc75925b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32] added
Nov 29 02:05:20 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a091309-0f67-4dc0-adfb-f0a3ac1134c9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ca1f5b-f259-45c3-88d9-1964973a176d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdYrTybo {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdYrTybo" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca27c87-ef8b-4458-8511-2942c95f5810]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RdYrTybo'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7332c0f-9882-454a-9c73-eca7eba6ce66]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a989a179-5940-4f9f-aba9-4cfe3a94c61d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:05:20 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:05:20 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e836c7cc-5786-4517-808f-ba3ac5ffab7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32, portal: 172.16.0.220,3260]
Nov 29 02:05:20 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32, portal: 172.16.0.220,3260] successful.
Nov 29 02:05:20 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ec0ecc-e8ca-4528-8433-a2b6e65b83e2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb4d73c-a339-40b7-9736-8f92eef001f1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:05:20 user nova-compute[75210]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:05:20 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:05:20 user nova-compute[75210]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:05:20 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a17f3f-b34d-446c-b983-594a3cd73468]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:05:20 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdYrTybo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:05:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:05:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26561643130636364', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:05:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561643130636364', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:05:21 user nova-compute[75210]: DEBUG nova.objects.instance [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lazy-loading 'flavor' on Instance uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:05:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 02:05:21 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:05:21 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 02:05:21 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:05:21 user nova-compute[75210]:   <serial>aacbbd71-3d67-40ae-9a3c-008f778e3e32</serial>
Nov 29 02:05:21 user nova-compute[75210]: </disk>
Nov 29 02:05:21 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 02:05:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:05:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:05:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] No VIF found with MAC fa:16:3e:88:3c:bd, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:05:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2cbffcd-23be-4d8c-86ab-35b16977509c tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.739s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:23 user nova-compute[75210]: INFO nova.compute.manager [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Rescuing
Nov 29 02:05:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:05:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquired lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:05:23 user nova-compute[75210]: DEBUG nova.network.neutron [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:05:23 user nova-compute[75210]: DEBUG nova.network.neutron [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updating instance_info_cache with network_info: [{"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:05:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Releasing lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:05:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-97009376-d20a-4abf-81c6-7896dacdb25c req-1cc668cf-3c40-4e85-91fc-b5851610e73c service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-unplugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-97009376-d20a-4abf-81c6-7896dacdb25c req-1cc668cf-3c40-4e85-91fc-b5851610e73c service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-97009376-d20a-4abf-81c6-7896dacdb25c req-1cc668cf-3c40-4e85-91fc-b5851610e73c service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-97009376-d20a-4abf-81c6-7896dacdb25c req-1cc668cf-3c40-4e85-91fc-b5851610e73c service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-97009376-d20a-4abf-81c6-7896dacdb25c req-1cc668cf-3c40-4e85-91fc-b5851610e73c service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-unplugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:05:24 user nova-compute[75210]: WARNING nova.compute.manager [req-97009376-d20a-4abf-81c6-7896dacdb25c req-1cc668cf-3c40-4e85-91fc-b5851610e73c service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-unplugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state active and task_state rescuing.
Nov 29 02:05:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Instance destroyed successfully.
Nov 29 02:05:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Attempting a stable device rescue
Nov 29 02:05:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75210) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Instance directory exists: not creating {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 29 02:05:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Creating image(s)
Nov 29 02:05:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "/opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "/opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG nova.objects.instance [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lazy-loading 'trusted_certs' on Instance uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "22880aeb1789ea0ee8244ab3eac089e19c8a6ff5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "22880aeb1789ea0ee8244ab3eac089e19c8a6ff5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5.part --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:05:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:25 user nova-compute[75210]: DEBUG nova.virt.images [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] 60f6df60-f1ee-4f3e-b754-fa48652c64c0 was qcow2, converting to raw {{(pid=75210) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 02:05:25 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 02:05:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5.part /opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5.converted {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5.part /opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5.converted" returned: 0 in 0.308s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5.converted --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-e9fa4217-76fd-486c-8753-8782b39bf100 req-36f69257-c5ba-486f-82e9-f48ec1bc9dc4 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e9fa4217-76fd-486c-8753-8782b39bf100 req-36f69257-c5ba-486f-82e9-f48ec1bc9dc4 service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e9fa4217-76fd-486c-8753-8782b39bf100 req-36f69257-c5ba-486f-82e9-f48ec1bc9dc4 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e9fa4217-76fd-486c-8753-8782b39bf100 req-36f69257-c5ba-486f-82e9-f48ec1bc9dc4 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-e9fa4217-76fd-486c-8753-8782b39bf100 req-36f69257-c5ba-486f-82e9-f48ec1bc9dc4 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:05:26 user nova-compute[75210]: WARNING nova.compute.manager [req-e9fa4217-76fd-486c-8753-8782b39bf100 req-36f69257-c5ba-486f-82e9-f48ec1bc9dc4 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state active and task_state rescuing.
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "22880aeb1789ea0ee8244ab3eac089e19c8a6ff5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.651s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "22880aeb1789ea0ee8244ab3eac089e19c8a6ff5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "22880aeb1789ea0ee8244ab3eac089e19c8a6ff5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5 --force-share --output=json" returned: 0 in 0.195s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5,backing_fmt=raw /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.rescue {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5,backing_fmt=raw /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.rescue" returned: 0 in 0.057s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "22880aeb1789ea0ee8244ab3eac089e19c8a6ff5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.objects.instance [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lazy-loading 'migration_context' on Instance uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.objects.base [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Object Instance<cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Start _get_guest_xml network_info=[{"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "vif_mac": "fa:16:3e:88:3c:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '60f6df60-f1ee-4f3e-b754-fa48652c64c0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '9e4674d2-f3f8-4086-83f4-1f2d640b6fa6', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdYrTybo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6', 'attached_at': '', 'detached_at': '', 'volume_id': 'aacbbd71-3d67-40ae-9a3c-008f778e3e32', 'serial': 'aacbbd71-3d67-40ae-9a3c-008f778e3e32'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.objects.instance [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lazy-loading 'resources' on Instance uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.objects.base [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Object Instance<cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.objects.instance [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lazy-loading 'numa_topology' on Instance uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.objects.base [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Object Instance<cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:05:26 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:05:26 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.objects.instance [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lazy-loading 'vcpu_model' on Instance uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.objects.base [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Object Instance<cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdYrTybo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:05:26 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:05:26 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:05:26 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b790ed73-6063-44a5-8676-37c564dc77c3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RdYrTybo\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 29 02:05:26 user nova-compute[75210]: node.name = iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32
Nov 29 02:05:26 user nova-compute[75210]: node.tpgt = -1
Nov 29 02:05:26 user nova-compute[75210]: node.startup = automatic
Nov 29 02:05:26 user nova-compute[75210]: node.leading_login = No
Nov 29 02:05:26 user nova-compute[75210]: iface.iscsi_ifacename = default
Nov 29 02:05:26 user nova-compute[75210]: iface.net_ifacename = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.ipaddress = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.prefix_len = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.hwaddress = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.transport_name = tcp
Nov 29 02:05:26 user nova-compute[75210]: iface.initiatorname = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.state = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.vlan_id = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.vlan_priority = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.vlan_state = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.iface_num = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.mtu = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.port = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.bootproto = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.subnet_mask = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.gateway = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.dhcp_alt_client_id_state = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.dhcp_alt_client_id = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.dhcp_dns = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.dhcp_learn_iqn = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.dhcp_req_vendor_id_state = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.dhcp_vendor_id_state = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.dhcp_vendor_id = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.dhcp_slp_da = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.fragmentation = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.gratuitous_arp = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.incoming_forwarding = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.tos_state = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.tos = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.ttl = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.delayed_ack = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.tcp_nagle = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.tcp_wsf_state = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.tcp_wsf = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.tcp_timer_scale = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.tcp_timestamp = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.redirect = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.def_task_mgmt_timeout = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.header_digest = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.data_digest = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.immediate_data = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.initial_r2t = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.data_seq_inorder = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.data_pdu_inorder = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.erl = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.max_receive_data_len = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.first_burst_len = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.max_outstanding_r2t = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.max_burst_len = 0
Nov 29 02:05:26 user nova-compute[75210]: iface.chap_auth = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.bidi_chap = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.strict_login_compliance = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.discovery_auth = <empty>
Nov 29 02:05:26 user nova-compute[75210]: iface.discovery_logout = <empty>
Nov 29 02:05:26 user nova-compute[75210]: node.discovery_address = <empty>
Nov 29 02:05:26 user nova-compute[75210]: node.discovery_port = 0
Nov 29 02:05:26 user nova-compute[75210]: node.discovery_type = static
Nov 29 02:05:26 user nova-compute[75210]: node.session.initial_cmdsn = 0
Nov 29 02:05:26 user nova-compute[75210]: node.session.initial_login_retry_max = 8
Nov 29 02:05:26 user nova-compute[75210]: node.session.xmit_thread_priority = -20
Nov 29 02:05:26 user nova-compute[75210]: node.session.cmds_max = 128
Nov 29 02:05:26 user nova-compute[75210]: node.session.queue_depth = 32
Nov 29 02:05:26 user nova-compute[75210]: node.session.nr_sessions = 1
Nov 29 02:05:26 user nova-compute[75210]: node.session.auth.authmethod = CHAP
Nov 29 02:05:26 user nova-compute[75210]: node.session.auth.username = RdYrTybo
Nov 29 02:05:26 user nova-compute[75210]: node.session.auth.password = ***
Nov 29 02:05:26 user nova-compute[75210]: node.session.auth.username_in = <empty>
Nov 29 02:05:26 user nova-compute[75210]: node.session.auth.password_in = <empty>
Nov 29 02:05:26 user nova-compute[75210]: node.session.auth.chap_algs = MD5
Nov 29 02:05:26 user nova-compute[75210]: node.session.timeo.replacement_timeout = 120
Nov 29 02:05:26 user nova-compute[75210]: node.session.err_timeo.abort_timeout = 15
Nov 29 02:05:26 user nova-compute[75210]: node.session.err_timeo.lu_reset_timeout = 30
Nov 29 02:05:26 user nova-compute[75210]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 29 02:05:26 user nova-compute[75210]: node.session.err_timeo.host_reset_timeout = 60
Nov 29 02:05:26 user nova-compute[75210]: node.session.iscsi.FastAbort = Yes
Nov 29 02:05:26 user nova-compute[75210]: node.session.iscsi.InitialR2T = No
Nov 29 02:05:26 user nova-compute[75210]: node.session.iscsi.ImmediateData = Yes
Nov 29 02:05:26 user nova-compute[75210]: node.session.iscsi.FirstBurstLength = 262144
Nov 29 02:05:26 user nova-compute[75210]: node.session.iscsi.MaxBurstLength = 16776192
Nov 29 02:05:26 user nova-compute[75210]: node.session.iscsi.DefaultTime2Retain = 0
Nov 29 02:05:26 user nova-compute[75210]: node.session.iscsi.DefaultTime2Wait = 2
Nov 29 02:05:26 user nova-compute[75210]: node.session.iscsi.MaxConnections = 1
Nov 29 02:05:26 user nova-compute[75210]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 29 02:05:26 user nova-compute[75210]: node.session.iscsi.ERL = 0
Nov 29 02:05:26 user nova-compute[75210]: node.session.scan = manual
Nov 29 02:05:26 user nova-compute[75210]: node.session.reopen_max = 0
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].address = 172.16.0.220
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].port = 3260
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].startup = manual
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].tcp.window_size = 524288
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].tcp.type_of_service = 0
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].timeo.logout_timeout = 15
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].timeo.login_timeout = 15
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].timeo.auth_timeout = 45
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].timeo.noop_out_interval = 5
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].timeo.noop_out_timeout = 5
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].iscsi.HeaderDigest = None
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].iscsi.DataDigest = None
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].iscsi.IFMarker = No
Nov 29 02:05:26 user nova-compute[75210]: node.conn[0].iscsi.OFMarker = No
Nov 29 02:05:26 user nova-compute[75210]: # END RECORD
Nov 29 02:05:26 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c844d6bc-e39a-4965-abcd-14ec028c6b6b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[59753f6f-27c7-4a23-9f75-50a9051f0a17]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdYrTybo {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RdYrTybo" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c633c5-f141-4979-b4e6-ba4c4497aa4d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RdYrTybo'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e72248a-2c6b-4589-8659-4947f8a32d8e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e125304-025d-469c-9598-2e3324d6d01e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:05:26 user nova-compute[75210]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:05:26 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:05:26 user nova-compute[75210]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:05:26 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.148s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] HCTL ('34', '0', '0', 0) found on session 51 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46e1834-ae8a-4441-8adb-cd531ef584ba]: (4, ('0 0 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Searching for a device in session 51 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdYrTybo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.170s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] <== connect_volume: return (171ms) {'type': 'block', 'scsi_wwn': '26561643130636364', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561643130636364', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1135885355',display_name='tempest-ServerStableDeviceRescueTest-server-1135885355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1135885355',id=41,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPSG3qE+VgrQNXmELqi5qSXBwBzUp8vZZBB9/REK7ixhkyDD6falVEmw2R1+zJ071dQTIbR39IgcId6lzef4D9VzKYNeqf+7J8rcwF1girVO8dNsvkXLI7BMPoX9/gWEQ==',key_name='tempest-keypair-376857331',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:01:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de78c813716a4a3fa74e92b498e9ed2e',ramdisk_id='',reservation_id='r-w40b89pl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-515826915',owner_user_name='tempest-ServerStableDeviceRescueTest-515826915-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a388bda7f1454c898a458fc7aa276a1c',uuid=cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "vif_mac": "fa:16:3e:88:3c:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Converting VIF {"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "vif_mac": "fa:16:3e:88:3c:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:3c:bd,bridge_name='br-int',has_traffic_filtering=True,id=24af94e3-44d6-4bd9-8dbb-ded94daa2b62,network=Network(7a102cdd-460e-4998-aae7-f6d0237ed234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24af94e3-44') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.objects.instance [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lazy-loading 'pci_devices' on Instance uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.objects.base [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Object Instance<cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:05:26 user nova-compute[75210]:   <uuid>cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6</uuid>
Nov 29 02:05:26 user nova-compute[75210]:   <name>instance-00000029</name>
Nov 29 02:05:26 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:05:26 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:05:26 user nova-compute[75210]:   <metadata>
Nov 29 02:05:26 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:05:26 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:05:26 user nova-compute[75210]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1135885355</nova:name>
Nov 29 02:05:26 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:05:26</nova:creationTime>
Nov 29 02:05:26 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:05:26 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:05:26 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:05:26 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:05:26 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:05:26 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:05:26 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:05:26 user nova-compute[75210]:       <nova:owner>
Nov 29 02:05:26 user nova-compute[75210]:         <nova:user uuid="a388bda7f1454c898a458fc7aa276a1c">tempest-ServerStableDeviceRescueTest-515826915-project-member</nova:user>
Nov 29 02:05:26 user nova-compute[75210]:         <nova:project uuid="de78c813716a4a3fa74e92b498e9ed2e">tempest-ServerStableDeviceRescueTest-515826915</nova:project>
Nov 29 02:05:26 user nova-compute[75210]:       </nova:owner>
Nov 29 02:05:26 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 02:05:26 user nova-compute[75210]:       <nova:ports>
Nov 29 02:05:26 user nova-compute[75210]:         <nova:port uuid="24af94e3-44d6-4bd9-8dbb-ded94daa2b62">
Nov 29 02:05:26 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 02:05:26 user nova-compute[75210]:         </nova:port>
Nov 29 02:05:26 user nova-compute[75210]:       </nova:ports>
Nov 29 02:05:26 user nova-compute[75210]:     </nova:instance>
Nov 29 02:05:26 user nova-compute[75210]:   </metadata>
Nov 29 02:05:26 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:05:26 user nova-compute[75210]:     <system>
Nov 29 02:05:26 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:05:26 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:05:26 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:05:26 user nova-compute[75210]:       <entry name="serial">cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6</entry>
Nov 29 02:05:26 user nova-compute[75210]:       <entry name="uuid">cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6</entry>
Nov 29 02:05:26 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:05:26 user nova-compute[75210]:     </system>
Nov 29 02:05:26 user nova-compute[75210]:   </sysinfo>
Nov 29 02:05:26 user nova-compute[75210]:   <os>
Nov 29 02:05:26 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:05:26 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:05:26 user nova-compute[75210]:   </os>
Nov 29 02:05:26 user nova-compute[75210]:   <features>
Nov 29 02:05:26 user nova-compute[75210]:     <acpi/>
Nov 29 02:05:26 user nova-compute[75210]:     <apic/>
Nov 29 02:05:26 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:05:26 user nova-compute[75210]:   </features>
Nov 29 02:05:26 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:05:26 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:05:26 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:05:26 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:05:26 user nova-compute[75210]:   </clock>
Nov 29 02:05:26 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:05:26 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:05:26 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:05:26 user nova-compute[75210]:   </cpu>
Nov 29 02:05:26 user nova-compute[75210]:   <devices>
Nov 29 02:05:26 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:05:26 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:05:26 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk"/>
Nov 29 02:05:26 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:05:26 user nova-compute[75210]:     </disk>
Nov 29 02:05:26 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 02:05:26 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:05:26 user nova-compute[75210]:       <source dev="/dev/sdc"/>
Nov 29 02:05:26 user nova-compute[75210]:       <target dev="vdb" bus="virtio"/>
Nov 29 02:05:26 user nova-compute[75210]:       <serial>aacbbd71-3d67-40ae-9a3c-008f778e3e32</serial>
Nov 29 02:05:26 user nova-compute[75210]:     </disk>
Nov 29 02:05:26 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:05:26 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:05:26 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.rescue"/>
Nov 29 02:05:26 user nova-compute[75210]:       <target dev="vdc" bus="virtio"/>
Nov 29 02:05:26 user nova-compute[75210]:       <boot order="1"/>
Nov 29 02:05:26 user nova-compute[75210]:     </disk>
Nov 29 02:05:26 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:05:26 user nova-compute[75210]:       <mac address="fa:16:3e:88:3c:bd"/>
Nov 29 02:05:26 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:05:26 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:05:26 user nova-compute[75210]:       <target dev="tap24af94e3-44"/>
Nov 29 02:05:26 user nova-compute[75210]:     </interface>
Nov 29 02:05:26 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:05:26 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/console.log" append="off"/>
Nov 29 02:05:26 user nova-compute[75210]:     </serial>
Nov 29 02:05:26 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:05:26 user nova-compute[75210]:     <video>
Nov 29 02:05:26 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:05:26 user nova-compute[75210]:     </video>
Nov 29 02:05:26 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:05:26 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:05:26 user nova-compute[75210]:     </rng>
Nov 29 02:05:26 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:05:26 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:05:26 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:05:26 user nova-compute[75210]:     </memballoon>
Nov 29 02:05:26 user nova-compute[75210]:   </devices>
Nov 29 02:05:26 user nova-compute[75210]: </domain>
Nov 29 02:05:26 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:05:26 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Instance destroyed successfully.
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:05:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] No VIF found with MAC fa:16:3e:88:3c:bd, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:05:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-56c22e18-e8c8-4e69-bc20-ef64bafedf26 req-166b6ec8-6f65-4c2d-9dc7-08b058c30f90 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:05:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-56c22e18-e8c8-4e69-bc20-ef64bafedf26 req-166b6ec8-6f65-4c2d-9dc7-08b058c30f90 service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-56c22e18-e8c8-4e69-bc20-ef64bafedf26 req-166b6ec8-6f65-4c2d-9dc7-08b058c30f90 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-56c22e18-e8c8-4e69-bc20-ef64bafedf26 req-166b6ec8-6f65-4c2d-9dc7-08b058c30f90 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-56c22e18-e8c8-4e69-bc20-ef64bafedf26 req-166b6ec8-6f65-4c2d-9dc7-08b058c30f90 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:05:28 user nova-compute[75210]: WARNING nova.compute.manager [req-56c22e18-e8c8-4e69-bc20-ef64bafedf26 req-166b6ec8-6f65-4c2d-9dc7-08b058c30f90 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state active and task_state rescuing.
Nov 29 02:05:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-207e08ee-7ef5-4f48-b5ed-617f8189c1b6 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:05:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-d3de63aa-549e-4cee-ba5b-fc71f9a9282a req-2cb37e4a-65b3-4dcb-98bb-e72624515ec0 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:05:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d3de63aa-549e-4cee-ba5b-fc71f9a9282a req-2cb37e4a-65b3-4dcb-98bb-e72624515ec0 service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d3de63aa-549e-4cee-ba5b-fc71f9a9282a req-2cb37e4a-65b3-4dcb-98bb-e72624515ec0 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d3de63aa-549e-4cee-ba5b-fc71f9a9282a req-2cb37e4a-65b3-4dcb-98bb-e72624515ec0 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-d3de63aa-549e-4cee-ba5b-fc71f9a9282a req-2cb37e4a-65b3-4dcb-98bb-e72624515ec0 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:05:30 user nova-compute[75210]: WARNING nova.compute.manager [req-d3de63aa-549e-4cee-ba5b-fc71f9a9282a req-2cb37e4a-65b3-4dcb-98bb-e72624515ec0 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state rescued and task_state None.
Nov 29 02:05:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:39 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:05:39 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:05:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:41 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:05:41 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:05:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:05:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:05:41 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:05:41 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updating instance_info_cache with network_info: [{"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:05:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:05:41 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:05:43 user nova-compute[75210]: INFO nova.compute.claims [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Claim successful on node user
Nov 29 02:05:43 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG nova.network.neutron [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:05:43 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:05:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:05:43 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Creating image(s)
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "/opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "/opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "/opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG nova.policy [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ee2d9a0f7574bad97338a59b8ce8968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64aac75090884257a9c33f94ec9aa367', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk 1073741824" returned: 0 in 0.052s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Successfully created port: ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Cannot resize image /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Ensure instance console log exists: /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Successfully updated port: ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "refresh_cache-01f7d4a1-2aec-4fca-a374-4a0554cfa838" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquired lock "refresh_cache-01f7d4a1-2aec-4fca-a374-4a0554cfa838" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-c47115e6-6812-49be-8362-55c949f5f0ca req-42d8c1bb-5499-4c98-b0c8-16e03d175d45 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Received event network-changed-ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-c47115e6-6812-49be-8362-55c949f5f0ca req-42d8c1bb-5499-4c98-b0c8-16e03d175d45 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Refreshing instance network info cache due to event network-changed-ab9a6b12-575e-4a8a-8fd8-8aa908140219. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c47115e6-6812-49be-8362-55c949f5f0ca req-42d8c1bb-5499-4c98-b0c8-16e03d175d45 service nova] Acquiring lock "refresh_cache-01f7d4a1-2aec-4fca-a374-4a0554cfa838" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:05:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.network.neutron [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Updating instance_info_cache with network_info: [{"id": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "address": "fa:16:3e:26:99:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9a6b12-57", "ovs_interfaceid": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Releasing lock "refresh_cache-01f7d4a1-2aec-4fca-a374-4a0554cfa838" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Instance network_info: |[{"id": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "address": "fa:16:3e:26:99:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9a6b12-57", "ovs_interfaceid": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c47115e6-6812-49be-8362-55c949f5f0ca req-42d8c1bb-5499-4c98-b0c8-16e03d175d45 service nova] Acquired lock "refresh_cache-01f7d4a1-2aec-4fca-a374-4a0554cfa838" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.network.neutron [req-c47115e6-6812-49be-8362-55c949f5f0ca req-42d8c1bb-5499-4c98-b0c8-16e03d175d45 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Refreshing network info cache for port ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Start _get_guest_xml network_info=[{"id": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "address": "fa:16:3e:26:99:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9a6b12-57", "ovs_interfaceid": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:05:45 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:05:45 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1414050662',display_name='tempest-AttachVolumeTestJSON-server-1414050662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1414050662',id=45,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnJEpIhGEUtzspNudloUDCqPdfW9cYZ2sQlzVx9tGUt/0scbS1iKZfEcu2ljSQv3C5J4amLs1qUmSdg9EDaH/uyEqSH7wkYN/aN65iQBsd4njMlhqQFcrheRR5tIujZFg==',key_name='tempest-keypair-1543632751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64aac75090884257a9c33f94ec9aa367',ramdisk_id='',reservation_id='r-yw0ada9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-91454133',owner_user_name='tempest-AttachVolumeTestJSON-91454133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee2d9a0f7574bad97338a59b8ce8968',uuid=01f7d4a1-2aec-4fca-a374-4a0554cfa838,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "address": "fa:16:3e:26:99:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9a6b12-57", "ovs_interfaceid": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converting VIF {"id": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "address": "fa:16:3e:26:99:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9a6b12-57", "ovs_interfaceid": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:99:90,bridge_name='br-int',has_traffic_filtering=True,id=ab9a6b12-575e-4a8a-8fd8-8aa908140219,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9a6b12-57') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.objects.instance [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'pci_devices' on Instance uuid 01f7d4a1-2aec-4fca-a374-4a0554cfa838 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:05:45 user nova-compute[75210]:   <uuid>01f7d4a1-2aec-4fca-a374-4a0554cfa838</uuid>
Nov 29 02:05:45 user nova-compute[75210]:   <name>instance-0000002d</name>
Nov 29 02:05:45 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:05:45 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:05:45 user nova-compute[75210]:   <metadata>
Nov 29 02:05:45 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:05:45 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:05:45 user nova-compute[75210]:       <nova:name>tempest-AttachVolumeTestJSON-server-1414050662</nova:name>
Nov 29 02:05:45 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:05:45</nova:creationTime>
Nov 29 02:05:45 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:05:45 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:05:45 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:05:45 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:05:45 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:05:45 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:05:45 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:05:45 user nova-compute[75210]:       <nova:owner>
Nov 29 02:05:45 user nova-compute[75210]:         <nova:user uuid="3ee2d9a0f7574bad97338a59b8ce8968">tempest-AttachVolumeTestJSON-91454133-project-member</nova:user>
Nov 29 02:05:45 user nova-compute[75210]:         <nova:project uuid="64aac75090884257a9c33f94ec9aa367">tempest-AttachVolumeTestJSON-91454133</nova:project>
Nov 29 02:05:45 user nova-compute[75210]:       </nova:owner>
Nov 29 02:05:45 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 02:05:45 user nova-compute[75210]:       <nova:ports>
Nov 29 02:05:45 user nova-compute[75210]:         <nova:port uuid="ab9a6b12-575e-4a8a-8fd8-8aa908140219">
Nov 29 02:05:45 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 29 02:05:45 user nova-compute[75210]:         </nova:port>
Nov 29 02:05:45 user nova-compute[75210]:       </nova:ports>
Nov 29 02:05:45 user nova-compute[75210]:     </nova:instance>
Nov 29 02:05:45 user nova-compute[75210]:   </metadata>
Nov 29 02:05:45 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:05:45 user nova-compute[75210]:     <system>
Nov 29 02:05:45 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:05:45 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:05:45 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:05:45 user nova-compute[75210]:       <entry name="serial">01f7d4a1-2aec-4fca-a374-4a0554cfa838</entry>
Nov 29 02:05:45 user nova-compute[75210]:       <entry name="uuid">01f7d4a1-2aec-4fca-a374-4a0554cfa838</entry>
Nov 29 02:05:45 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:05:45 user nova-compute[75210]:     </system>
Nov 29 02:05:45 user nova-compute[75210]:   </sysinfo>
Nov 29 02:05:45 user nova-compute[75210]:   <os>
Nov 29 02:05:45 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:05:45 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:05:45 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:05:45 user nova-compute[75210]:   </os>
Nov 29 02:05:45 user nova-compute[75210]:   <features>
Nov 29 02:05:45 user nova-compute[75210]:     <acpi/>
Nov 29 02:05:45 user nova-compute[75210]:     <apic/>
Nov 29 02:05:45 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:05:45 user nova-compute[75210]:   </features>
Nov 29 02:05:45 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:05:45 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:05:45 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:05:45 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:05:45 user nova-compute[75210]:   </clock>
Nov 29 02:05:45 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:05:45 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:05:45 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:05:45 user nova-compute[75210]:   </cpu>
Nov 29 02:05:45 user nova-compute[75210]:   <devices>
Nov 29 02:05:45 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:05:45 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:05:45 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk"/>
Nov 29 02:05:45 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:05:45 user nova-compute[75210]:     </disk>
Nov 29 02:05:45 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:05:45 user nova-compute[75210]:       <mac address="fa:16:3e:26:99:90"/>
Nov 29 02:05:45 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:05:45 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:05:45 user nova-compute[75210]:       <target dev="tapab9a6b12-57"/>
Nov 29 02:05:45 user nova-compute[75210]:     </interface>
Nov 29 02:05:45 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:05:45 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/console.log" append="off"/>
Nov 29 02:05:45 user nova-compute[75210]:     </serial>
Nov 29 02:05:45 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:05:45 user nova-compute[75210]:     <video>
Nov 29 02:05:45 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:05:45 user nova-compute[75210]:     </video>
Nov 29 02:05:45 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:05:45 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:05:45 user nova-compute[75210]:     </rng>
Nov 29 02:05:45 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:05:45 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:05:45 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:05:45 user nova-compute[75210]:     </memballoon>
Nov 29 02:05:45 user nova-compute[75210]:   </devices>
Nov 29 02:05:45 user nova-compute[75210]: </domain>
Nov 29 02:05:45 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1414050662',display_name='tempest-AttachVolumeTestJSON-server-1414050662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1414050662',id=45,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnJEpIhGEUtzspNudloUDCqPdfW9cYZ2sQlzVx9tGUt/0scbS1iKZfEcu2ljSQv3C5J4amLs1qUmSdg9EDaH/uyEqSH7wkYN/aN65iQBsd4njMlhqQFcrheRR5tIujZFg==',key_name='tempest-keypair-1543632751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64aac75090884257a9c33f94ec9aa367',ramdisk_id='',reservation_id='r-yw0ada9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-91454133',owner_user_name='tempest-AttachVolumeTestJSON-91454133-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee2d9a0f7574bad97338a59b8ce8968',uuid=01f7d4a1-2aec-4fca-a374-4a0554cfa838,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "address": "fa:16:3e:26:99:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9a6b12-57", "ovs_interfaceid": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converting VIF {"id": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "address": "fa:16:3e:26:99:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9a6b12-57", "ovs_interfaceid": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:99:90,bridge_name='br-int',has_traffic_filtering=True,id=ab9a6b12-575e-4a8a-8fd8-8aa908140219,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9a6b12-57') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG os_vif [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:99:90,bridge_name='br-int',has_traffic_filtering=True,id=ab9a6b12-575e-4a8a-8fd8-8aa908140219,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9a6b12-57') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ec98c06-f200-5def-961a-6f7325b67042', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab9a6b12-57, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab9a6b12-57, col_values=(('qos', UUID('b5bb09c8-95da-49e8-a3bc-4f50b916be45')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab9a6b12-57, col_values=(('external_ids', {'iface-id': 'ab9a6b12-575e-4a8a-8fd8-8aa908140219', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:99:90', 'vm-uuid': '01f7d4a1-2aec-4fca-a374-4a0554cfa838'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:45 user nova-compute[75210]: INFO os_vif [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:99:90,bridge_name='br-int',has_traffic_filtering=True,id=ab9a6b12-575e-4a8a-8fd8-8aa908140219,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9a6b12-57')
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No VIF found with MAC fa:16:3e:26:99:90, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.network.neutron [req-c47115e6-6812-49be-8362-55c949f5f0ca req-42d8c1bb-5499-4c98-b0c8-16e03d175d45 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Updated VIF entry in instance network info cache for port ab9a6b12-575e-4a8a-8fd8-8aa908140219. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG nova.network.neutron [req-c47115e6-6812-49be-8362-55c949f5f0ca req-42d8c1bb-5499-4c98-b0c8-16e03d175d45 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Updating instance_info_cache with network_info: [{"id": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "address": "fa:16:3e:26:99:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9a6b12-57", "ovs_interfaceid": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:05:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-c47115e6-6812-49be-8362-55c949f5f0ca req-42d8c1bb-5499-4c98-b0c8-16e03d175d45 service nova] Releasing lock "refresh_cache-01f7d4a1-2aec-4fca-a374-4a0554cfa838" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:05:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-24323221-2785-4045-aed1-da149ffc9c29 req-86a775f1-4719-416e-8baa-f8a7ab87d248 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Received event network-vif-plugged-ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:05:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-24323221-2785-4045-aed1-da149ffc9c29 req-86a775f1-4719-416e-8baa-f8a7ab87d248 service nova] Acquiring lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-24323221-2785-4045-aed1-da149ffc9c29 req-86a775f1-4719-416e-8baa-f8a7ab87d248 service nova] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-24323221-2785-4045-aed1-da149ffc9c29 req-86a775f1-4719-416e-8baa-f8a7ab87d248 service nova] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-24323221-2785-4045-aed1-da149ffc9c29 req-86a775f1-4719-416e-8baa-f8a7ab87d248 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] No waiting events found dispatching network-vif-plugged-ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:05:46 user nova-compute[75210]: WARNING nova.compute.manager [req-24323221-2785-4045-aed1-da149ffc9c29 req-86a775f1-4719-416e-8baa-f8a7ab87d248 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Received unexpected event network-vif-plugged-ab9a6b12-575e-4a8a-8fd8-8aa908140219 for instance with vm_state building and task_state spawning.
Nov 29 02:05:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:05:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:05:48 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:05:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:05:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:05:48 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Instance spawned successfully.
Nov 29 02:05:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:05:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:05:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:05:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:05:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:05:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:05:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:05:48 user nova-compute[75210]: INFO nova.compute.manager [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 29 02:05:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:05:48 user nova-compute[75210]: INFO nova.compute.manager [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Took 5.80 seconds to build instance.
Nov 29 02:05:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-baa39d10-5740-4766-b26a-c254c5fdcd42 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.891s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-3bee9f44-8572-4b32-96a7-a6074c4fb7b7 req-f68f3fdc-49f7-404a-94bf-711025f1168c service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Received event network-vif-plugged-ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:05:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3bee9f44-8572-4b32-96a7-a6074c4fb7b7 req-f68f3fdc-49f7-404a-94bf-711025f1168c service nova] Acquiring lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3bee9f44-8572-4b32-96a7-a6074c4fb7b7 req-f68f3fdc-49f7-404a-94bf-711025f1168c service nova] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3bee9f44-8572-4b32-96a7-a6074c4fb7b7 req-f68f3fdc-49f7-404a-94bf-711025f1168c service nova] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:49 user nova-compute[75210]: DEBUG nova.compute.manager [req-3bee9f44-8572-4b32-96a7-a6074c4fb7b7 req-f68f3fdc-49f7-404a-94bf-711025f1168c service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] No waiting events found dispatching network-vif-plugged-ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:05:49 user nova-compute[75210]: WARNING nova.compute.manager [req-3bee9f44-8572-4b32-96a7-a6074c4fb7b7 req-f68f3fdc-49f7-404a-94bf-711025f1168c service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Received unexpected event network-vif-plugged-ab9a6b12-575e-4a8a-8fd8-8aa908140219 for instance with vm_state active and task_state None.
Nov 29 02:05:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:05:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:50 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:05:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:50 user nova-compute[75210]: INFO nova.compute.manager [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Unshelving
Nov 29 02:05:50 user nova-compute[75210]: INFO nova.virt.block_device [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Booting with volume 36d0d40d-1411-4019-af37-cb6154504220 at /dev/vdc
Nov 29 02:05:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:05:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG os_brick.utils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca552ae-5231-407e-84fc-c27ed7a47444]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b9f697-7524-49a4-9d82-e25177c28888]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a5babb-6a27-4ff5-b639-d5e8f253726b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb76d27-5ba3-4ddc-998f-93318e34e597]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:05:51 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[273a1403-ad45-4c52-8819-712308f89bcd]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG os_brick.utils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updating existing volume attachment record: 700ff23d-2d55-4610-9570-653962fac7b4 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:05:52 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:05:52 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:05:52 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=25.081890106201172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:05:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:52 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:05:52 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 8d971e56-00ad-4c02-8cfc-98a04ae8f528 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:05:52 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 86e93036-8370-46a9-bea4-48c43b372fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:05:52 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:05:52 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance b9fabd34-7143-4b40-bca8-15b6d2bde253 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 29 02:05:52 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:05:52 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:05:53 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:05:53 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:05:53 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:05:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-82284b15-4873-4351-a0ac-4566cf92df8f req-154ac537-69a0-4eba-bd5d-d3d68bd37ff2 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Received event network-changed-331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:05:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-82284b15-4873-4351-a0ac-4566cf92df8f req-154ac537-69a0-4eba-bd5d-d3d68bd37ff2 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Refreshing instance network info cache due to event network-changed-331dcb66-bd77-4e4b-9962-6742ebf5f82b. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:05:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-82284b15-4873-4351-a0ac-4566cf92df8f req-154ac537-69a0-4eba-bd5d-d3d68bd37ff2 service nova] Acquiring lock "refresh_cache-8d971e56-00ad-4c02-8cfc-98a04ae8f528" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:05:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-82284b15-4873-4351-a0ac-4566cf92df8f req-154ac537-69a0-4eba-bd5d-d3d68bd37ff2 service nova] Acquired lock "refresh_cache-8d971e56-00ad-4c02-8cfc-98a04ae8f528" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:05:56 user nova-compute[75210]: DEBUG nova.network.neutron [req-82284b15-4873-4351-a0ac-4566cf92df8f req-154ac537-69a0-4eba-bd5d-d3d68bd37ff2 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Refreshing network info cache for port 331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:05:57 user nova-compute[75210]: DEBUG nova.network.neutron [req-82284b15-4873-4351-a0ac-4566cf92df8f req-154ac537-69a0-4eba-bd5d-d3d68bd37ff2 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Updated VIF entry in instance network info cache for port 331dcb66-bd77-4e4b-9962-6742ebf5f82b. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:05:57 user nova-compute[75210]: DEBUG nova.network.neutron [req-82284b15-4873-4351-a0ac-4566cf92df8f req-154ac537-69a0-4eba-bd5d-d3d68bd37ff2 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Updating instance_info_cache with network_info: [{"id": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "address": "fa:16:3e:61:4d:19", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331dcb66-bd", "ovs_interfaceid": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:05:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-82284b15-4873-4351-a0ac-4566cf92df8f req-154ac537-69a0-4eba-bd5d-d3d68bd37ff2 service nova] Releasing lock "refresh_cache-8d971e56-00ad-4c02-8cfc-98a04ae8f528" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:58 user nova-compute[75210]: INFO nova.compute.manager [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Terminating instance
Nov 29 02:05:58 user nova-compute[75210]: DEBUG nova.compute.manager [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-2fdab283-9aba-4cc0-a923-22b58c88c934 req-a2032b21-d596-4702-9604-48edcdac2be1 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Received event network-vif-unplugged-331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2fdab283-9aba-4cc0-a923-22b58c88c934 req-a2032b21-d596-4702-9604-48edcdac2be1 service nova] Acquiring lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2fdab283-9aba-4cc0-a923-22b58c88c934 req-a2032b21-d596-4702-9604-48edcdac2be1 service nova] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2fdab283-9aba-4cc0-a923-22b58c88c934 req-a2032b21-d596-4702-9604-48edcdac2be1 service nova] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-2fdab283-9aba-4cc0-a923-22b58c88c934 req-a2032b21-d596-4702-9604-48edcdac2be1 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] No waiting events found dispatching network-vif-unplugged-331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:05:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-2fdab283-9aba-4cc0-a923-22b58c88c934 req-a2032b21-d596-4702-9604-48edcdac2be1 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Received event network-vif-unplugged-331dcb66-bd77-4e4b-9962-6742ebf5f82b for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:05:59 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Instance destroyed successfully.
Nov 29 02:05:59 user nova-compute[75210]: DEBUG nova.objects.instance [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lazy-loading 'resources' on Instance uuid 8d971e56-00ad-4c02-8cfc-98a04ae8f528 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1245055753',display_name='tempest-TestVolumeBootPattern-server-1245055753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1245055753',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbeEJ035qedgw6ffpy9AgBMNgjtmpEug1BnI4ukxa+OzSVx7eUZOgpnD5Ot84IR7Q55P3We053ESM83PfYsrIt51L3Ie8cNeSPyWbkxkw4BsGC2WohQHJL8Q1MriTltHA==',key_name='tempest-TestVolumeBootPattern-274321318',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:04:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-uobe9bow',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:04:18Z,user_data=None,user_id='080bcd228b454b03995b0f3e116df917',uuid=8d971e56-00ad-4c02-8cfc-98a04ae8f528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "address": "fa:16:3e:61:4d:19", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331dcb66-bd", "ovs_interfaceid": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "address": "fa:16:3e:61:4d:19", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap331dcb66-bd", "ovs_interfaceid": "331dcb66-bd77-4e4b-9962-6742ebf5f82b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:4d:19,bridge_name='br-int',has_traffic_filtering=True,id=331dcb66-bd77-4e4b-9962-6742ebf5f82b,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331dcb66-bd') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_vif [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:4d:19,bridge_name='br-int',has_traffic_filtering=True,id=331dcb66-bd77-4e4b-9962-6742ebf5f82b,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331dcb66-bd') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap331dcb66-bd, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89ea18e0-ca4f-41e3-aae5-7716b6c1f1a6) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:05:59 user nova-compute[75210]: INFO os_vif [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:4d:19,bridge_name='br-int',has_traffic_filtering=True,id=331dcb66-bd77-4e4b-9962-6742ebf5f82b,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap331dcb66-bd')
Nov 29 02:05:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpNytGVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:05:59 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b2beda-0dc0-4426-8ce1-516f32b76f97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:05:59 user nova-compute[75210]: No targets found.
Nov 29 02:05:59 user nova-compute[75210]: iSNS:
Nov 29 02:05:59 user nova-compute[75210]: No targets found.
Nov 29 02:05:59 user nova-compute[75210]: STATIC:
Nov 29 02:05:59 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18
Nov 29 02:05:59 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:05:59 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:05:59 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32
Nov 29 02:05:59 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:05:59 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:05:59 user nova-compute[75210]: FIRMWARE:
Nov 29 02:05:59 user nova-compute[75210]: No targets found.
Nov 29 02:05:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:05:59 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:05:59 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[21346c90-08c7-451b-ab2e-a72bcd01ca5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d10fb15-a57d-4261-a4b3-fbcb9b4b7787]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:05:59 user nova-compute[75210]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:05:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:05:59 user nova-compute[75210]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:05:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e86a8310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f041591-07f1-4a5b-820e-26ebf2ab0495]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG nova.objects.instance [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'pci_requests' on Instance uuid b9fabd34-7143-4b40-bca8-15b6d2bde253 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG nova.objects.instance [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'numa_topology' on Instance uuid b9fabd34-7143-4b40-bca8-15b6d2bde253 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[280c9bc0-7ba2-44ef-a589-4e71d54cc7b8]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:05:59 user nova-compute[75210]: INFO nova.compute.claims [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Claim successful on node user
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceaaca59-cbb2-4f3c-8970-7414fb0a9616]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.123s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bf1922-0f5f-47b2-97aa-991ef57045cf]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.122s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d20015f-be0c-4f24-b43a-142935ef7be3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f219e8f-1efd-411b-af07-8ac5e56cd1e3]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260]
Nov 29 02:05:59 user nova-compute[75210]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260] successful.
Nov 29 02:05:59 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ffc52c-f22d-4870-b556-6998def21c8c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.524s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== disconnect_volume: return (525ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:05:59 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Deleting instance files /opt/stack/data/nova/instances/8d971e56-00ad-4c02-8cfc-98a04ae8f528_del
Nov 29 02:05:59 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Deletion of /opt/stack/data/nova/instances/8d971e56-00ad-4c02-8cfc-98a04ae8f528_del complete
Nov 29 02:05:59 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:05:59 user nova-compute[75210]: INFO nova.compute.manager [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:05:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:05:59 user nova-compute[75210]: INFO nova.network.neutron [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updating port 6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 02:06:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-ba4fc6d4-ffa4-431d-abfc-b71db8a01ccb req-9a2f150f-07c0-4896-8617-912210ed03c4 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Received event network-vif-plugged-331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:06:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ba4fc6d4-ffa4-431d-abfc-b71db8a01ccb req-9a2f150f-07c0-4896-8617-912210ed03c4 service nova] Acquiring lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ba4fc6d4-ffa4-431d-abfc-b71db8a01ccb req-9a2f150f-07c0-4896-8617-912210ed03c4 service nova] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ba4fc6d4-ffa4-431d-abfc-b71db8a01ccb req-9a2f150f-07c0-4896-8617-912210ed03c4 service nova] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-ba4fc6d4-ffa4-431d-abfc-b71db8a01ccb req-9a2f150f-07c0-4896-8617-912210ed03c4 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] No waiting events found dispatching network-vif-plugged-331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:06:00 user nova-compute[75210]: WARNING nova.compute.manager [req-ba4fc6d4-ffa4-431d-abfc-b71db8a01ccb req-9a2f150f-07c0-4896-8617-912210ed03c4 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Received unexpected event network-vif-plugged-331dcb66-bd77-4e4b-9962-6742ebf5f82b for instance with vm_state active and task_state deleting.
Nov 29 02:06:01 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:06:01 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Took 1.35 seconds to deallocate network for instance.
Nov 29 02:06:01 user nova-compute[75210]: DEBUG nova.compute.manager [req-3151ec59-7ec5-4800-987e-d6926bd794f1 req-b24e6345-02d7-4a1f-aaa0-626b4cb7d9a3 service nova] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Received event network-vif-deleted-331dcb66-bd77-4e4b-9962-6742ebf5f82b {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:06:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:06:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquired lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:06:01 user nova-compute[75210]: DEBUG nova.network.neutron [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:06:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:01 user nova-compute[75210]: DEBUG nova.network.neutron [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updating instance_info_cache with network_info: [{"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:06:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Releasing lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:06:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:06:01 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Creating image(s)
Nov 29 02:06:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "/opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "/opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:01 user nova-compute[75210]: DEBUG nova.objects.instance [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'trusted_certs' on Instance uuid b9fabd34-7143-4b40-bca8-15b6d2bde253 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:06:01 user nova-compute[75210]: DEBUG nova.objects.base [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Object Instance<b9fabd34-7143-4b40-bca8-15b6d2bde253> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:06:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "597d766c9840d65bcfbfa75e9ee2f7caad1679f5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "597d766c9840d65bcfbfa75e9ee2f7caad1679f5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5.part --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:02 user nova-compute[75210]: INFO nova.compute.manager [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 8d971e56-00ad-4c02-8cfc-98a04ae8f528] Took 1.61 seconds to detach 1 volumes for instance.
Nov 29 02:06:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:02 user nova-compute[75210]: DEBUG nova.virt.images [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] 3083fe68-5446-46b3-971c-019dcf3df086 was qcow2, converting to raw {{(pid=75210) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 02:06:02 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 02:06:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5.part /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5.converted {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:02 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5.part /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5.converted" returned: 0 in 0.266s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5.converted --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:03 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Deleted allocations for instance 8d971e56-00ad-4c02-8cfc-98a04ae8f528
Nov 29 02:06:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-4a031db2-9bad-462b-9426-db2e28ccb000 req-f9860965-c0c6-4eeb-9156-9d45b210a6e8 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-changed-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-4a031db2-9bad-462b-9426-db2e28ccb000 req-f9860965-c0c6-4eeb-9156-9d45b210a6e8 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Refreshing instance network info cache due to event network-changed-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4a031db2-9bad-462b-9426-db2e28ccb000 req-f9860965-c0c6-4eeb-9156-9d45b210a6e8 service nova] Acquiring lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4a031db2-9bad-462b-9426-db2e28ccb000 req-f9860965-c0c6-4eeb-9156-9d45b210a6e8 service nova] Acquired lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG nova.network.neutron [req-4a031db2-9bad-462b-9426-db2e28ccb000 req-f9860965-c0c6-4eeb-9156-9d45b210a6e8 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Refreshing network info cache for port 6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-4eba72ce-4929-4127-a248-8a617c8a4339 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "8d971e56-00ad-4c02-8cfc-98a04ae8f528" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.920s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "597d766c9840d65bcfbfa75e9ee2f7caad1679f5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.707s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5 --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "597d766c9840d65bcfbfa75e9ee2f7caad1679f5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "597d766c9840d65bcfbfa75e9ee2f7caad1679f5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG nova.network.neutron [req-4a031db2-9bad-462b-9426-db2e28ccb000 req-f9860965-c0c6-4eeb-9156-9d45b210a6e8 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updated VIF entry in instance network info cache for port 6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG nova.network.neutron [req-4a031db2-9bad-462b-9426-db2e28ccb000 req-f9860965-c0c6-4eeb-9156-9d45b210a6e8 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updating instance_info_cache with network_info: [{"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4a031db2-9bad-462b-9426-db2e28ccb000 req-f9860965-c0c6-4eeb-9156-9d45b210a6e8 service nova] Releasing lock "refresh_cache-b9fabd34-7143-4b40-bca8-15b6d2bde253" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5 --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5,backing_fmt=raw /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5,backing_fmt=raw /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk 1073741824" returned: 0 in 0.049s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "597d766c9840d65bcfbfa75e9ee2f7caad1679f5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5 --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG nova.objects.instance [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'migration_context' on Instance uuid b9fabd34-7143-4b40-bca8-15b6d2bde253 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:06:03 user nova-compute[75210]: DEBUG nova.objects.base [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Object Instance<b9fabd34-7143-4b40-bca8-15b6d2bde253> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:06:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Rebasing disk image.
Nov 29 02:06:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 -F raw /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 -F raw /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk" returned: 0 in 1.943s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Ensure instance console log exists: /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Start _get_guest_xml network_info=[{"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='5bc3e42cffa80ca61b3bec16232a7f83',container_format='bare',created_at=2023-11-29T02:03:58Z,direct_url=<?>,disk_format='qcow2',id=3083fe68-5446-46b3-971c-019dcf3df086,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1647236808-shelved',owner='55934a4b47ab45a4a7f389919225c156',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T02:04:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '700ff23d-2d55-4610-9570-653962fac7b4', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eKPyBtjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'b9fabd34-7143-4b40-bca8-15b6d2bde253', 'attached_at': '', 'detached_at': '', 'volume_id': '36d0d40d-1411-4019-af37-cb6154504220', 'serial': '36d0d40d-1411-4019-af37-cb6154504220'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:06:06 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:06:06 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5bc3e42cffa80ca61b3bec16232a7f83',container_format='bare',created_at=2023-11-29T02:03:58Z,direct_url=<?>,disk_format='qcow2',id=3083fe68-5446-46b3-971c-019dcf3df086,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1647236808-shelved',owner='55934a4b47ab45a4a7f389919225c156',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T02:04:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.objects.instance [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'vcpu_model' on Instance uuid b9fabd34-7143-4b40-bca8-15b6d2bde253 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.objects.base [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Object Instance<b9fabd34-7143-4b40-bca8-15b6d2bde253> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eKPyBtjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:06:06 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:06:06 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:06:06 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cffbb8a-178a-49d7-98af-64bd09a2198b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:06:06 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dc98dd-f21a-4cb7-a7d2-f88b0a309594]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220] added
Nov 29 02:06:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc59a54-4543-4182-bf7f-5b58f8bf4952]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f5dc7c-55bc-4a50-8803-6a4678d05440]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eKPyBtjv {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eKPyBtjv" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[96622204-1813-498b-8fec-1aafa3153d82]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eKPyBtjv'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f2e0e4-9c64-4601-baf9-3f40ee938e3a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b127a16-cf24-4934-9a46-479a79621e75]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:06:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:06:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c326def-9083-4fff-84a1-a22d5317e79b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220, portal: 172.16.0.220,3260]
Nov 29 02:06:06 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220, portal: 172.16.0.220,3260] successful.
Nov 29 02:06:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5397709c-11e7-489b-bd7a-0adccc99727c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7c8354-a4f8-4ac2-8049-20bcf141bf0d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:06:06 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:06:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:06:06 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:06:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c442df-d210-422a-8725-217be22b6500]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eKPyBtjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:06:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23634613965356162', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634613965356162', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T02:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1647236808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1647236808',id=42,image_ref='3083fe68-5446-46b3-971c-019dcf3df086',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-785264678',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:02:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='55934a4b47ab45a4a7f389919225c156',ramdisk_id='',reservation_id='r-ygxad600',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2088736241',owner_user_name='tempest-AttachVolumeShelveTestJSON-2088736241-project-member',shelved_at='2023-11-29T02:04:02.266973',shelved_host='user',shelved_image_id='3083fe68-5446-46b3-971c-019dcf3df086'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f7a67a01104567b3e96f9d150dddd2',uuid=b9fabd34-7143-4b40-bca8-15b6d2bde253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converting VIF {"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG nova.objects.instance [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'pci_devices' on Instance uuid b9fabd34-7143-4b40-bca8-15b6d2bde253 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG nova.objects.base [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Object Instance<b9fabd34-7143-4b40-bca8-15b6d2bde253> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:06:07 user nova-compute[75210]:   <uuid>b9fabd34-7143-4b40-bca8-15b6d2bde253</uuid>
Nov 29 02:06:07 user nova-compute[75210]:   <name>instance-0000002a</name>
Nov 29 02:06:07 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:06:07 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:06:07 user nova-compute[75210]:   <metadata>
Nov 29 02:06:07 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:06:07 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:06:07 user nova-compute[75210]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1647236808</nova:name>
Nov 29 02:06:07 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:06:06</nova:creationTime>
Nov 29 02:06:07 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:06:07 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:06:07 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:06:07 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:06:07 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:06:07 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:06:07 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:06:07 user nova-compute[75210]:       <nova:owner>
Nov 29 02:06:07 user nova-compute[75210]:         <nova:user uuid="f4f7a67a01104567b3e96f9d150dddd2">tempest-AttachVolumeShelveTestJSON-2088736241-project-member</nova:user>
Nov 29 02:06:07 user nova-compute[75210]:         <nova:project uuid="55934a4b47ab45a4a7f389919225c156">tempest-AttachVolumeShelveTestJSON-2088736241</nova:project>
Nov 29 02:06:07 user nova-compute[75210]:       </nova:owner>
Nov 29 02:06:07 user nova-compute[75210]:       <nova:root type="image" uuid="3083fe68-5446-46b3-971c-019dcf3df086"/>
Nov 29 02:06:07 user nova-compute[75210]:       <nova:ports>
Nov 29 02:06:07 user nova-compute[75210]:         <nova:port uuid="6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7">
Nov 29 02:06:07 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 29 02:06:07 user nova-compute[75210]:         </nova:port>
Nov 29 02:06:07 user nova-compute[75210]:       </nova:ports>
Nov 29 02:06:07 user nova-compute[75210]:     </nova:instance>
Nov 29 02:06:07 user nova-compute[75210]:   </metadata>
Nov 29 02:06:07 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:06:07 user nova-compute[75210]:     <system>
Nov 29 02:06:07 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:06:07 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:06:07 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:06:07 user nova-compute[75210]:       <entry name="serial">b9fabd34-7143-4b40-bca8-15b6d2bde253</entry>
Nov 29 02:06:07 user nova-compute[75210]:       <entry name="uuid">b9fabd34-7143-4b40-bca8-15b6d2bde253</entry>
Nov 29 02:06:07 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:06:07 user nova-compute[75210]:     </system>
Nov 29 02:06:07 user nova-compute[75210]:   </sysinfo>
Nov 29 02:06:07 user nova-compute[75210]:   <os>
Nov 29 02:06:07 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:06:07 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:06:07 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:06:07 user nova-compute[75210]:   </os>
Nov 29 02:06:07 user nova-compute[75210]:   <features>
Nov 29 02:06:07 user nova-compute[75210]:     <acpi/>
Nov 29 02:06:07 user nova-compute[75210]:     <apic/>
Nov 29 02:06:07 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:06:07 user nova-compute[75210]:   </features>
Nov 29 02:06:07 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:06:07 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:06:07 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:06:07 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:06:07 user nova-compute[75210]:   </clock>
Nov 29 02:06:07 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:06:07 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:06:07 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:06:07 user nova-compute[75210]:   </cpu>
Nov 29 02:06:07 user nova-compute[75210]:   <devices>
Nov 29 02:06:07 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:06:07 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:06:07 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk"/>
Nov 29 02:06:07 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:06:07 user nova-compute[75210]:     </disk>
Nov 29 02:06:07 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 02:06:07 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:06:07 user nova-compute[75210]:       <source dev="/dev/sdb"/>
Nov 29 02:06:07 user nova-compute[75210]:       <target dev="vdc" bus="virtio"/>
Nov 29 02:06:07 user nova-compute[75210]:       <serial>36d0d40d-1411-4019-af37-cb6154504220</serial>
Nov 29 02:06:07 user nova-compute[75210]:     </disk>
Nov 29 02:06:07 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:06:07 user nova-compute[75210]:       <mac address="fa:16:3e:16:a1:c9"/>
Nov 29 02:06:07 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:06:07 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:06:07 user nova-compute[75210]:       <target dev="tap6f0dfb9d-2c"/>
Nov 29 02:06:07 user nova-compute[75210]:     </interface>
Nov 29 02:06:07 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:06:07 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/console.log" append="off"/>
Nov 29 02:06:07 user nova-compute[75210]:     </serial>
Nov 29 02:06:07 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:06:07 user nova-compute[75210]:     <video>
Nov 29 02:06:07 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:06:07 user nova-compute[75210]:     </video>
Nov 29 02:06:07 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:06:07 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:06:07 user nova-compute[75210]:     </rng>
Nov 29 02:06:07 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:06:07 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:06:07 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:06:07 user nova-compute[75210]:     </memballoon>
Nov 29 02:06:07 user nova-compute[75210]:   </devices>
Nov 29 02:06:07 user nova-compute[75210]: </domain>
Nov 29 02:06:07 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T02:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1647236808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1647236808',id=42,image_ref='3083fe68-5446-46b3-971c-019dcf3df086',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-785264678',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:02:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='55934a4b47ab45a4a7f389919225c156',ramdisk_id='',reservation_id='r-ygxad600',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2088736241',owner_user_name='tempest-AttachVolumeShelveTestJSON-2088736241-project-member',shelved_at='2023-11-29T02:04:02.266973',shelved_host='user',shelved_image_id='3083fe68-5446-46b3-971c-019dcf3df086'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f7a67a01104567b3e96f9d150dddd2',uuid=b9fabd34-7143-4b40-bca8-15b6d2bde253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converting VIF {"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG os_vif [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab430f39-9e6c-5553-a90d-c7940070ec7d', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f0dfb9d-2c, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f0dfb9d-2c, col_values=(('qos', UUID('1df271ee-717b-45b0-a704-6e2b6a6a397e')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f0dfb9d-2c, col_values=(('external_ids', {'iface-id': '6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:a1:c9', 'vm-uuid': 'b9fabd34-7143-4b40-bca8-15b6d2bde253'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:07 user nova-compute[75210]: INFO os_vif [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c')
Nov 29 02:06:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:06:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] No VIF found with MAC fa:16:3e:16:a1:c9, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:06:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-08b42d40-5d73-4d40-82f0-90124373ace3 req-1ca4cab6-6b68-4c73-a500-30b31a454dc2 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:06:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-08b42d40-5d73-4d40-82f0-90124373ace3 req-1ca4cab6-6b68-4c73-a500-30b31a454dc2 service nova] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-08b42d40-5d73-4d40-82f0-90124373ace3 req-1ca4cab6-6b68-4c73-a500-30b31a454dc2 service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-08b42d40-5d73-4d40-82f0-90124373ace3 req-1ca4cab6-6b68-4c73-a500-30b31a454dc2 service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-08b42d40-5d73-4d40-82f0-90124373ace3 req-1ca4cab6-6b68-4c73-a500-30b31a454dc2 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] No waiting events found dispatching network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:06:09 user nova-compute[75210]: WARNING nova.compute.manager [req-08b42d40-5d73-4d40-82f0-90124373ace3 req-1ca4cab6-6b68-4c73-a500-30b31a454dc2 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received unexpected event network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 02:06:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:06:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:06:10 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Instance spawned successfully.
Nov 29 02:06:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-40400484-c1a7-4ba3-8b76-59a63ff85326 req-743c1034-d4c8-48b8-a094-e23a31e79d84 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:06:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-40400484-c1a7-4ba3-8b76-59a63ff85326 req-743c1034-d4c8-48b8-a094-e23a31e79d84 service nova] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-40400484-c1a7-4ba3-8b76-59a63ff85326 req-743c1034-d4c8-48b8-a094-e23a31e79d84 service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-40400484-c1a7-4ba3-8b76-59a63ff85326 req-743c1034-d4c8-48b8-a094-e23a31e79d84 service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-40400484-c1a7-4ba3-8b76-59a63ff85326 req-743c1034-d4c8-48b8-a094-e23a31e79d84 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] No waiting events found dispatching network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:06:11 user nova-compute[75210]: WARNING nova.compute.manager [req-40400484-c1a7-4ba3-8b76-59a63ff85326 req-743c1034-d4c8-48b8-a094-e23a31e79d84 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received unexpected event network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 02:06:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:06:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-dee29f2f-3dfb-44bb-9897-66a7d50c750d tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.420s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-9b96c367-d1ba-4172-9763-d3492186b907 req-bc4a09ba-4ff9-4453-ab48-f118958b62e2 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Received event network-changed-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:06:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-9b96c367-d1ba-4172-9763-d3492186b907 req-bc4a09ba-4ff9-4453-ab48-f118958b62e2 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Refreshing instance network info cache due to event network-changed-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:06:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9b96c367-d1ba-4172-9763-d3492186b907 req-bc4a09ba-4ff9-4453-ab48-f118958b62e2 service nova] Acquiring lock "refresh_cache-86e93036-8370-46a9-bea4-48c43b372fb3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:06:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9b96c367-d1ba-4172-9763-d3492186b907 req-bc4a09ba-4ff9-4453-ab48-f118958b62e2 service nova] Acquired lock "refresh_cache-86e93036-8370-46a9-bea4-48c43b372fb3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:06:14 user nova-compute[75210]: DEBUG nova.network.neutron [req-9b96c367-d1ba-4172-9763-d3492186b907 req-bc4a09ba-4ff9-4453-ab48-f118958b62e2 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Refreshing network info cache for port 0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:06:15 user nova-compute[75210]: DEBUG nova.network.neutron [req-9b96c367-d1ba-4172-9763-d3492186b907 req-bc4a09ba-4ff9-4453-ab48-f118958b62e2 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Updated VIF entry in instance network info cache for port 0f36b7c3-433c-4c8f-b14e-86a4f9a05c34. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:06:15 user nova-compute[75210]: DEBUG nova.network.neutron [req-9b96c367-d1ba-4172-9763-d3492186b907 req-bc4a09ba-4ff9-4453-ab48-f118958b62e2 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Updating instance_info_cache with network_info: [{"id": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "address": "fa:16:3e:68:f0:20", "network": {"id": "592e6292-5cff-47e9-a721-6d783a66ba5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2045737211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e854d353630b499b84ffee7b89f1c7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f36b7c3-43", "ovs_interfaceid": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:06:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9b96c367-d1ba-4172-9763-d3492186b907 req-bc4a09ba-4ff9-4453-ab48-f118958b62e2 service nova] Releasing lock "refresh_cache-86e93036-8370-46a9-bea4-48c43b372fb3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:06:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "86e93036-8370-46a9-bea4-48c43b372fb3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "86e93036-8370-46a9-bea4-48c43b372fb3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:17 user nova-compute[75210]: DEBUG nova.objects.instance [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lazy-loading 'flavor' on Instance uuid 86e93036-8370-46a9-bea4-48c43b372fb3 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:06:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "86e93036-8370-46a9-bea4-48c43b372fb3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "86e93036-8370-46a9-bea4-48c43b372fb3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "86e93036-8370-46a9-bea4-48c43b372fb3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:17 user nova-compute[75210]: INFO nova.compute.manager [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Attaching volume 8691ad5a-2db0-443f-b4d3-d54b403b6d88 to /dev/vdb
Nov 29 02:06:18 user nova-compute[75210]: DEBUG os_brick.utils [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9940e58-f8cd-4cdb-b7aa-bcd85ab6feee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bcc6c9-3aa0-4edd-b2c0-de1def9114d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f21977-9dd8-49ab-8072-fe754100c198]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[32eaa967-8579-463d-bc05-db0cac5f50a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:06:18 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:06:18 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94af8e3-aae4-494d-a89e-d2892b03a2b6]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG os_brick.utils [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:06:18 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Updating existing volume attachment record: 41fdd0e9-5f4b-47d5-a8f2-e9acc6fd78eb {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:06:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHUnQthR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:06:25 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:06:25 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:06:25 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b207b2be-752c-4c1e-bbbe-0c3123e3dbfa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:06:25 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79fdcb1-5939-486f-a16f-c861550532e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88] added
Nov 29 02:06:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc7f6ba-ad0c-42b1-a387-26db31c47386]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[05625cc3-24cf-4815-b556-bdb58c931df1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHUnQthR {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DHUnQthR" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a4c383-f953-4e6e-96c6-a2a1411eea88]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DHUnQthR'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8d3459-2c23-40d4-8fc3-f831c720815c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d74dcb7-fb43-4d49-a217-d28e0886decc]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:06:25 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:06:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:06:25 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:06:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a29698-7354-40c6-a238-8c34987cf415]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88, portal: 172.16.0.220,3260]
Nov 29 02:06:25 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88, portal: 172.16.0.220,3260] successful.
Nov 29 02:06:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[222cb39a-9fac-45c2-9e3d-0a5c05ca0201]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[07904b92-5779-45a4-8340-fb219b4505fa]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:06:25 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:06:25 user nova-compute[75210]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 (non-flash)
Nov 29 02:06:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:06:25 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:06:25 user nova-compute[75210]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 (non-flash)
Nov 29 02:06:25 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f600fdc-2045-4c0d-9f67-364c0678613f]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:25 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:06:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:26 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:06:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHUnQthR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:06:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:06:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23738613566623035', 'path': '/dev/sdd'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:06:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738613566623035', 'path': '/dev/sdd'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:06:26 user nova-compute[75210]: DEBUG nova.objects.instance [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lazy-loading 'flavor' on Instance uuid 86e93036-8370-46a9-bea4-48c43b372fb3 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:06:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 02:06:26 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:06:26 user nova-compute[75210]:   <source dev="/dev/sdd"/>
Nov 29 02:06:26 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:06:26 user nova-compute[75210]:   <serial>8691ad5a-2db0-443f-b4d3-d54b403b6d88</serial>
Nov 29 02:06:26 user nova-compute[75210]: </disk>
Nov 29 02:06:26 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 02:06:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:06:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:06:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] No VIF found with MAC fa:16:3e:68:f0:20, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:06:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-943cfa23-9c77-4ee7-9c69-294ad607f2ab tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "86e93036-8370-46a9-bea4-48c43b372fb3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.166s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "86e93036-8370-46a9-bea4-48c43b372fb3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "86e93036-8370-46a9-bea4-48c43b372fb3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:28 user nova-compute[75210]: INFO nova.compute.manager [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Detaching volume 8691ad5a-2db0-443f-b4d3-d54b403b6d88
Nov 29 02:06:28 user nova-compute[75210]: INFO nova.virt.block_device [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Attempting to driver detach volume 8691ad5a-2db0-443f-b4d3-d54b403b6d88 from mountpoint /dev/vdb
Nov 29 02:06:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Attempting to detach device vdb from instance 86e93036-8370-46a9-bea4-48c43b372fb3 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:06:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:06:28 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:06:28 user nova-compute[75210]:   <source dev="/dev/sdd"/>
Nov 29 02:06:28 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:06:28 user nova-compute[75210]:   <serial>8691ad5a-2db0-443f-b4d3-d54b403b6d88</serial>
Nov 29 02:06:28 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:06:28 user nova-compute[75210]: </disk>
Nov 29 02:06:28 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:06:28 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Successfully detached device vdb from instance 86e93036-8370-46a9-bea4-48c43b372fb3 from the persistent domain config.
Nov 29 02:06:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86e93036-8370-46a9-bea4-48c43b372fb3 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:06:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:06:28 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:06:28 user nova-compute[75210]:   <source dev="/dev/sdd"/>
Nov 29 02:06:28 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:06:28 user nova-compute[75210]:   <serial>8691ad5a-2db0-443f-b4d3-d54b403b6d88</serial>
Nov 29 02:06:28 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:06:28 user nova-compute[75210]: </disk>
Nov 29 02:06:28 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:06:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86e93036-8370-46a9-bea4-48c43b372fb3 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:06:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:40 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:06:40 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:06:41 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:06:41 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:06:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-86e93036-8370-46a9-bea4-48c43b372fb3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:06:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-86e93036-8370-46a9-bea4-48c43b372fb3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:06:41 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:06:42 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Updating instance_info_cache with network_info: [{"id": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "address": "fa:16:3e:68:f0:20", "network": {"id": "592e6292-5cff-47e9-a721-6d783a66ba5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2045737211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e854d353630b499b84ffee7b89f1c7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f36b7c3-43", "ovs_interfaceid": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:06:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-86e93036-8370-46a9-bea4-48c43b372fb3" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:06:42 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:06:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:06:44 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:06:45 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:06:46 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:06:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:48 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:06:48 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:06:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:06:49 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 86e93036-8370-46a9-bea4-48c43b372fb3 is timed out.
Nov 29 02:06:49 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Successfully detached device vdb from instance 86e93036-8370-46a9-bea4-48c43b372fb3 from the live domain config.
Nov 29 02:06:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DHUnQthR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:06:49 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2809e3e4-eafd-4e8d-8d41-f9a5101f8703]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:06:49 user nova-compute[75210]: No targets found.
Nov 29 02:06:49 user nova-compute[75210]: iSNS:
Nov 29 02:06:49 user nova-compute[75210]: No targets found.
Nov 29 02:06:49 user nova-compute[75210]: STATIC:
Nov 29 02:06:49 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220
Nov 29 02:06:49 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:06:49 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:06:49 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32
Nov 29 02:06:49 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:06:49 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:06:49 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88
Nov 29 02:06:49 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:06:49 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:06:49 user nova-compute[75210]: FIRMWARE:
Nov 29 02:06:49 user nova-compute[75210]: No targets found.
Nov 29 02:06:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:06:49 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:06:49 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ed0dc3-0b21-4fe4-b0ea-7e4225ddf59b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f457ac2-2f35-4f03-a38c-6f25b46f8cec]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:06:49 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:06:49 user nova-compute[75210]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 (non-flash)
Nov 29 02:06:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:06:49 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:06:49 user nova-compute[75210]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 (non-flash)
Nov 29 02:06:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e8709cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88'): ({'sdd'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Removing single pathed devices sdd {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3fe15d-7230-4d36-ba33-fe06a746882c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7997a2-7319-4587-ba09-3f79594f04a0]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Flushing IO for device /dev/sdd {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4690d663-7f8d-478e-b96a-b4e354c0ef62]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f2cdda-55e2-465c-9a7f-0a6f45aab590]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e7fa8b-ced2-4c16-b917-372bea38a0cd]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5314c6b6-70b9-425d-af73-24a20e25e6e9]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88, portal: 172.16.0.220,3260]
Nov 29 02:06:49 user nova-compute[75210]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88, portal: 172.16.0.220,3260] successful.
Nov 29 02:06:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8691ad5a-2db0-443f-b4d3-d54b403b6d88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3608d9-676a-40db-8fc1-496ffe6ccc18]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] <== disconnect_volume: return (281ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:06:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lazy-loading 'flavor' on Instance uuid 86e93036-8370-46a9-bea4-48c43b372fb3 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-19f2267a-d9d2-4070-b665-94eb3dcf9506 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "86e93036-8370-46a9-bea4-48c43b372fb3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.796s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:06:50 user nova-compute[75210]: INFO nova.compute.claims [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Claim successful on node user
Nov 29 02:06:50 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:06:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:06:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG nova.policy [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '080bcd228b454b03995b0f3e116df917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70d8cbb4232433cbd0db9e9448d897f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:06:50 user nova-compute[75210]: INFO nova.virt.block_device [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Booting with volume 85345339-62fb-4ea2-93e5-5ece2bae3b18 at /dev/vda
Nov 29 02:06:50 user nova-compute[75210]: DEBUG os_brick.utils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[545942a7-4be4-452f-80c9-7210e2ead9c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4f4efb-5aef-4ba0-a6e2-1ebd0f735a9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[313bc33b-763f-469f-82e1-3636af3e856a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[de492757-a1b3-4773-af79-cbfff75398ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:06:50 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:06:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb84294f-d17b-4888-a9c0-1d4b06770f58]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG os_brick.utils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:06:50 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Updating existing volume attachment record: ab927342-9dd5-492b-a184-de8fdeb90a32 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:06:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:51 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:06:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:51 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:06:51 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Successfully created port: 57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:06:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.rescue --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Successfully updated port: 57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquired lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-25cd5c6b-dbcb-4e17-b145-e25a56effdf0 req-6ad09a52-4eaa-4815-a4e7-cda178e6142d service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Received event network-changed-57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-25cd5c6b-dbcb-4e17-b145-e25a56effdf0 req-6ad09a52-4eaa-4815-a4e7-cda178e6142d service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Refreshing instance network info cache due to event network-changed-57a63d91-cd0f-42a7-ac0f-d29e291ee465. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-25cd5c6b-dbcb-4e17-b145-e25a56effdf0 req-6ad09a52-4eaa-4815-a4e7-cda178e6142d service nova] Acquiring lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Updating instance_info_cache with network_info: [{"id": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "address": "fa:16:3e:0b:6e:84", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a63d91-cd", "ovs_interfaceid": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Releasing lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Instance network_info: |[{"id": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "address": "fa:16:3e:0b:6e:84", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a63d91-cd", "ovs_interfaceid": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-25cd5c6b-dbcb-4e17-b145-e25a56effdf0 req-6ad09a52-4eaa-4815-a4e7-cda178e6142d service nova] Acquired lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG nova.network.neutron [req-25cd5c6b-dbcb-4e17-b145-e25a56effdf0 req-6ad09a52-4eaa-4815-a4e7-cda178e6142d service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Refreshing network info cache for port 57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:53 user nova-compute[75210]: DEBUG nova.network.neutron [req-25cd5c6b-dbcb-4e17-b145-e25a56effdf0 req-6ad09a52-4eaa-4815-a4e7-cda178e6142d service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Updated VIF entry in instance network info cache for port 57a63d91-cd0f-42a7-ac0f-d29e291ee465. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:06:53 user nova-compute[75210]: DEBUG nova.network.neutron [req-25cd5c6b-dbcb-4e17-b145-e25a56effdf0 req-6ad09a52-4eaa-4815-a4e7-cda178e6142d service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Updating instance_info_cache with network_info: [{"id": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "address": "fa:16:3e:0b:6e:84", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a63d91-cd", "ovs_interfaceid": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:06:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-25cd5c6b-dbcb-4e17-b145-e25a56effdf0 req-6ad09a52-4eaa-4815-a4e7-cda178e6142d service nova] Releasing lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:06:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:06:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:06:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:06:53 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:06:53 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:06:53 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8467MB free_disk=25.010498046875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:06:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:06:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:06:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:06:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 86e93036-8370-46a9-bea4-48c43b372fb3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:06:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:06:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance b9fabd34-7143-4b40-bca8-15b6d2bde253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:06:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:06:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:06:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:06:54 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:06:54 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:06:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:06:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:06:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:07:00 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Creating image(s)
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Ensure instance console log exists: /opt/stack/data/nova/instances/f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Start _get_guest_xml network_info=[{"id": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "address": "fa:16:3e:0b:6e:84", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a63d91-cd", "ovs_interfaceid": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'ab927342-9dd5-492b-a184-de8fdeb90a32', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpNytGVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d', 'attached_at': '', 'detached_at': '', 'volume_id': '85345339-62fb-4ea2-93e5-5ece2bae3b18', 'serial': '85345339-62fb-4ea2-93e5-5ece2bae3b18'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:07:00 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:07:00 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpNytGVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:07:00 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:07:00 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:07:00 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2783f81-587f-442c-a88e-721093745fc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:07:00 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c7e6f7-5e3f-46b8-8ff9-597b0cc53e95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18] added
Nov 29 02:07:00 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf98e57-01e4-47b1-bc1a-f2410f1e007f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cb77f4-d4c4-414d-8678-af876713ff85]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CpNytGVo {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CpNytGVo" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[43261cf0-c678-4346-8585-2f7854b568c0]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CpNytGVo'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fb1649-f8a2-412f-90b4-47de202e3a2a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[75530e7d-f2d3-4bc7-b62d-725152cd4796]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:07:00 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:07:00 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:07:00 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:07:00 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[767f204c-e340-4835-9b19-c79667e6817f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260]
Nov 29 02:07:00 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260] successful.
Nov 29 02:07:00 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04dfb04-c5e4-49ba-b995-86349c6b8426]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0764a30-98fb-4440-a83e-55c3ad60bde0]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:07:01 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:07:01 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:07:01 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:07:01 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:07:01 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:07:01 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14f22aa-b4f3-48f9-a489-7b6157e0c47e]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:07:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpNytGVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23937613765633764', 'path': '/dev/sdd'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937613765633764', 'path': '/dev/sdd'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-912707013',display_name='tempest-TestVolumeBootPattern-server-912707013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-912707013',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbeEJ035qedgw6ffpy9AgBMNgjtmpEug1BnI4ukxa+OzSVx7eUZOgpnD5Ot84IR7Q55P3We053ESM83PfYsrIt51L3Ie8cNeSPyWbkxkw4BsGC2WohQHJL8Q1MriTltHA==',key_name='tempest-TestVolumeBootPattern-274321318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-kq2ou3uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:06:51Z,user_data=None,user_id='080bcd228b454b03995b0f3e116df917',uuid=f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "address": "fa:16:3e:0b:6e:84", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a63d91-cd", "ovs_interfaceid": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "address": "fa:16:3e:0b:6e:84", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a63d91-cd", "ovs_interfaceid": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:6e:84,bridge_name='br-int',has_traffic_filtering=True,id=57a63d91-cd0f-42a7-ac0f-d29e291ee465,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a63d91-cd') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG nova.objects.instance [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lazy-loading 'pci_devices' on Instance uuid f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:07:02 user nova-compute[75210]:   <uuid>f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d</uuid>
Nov 29 02:07:02 user nova-compute[75210]:   <name>instance-0000002e</name>
Nov 29 02:07:02 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:07:02 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:07:02 user nova-compute[75210]:   <metadata>
Nov 29 02:07:02 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:07:02 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:07:02 user nova-compute[75210]:       <nova:name>tempest-TestVolumeBootPattern-server-912707013</nova:name>
Nov 29 02:07:02 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:07:00</nova:creationTime>
Nov 29 02:07:02 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:07:02 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:07:02 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:07:02 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:07:02 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:07:02 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:07:02 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:07:02 user nova-compute[75210]:       <nova:owner>
Nov 29 02:07:02 user nova-compute[75210]:         <nova:user uuid="080bcd228b454b03995b0f3e116df917">tempest-TestVolumeBootPattern-670838009-project-member</nova:user>
Nov 29 02:07:02 user nova-compute[75210]:         <nova:project uuid="f70d8cbb4232433cbd0db9e9448d897f">tempest-TestVolumeBootPattern-670838009</nova:project>
Nov 29 02:07:02 user nova-compute[75210]:       </nova:owner>
Nov 29 02:07:02 user nova-compute[75210]:       <nova:ports>
Nov 29 02:07:02 user nova-compute[75210]:         <nova:port uuid="57a63d91-cd0f-42a7-ac0f-d29e291ee465">
Nov 29 02:07:02 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 29 02:07:02 user nova-compute[75210]:         </nova:port>
Nov 29 02:07:02 user nova-compute[75210]:       </nova:ports>
Nov 29 02:07:02 user nova-compute[75210]:     </nova:instance>
Nov 29 02:07:02 user nova-compute[75210]:   </metadata>
Nov 29 02:07:02 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:07:02 user nova-compute[75210]:     <system>
Nov 29 02:07:02 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:07:02 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:07:02 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:07:02 user nova-compute[75210]:       <entry name="serial">f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d</entry>
Nov 29 02:07:02 user nova-compute[75210]:       <entry name="uuid">f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d</entry>
Nov 29 02:07:02 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:07:02 user nova-compute[75210]:     </system>
Nov 29 02:07:02 user nova-compute[75210]:   </sysinfo>
Nov 29 02:07:02 user nova-compute[75210]:   <os>
Nov 29 02:07:02 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:07:02 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:07:02 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:07:02 user nova-compute[75210]:   </os>
Nov 29 02:07:02 user nova-compute[75210]:   <features>
Nov 29 02:07:02 user nova-compute[75210]:     <acpi/>
Nov 29 02:07:02 user nova-compute[75210]:     <apic/>
Nov 29 02:07:02 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:07:02 user nova-compute[75210]:   </features>
Nov 29 02:07:02 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:07:02 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:07:02 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:07:02 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:07:02 user nova-compute[75210]:   </clock>
Nov 29 02:07:02 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:07:02 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:07:02 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:07:02 user nova-compute[75210]:   </cpu>
Nov 29 02:07:02 user nova-compute[75210]:   <devices>
Nov 29 02:07:02 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 02:07:02 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:07:02 user nova-compute[75210]:       <source dev="/dev/sdd"/>
Nov 29 02:07:02 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:07:02 user nova-compute[75210]:       <serial>85345339-62fb-4ea2-93e5-5ece2bae3b18</serial>
Nov 29 02:07:02 user nova-compute[75210]:     </disk>
Nov 29 02:07:02 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:07:02 user nova-compute[75210]:       <mac address="fa:16:3e:0b:6e:84"/>
Nov 29 02:07:02 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:07:02 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:07:02 user nova-compute[75210]:       <target dev="tap57a63d91-cd"/>
Nov 29 02:07:02 user nova-compute[75210]:     </interface>
Nov 29 02:07:02 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:07:02 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d/console.log" append="off"/>
Nov 29 02:07:02 user nova-compute[75210]:     </serial>
Nov 29 02:07:02 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:07:02 user nova-compute[75210]:     <video>
Nov 29 02:07:02 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:07:02 user nova-compute[75210]:     </video>
Nov 29 02:07:02 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:07:02 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:07:02 user nova-compute[75210]:     </rng>
Nov 29 02:07:02 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:07:02 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:07:02 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:07:02 user nova-compute[75210]:     </memballoon>
Nov 29 02:07:02 user nova-compute[75210]:   </devices>
Nov 29 02:07:02 user nova-compute[75210]: </domain>
Nov 29 02:07:02 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-912707013',display_name='tempest-TestVolumeBootPattern-server-912707013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-912707013',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbeEJ035qedgw6ffpy9AgBMNgjtmpEug1BnI4ukxa+OzSVx7eUZOgpnD5Ot84IR7Q55P3We053ESM83PfYsrIt51L3Ie8cNeSPyWbkxkw4BsGC2WohQHJL8Q1MriTltHA==',key_name='tempest-TestVolumeBootPattern-274321318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-kq2ou3uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:06:51Z,user_data=None,user_id='080bcd228b454b03995b0f3e116df917',uuid=f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "address": "fa:16:3e:0b:6e:84", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a63d91-cd", "ovs_interfaceid": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "address": "fa:16:3e:0b:6e:84", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a63d91-cd", "ovs_interfaceid": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:6e:84,bridge_name='br-int',has_traffic_filtering=True,id=57a63d91-cd0f-42a7-ac0f-d29e291ee465,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a63d91-cd') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG os_vif [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:6e:84,bridge_name='br-int',has_traffic_filtering=True,id=57a63d91-cd0f-42a7-ac0f-d29e291ee465,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a63d91-cd') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2c37c0b-3495-55a5-9de7-cffa3209ccff', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57a63d91-cd, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57a63d91-cd, col_values=(('qos', UUID('26a276e5-8252-41ed-9239-4427cbf65234')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57a63d91-cd, col_values=(('external_ids', {'iface-id': '57a63d91-cd0f-42a7-ac0f-d29e291ee465', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:6e:84', 'vm-uuid': 'f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:02 user nova-compute[75210]: INFO os_vif [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:6e:84,bridge_name='br-int',has_traffic_filtering=True,id=57a63d91-cd0f-42a7-ac0f-d29e291ee465,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a63d91-cd')
Nov 29 02:07:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:07:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] No VIF found with MAC fa:16:3e:0b:6e:84, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:07:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-3956454c-dc34-4e03-93b5-4b72412547b3 req-914240a3-5437-4daf-8aa8-770021d980fb service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Received event network-vif-plugged-57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3956454c-dc34-4e03-93b5-4b72412547b3 req-914240a3-5437-4daf-8aa8-770021d980fb service nova] Acquiring lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3956454c-dc34-4e03-93b5-4b72412547b3 req-914240a3-5437-4daf-8aa8-770021d980fb service nova] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3956454c-dc34-4e03-93b5-4b72412547b3 req-914240a3-5437-4daf-8aa8-770021d980fb service nova] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-3956454c-dc34-4e03-93b5-4b72412547b3 req-914240a3-5437-4daf-8aa8-770021d980fb service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] No waiting events found dispatching network-vif-plugged-57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:07:03 user nova-compute[75210]: WARNING nova.compute.manager [req-3956454c-dc34-4e03-93b5-4b72412547b3 req-914240a3-5437-4daf-8aa8-770021d980fb service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Received unexpected event network-vif-plugged-57a63d91-cd0f-42a7-ac0f-d29e291ee465 for instance with vm_state building and task_state spawning.
Nov 29 02:07:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:07:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:07:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Instance spawned successfully.
Nov 29 02:07:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:07:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:07:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:07:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:07:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:07:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:07:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:07:05 user nova-compute[75210]: INFO nova.compute.manager [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 29 02:07:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:07:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-330f450c-16e5-4e20-801f-dadcd98ed320 req-0a295993-4d55-4f3a-b4f2-87228f94d826 service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Received event network-vif-plugged-57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-330f450c-16e5-4e20-801f-dadcd98ed320 req-0a295993-4d55-4f3a-b4f2-87228f94d826 service nova] Acquiring lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-330f450c-16e5-4e20-801f-dadcd98ed320 req-0a295993-4d55-4f3a-b4f2-87228f94d826 service nova] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-330f450c-16e5-4e20-801f-dadcd98ed320 req-0a295993-4d55-4f3a-b4f2-87228f94d826 service nova] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-330f450c-16e5-4e20-801f-dadcd98ed320 req-0a295993-4d55-4f3a-b4f2-87228f94d826 service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] No waiting events found dispatching network-vif-plugged-57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:07:05 user nova-compute[75210]: WARNING nova.compute.manager [req-330f450c-16e5-4e20-801f-dadcd98ed320 req-0a295993-4d55-4f3a-b4f2-87228f94d826 service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Received unexpected event network-vif-plugged-57a63d91-cd0f-42a7-ac0f-d29e291ee465 for instance with vm_state building and task_state spawning.
Nov 29 02:07:05 user nova-compute[75210]: INFO nova.compute.manager [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Took 15.40 seconds to build instance.
Nov 29 02:07:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b94897b9-e4a7-498c-9725-2650952bc048 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.507s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:07:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:07:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:07:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:07:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:07:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:14 user nova-compute[75210]: INFO nova.compute.manager [None req-c579644b-74f1-4d40-afa0-d8b5c291a1f4 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Unrescuing
Nov 29 02:07:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c579644b-74f1-4d40-afa0-d8b5c291a1f4 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:07:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c579644b-74f1-4d40-afa0-d8b5c291a1f4 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquired lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:07:14 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c579644b-74f1-4d40-afa0-d8b5c291a1f4 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:07:14 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c579644b-74f1-4d40-afa0-d8b5c291a1f4 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updating instance_info_cache with network_info: [{"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:07:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c579644b-74f1-4d40-afa0-d8b5c291a1f4 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Releasing lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:07:14 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c579644b-74f1-4d40-afa0-d8b5c291a1f4 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lazy-loading 'flavor' on Instance uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:07:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:15 user nova-compute[75210]: DEBUG nova.compute.manager [req-1874d04a-b97a-4008-9c89-8cf6295c07e5 req-3f8f25c3-7700-4341-9fe1-6824fa2c9cff service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-unplugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1874d04a-b97a-4008-9c89-8cf6295c07e5 req-3f8f25c3-7700-4341-9fe1-6824fa2c9cff service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1874d04a-b97a-4008-9c89-8cf6295c07e5 req-3f8f25c3-7700-4341-9fe1-6824fa2c9cff service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1874d04a-b97a-4008-9c89-8cf6295c07e5 req-3f8f25c3-7700-4341-9fe1-6824fa2c9cff service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:15 user nova-compute[75210]: DEBUG nova.compute.manager [req-1874d04a-b97a-4008-9c89-8cf6295c07e5 req-3f8f25c3-7700-4341-9fe1-6824fa2c9cff service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-unplugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:07:15 user nova-compute[75210]: WARNING nova.compute.manager [req-1874d04a-b97a-4008-9c89-8cf6295c07e5 req-3f8f25c3-7700-4341-9fe1-6824fa2c9cff service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-unplugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state rescued and task_state unrescuing.
Nov 29 02:07:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:15 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Instance destroyed successfully.
Nov 29 02:07:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:07:17 user nova-compute[75210]: WARNING nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state rescued and task_state unrescuing.
Nov 29 02:07:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-changed-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Refreshing instance network info cache due to event network-changed-24af94e3-44d6-4bd9-8dbb-ded94daa2b62. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Acquiring lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Acquired lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Refreshing network info cache for port 24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updated VIF entry in instance network info cache for port 24af94e3-44d6-4bd9-8dbb-ded94daa2b62. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updating instance_info_cache with network_info: [{"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Releasing lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-changed-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Refreshing instance network info cache due to event network-changed-24af94e3-44d6-4bd9-8dbb-ded94daa2b62. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Acquiring lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Acquired lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:07:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Refreshing network info cache for port 24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG nova.network.neutron [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updated VIF entry in instance network info cache for port 24af94e3-44d6-4bd9-8dbb-ded94daa2b62. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG nova.network.neutron [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updating instance_info_cache with network_info: [{"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Releasing lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:07:18 user nova-compute[75210]: WARNING nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state rescued and task_state unrescuing.
Nov 29 02:07:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:07:18 user nova-compute[75210]: WARNING nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state rescued and task_state unrescuing.
Nov 29 02:07:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-unplugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-unplugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:07:18 user nova-compute[75210]: WARNING nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-unplugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state rescued and task_state unrescuing.
Nov 29 02:07:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:07:18 user nova-compute[75210]: WARNING nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state rescued and task_state unrescuing.
Nov 29 02:07:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:07:18 user nova-compute[75210]: WARNING nova.compute.manager [req-8d9da51e-b2f0-4567-885d-fb27bccd7cd5 req-4aba4f6d-0684-4992-a60b-b30716bf5a26 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state rescued and task_state unrescuing.
Nov 29 02:07:19 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c579644b-74f1-4d40-afa0-d8b5c291a1f4 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:07:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-8260d23a-4ecb-4e8d-8a42-38a59f2cb425 req-176ecc84-b107-439a-a8f0-c49af5542acd service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8260d23a-4ecb-4e8d-8a42-38a59f2cb425 req-176ecc84-b107-439a-a8f0-c49af5542acd service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8260d23a-4ecb-4e8d-8a42-38a59f2cb425 req-176ecc84-b107-439a-a8f0-c49af5542acd service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8260d23a-4ecb-4e8d-8a42-38a59f2cb425 req-176ecc84-b107-439a-a8f0-c49af5542acd service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-8260d23a-4ecb-4e8d-8a42-38a59f2cb425 req-176ecc84-b107-439a-a8f0-c49af5542acd service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:07:19 user nova-compute[75210]: WARNING nova.compute.manager [req-8260d23a-4ecb-4e8d-8a42-38a59f2cb425 req-176ecc84-b107-439a-a8f0-c49af5542acd service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state active and task_state None.
Nov 29 02:07:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "86e93036-8370-46a9-bea4-48c43b372fb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "86e93036-8370-46a9-bea4-48c43b372fb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:22 user nova-compute[75210]: INFO nova.compute.manager [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Terminating instance
Nov 29 02:07:22 user nova-compute[75210]: DEBUG nova.compute.manager [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-7518fdf8-aabb-4a1d-a80e-9d124cff7ce9 req-e931a41b-44fd-494a-ade6-a1a2c1f6fb61 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Received event network-vif-unplugged-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7518fdf8-aabb-4a1d-a80e-9d124cff7ce9 req-e931a41b-44fd-494a-ade6-a1a2c1f6fb61 service nova] Acquiring lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7518fdf8-aabb-4a1d-a80e-9d124cff7ce9 req-e931a41b-44fd-494a-ade6-a1a2c1f6fb61 service nova] Lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7518fdf8-aabb-4a1d-a80e-9d124cff7ce9 req-e931a41b-44fd-494a-ade6-a1a2c1f6fb61 service nova] Lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-7518fdf8-aabb-4a1d-a80e-9d124cff7ce9 req-e931a41b-44fd-494a-ade6-a1a2c1f6fb61 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] No waiting events found dispatching network-vif-unplugged-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-7518fdf8-aabb-4a1d-a80e-9d124cff7ce9 req-e931a41b-44fd-494a-ade6-a1a2c1f6fb61 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Received event network-vif-unplugged-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:07:22 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Instance destroyed successfully.
Nov 29 02:07:22 user nova-compute[75210]: DEBUG nova.objects.instance [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lazy-loading 'resources' on Instance uuid 86e93036-8370-46a9-bea4-48c43b372fb3 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-401979044',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-401979044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4019790',id=44,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSpHuZJXdXhr7Wk5TcXjFvrE/jJmo+7Io085WxJ0D0x/+u7O0bc73LsuFaSMb/b1a+toh1nUxxrC+s2JjZwuoWAGaM67j8qkQcjawRLQFSlOmKXG9mgxTxdhvONwGUZzg==',key_name='tempest-keypair-2068651168',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:04:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e854d353630b499b84ffee7b89f1c7bf',ramdisk_id='',reservation_id='r-tsu23mw2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2042911204',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:04:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b3e05194fce4b2d865ca10a13e4d1da',uuid=86e93036-8370-46a9-bea4-48c43b372fb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "address": "fa:16:3e:68:f0:20", "network": {"id": "592e6292-5cff-47e9-a721-6d783a66ba5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2045737211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e854d353630b499b84ffee7b89f1c7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f36b7c3-43", "ovs_interfaceid": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Converting VIF {"id": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "address": "fa:16:3e:68:f0:20", "network": {"id": "592e6292-5cff-47e9-a721-6d783a66ba5a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2045737211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e854d353630b499b84ffee7b89f1c7bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f36b7c3-43", "ovs_interfaceid": "0f36b7c3-433c-4c8f-b14e-86a4f9a05c34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=0f36b7c3-433c-4c8f-b14e-86a4f9a05c34,network=Network(592e6292-5cff-47e9-a721-6d783a66ba5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f36b7c3-43') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG os_vif [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=0f36b7c3-433c-4c8f-b14e-86a4f9a05c34,network=Network(592e6292-5cff-47e9-a721-6d783a66ba5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f36b7c3-43') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f36b7c3-43, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28267efb-7f2f-437b-80de-36b680c5116b) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:07:22 user nova-compute[75210]: INFO os_vif [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:f0:20,bridge_name='br-int',has_traffic_filtering=True,id=0f36b7c3-433c-4c8f-b14e-86a4f9a05c34,network=Network(592e6292-5cff-47e9-a721-6d783a66ba5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f36b7c3-43')
Nov 29 02:07:22 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Deleting instance files /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3_del
Nov 29 02:07:22 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Deletion of /opt/stack/data/nova/instances/86e93036-8370-46a9-bea4-48c43b372fb3_del complete
Nov 29 02:07:22 user nova-compute[75210]: INFO nova.compute.manager [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 02:07:22 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:07:22 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:07:23 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:07:23 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Took 0.89 seconds to deallocate network for instance.
Nov 29 02:07:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e2e7ab8-8f68-4b76-a464-008abefe9aa7 req-c1bd25bf-4e93-4a56-b5a0-f22d63ac384c service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Received event network-vif-deleted-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:23 user nova-compute[75210]: INFO nova.compute.manager [req-8e2e7ab8-8f68-4b76-a464-008abefe9aa7 req-c1bd25bf-4e93-4a56-b5a0-f22d63ac384c service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Neutron deleted interface 0f36b7c3-433c-4c8f-b14e-86a4f9a05c34; detaching it from the instance and deleting it from the info cache
Nov 29 02:07:23 user nova-compute[75210]: DEBUG nova.network.neutron [req-8e2e7ab8-8f68-4b76-a464-008abefe9aa7 req-c1bd25bf-4e93-4a56-b5a0-f22d63ac384c service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:07:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e2e7ab8-8f68-4b76-a464-008abefe9aa7 req-c1bd25bf-4e93-4a56-b5a0-f22d63ac384c service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Detach interface failed, port_id=0f36b7c3-433c-4c8f-b14e-86a4f9a05c34, reason: Instance 86e93036-8370-46a9-bea4-48c43b372fb3 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 02:07:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:24 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:07:24 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:07:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:24 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Deleted allocations for instance 86e93036-8370-46a9-bea4-48c43b372fb3
Nov 29 02:07:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ecb03236-d38e-4050-af9e-a34d60ec7870 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204 tempest-TestServerVolumeAttachScenarioOldVersion-2042911204-project-member] Lock "86e93036-8370-46a9-bea4-48c43b372fb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.178s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-55aaa672-0da9-42ca-8a52-2cb46a133c1c req-d0e901d1-ba27-4757-be8b-da918e7e5067 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Received event network-vif-plugged-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-55aaa672-0da9-42ca-8a52-2cb46a133c1c req-d0e901d1-ba27-4757-be8b-da918e7e5067 service nova] Acquiring lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-55aaa672-0da9-42ca-8a52-2cb46a133c1c req-d0e901d1-ba27-4757-be8b-da918e7e5067 service nova] Lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-55aaa672-0da9-42ca-8a52-2cb46a133c1c req-d0e901d1-ba27-4757-be8b-da918e7e5067 service nova] Lock "86e93036-8370-46a9-bea4-48c43b372fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-55aaa672-0da9-42ca-8a52-2cb46a133c1c req-d0e901d1-ba27-4757-be8b-da918e7e5067 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] No waiting events found dispatching network-vif-plugged-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:07:24 user nova-compute[75210]: WARNING nova.compute.manager [req-55aaa672-0da9-42ca-8a52-2cb46a133c1c req-d0e901d1-ba27-4757-be8b-da918e7e5067 service nova] [instance: 86e93036-8370-46a9-bea4-48c43b372fb3] Received unexpected event network-vif-plugged-0f36b7c3-433c-4c8f-b14e-86a4f9a05c34 for instance with vm_state deleted and task_state None.
Nov 29 02:07:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-0ac4e2b4-08ed-4e2f-90b2-eb35eead6727 req-f5618822-81b6-4ec9-a177-caa9078342a0 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Received event network-changed-ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:07:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-0ac4e2b4-08ed-4e2f-90b2-eb35eead6727 req-f5618822-81b6-4ec9-a177-caa9078342a0 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Refreshing instance network info cache due to event network-changed-ab9a6b12-575e-4a8a-8fd8-8aa908140219. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:07:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0ac4e2b4-08ed-4e2f-90b2-eb35eead6727 req-f5618822-81b6-4ec9-a177-caa9078342a0 service nova] Acquiring lock "refresh_cache-01f7d4a1-2aec-4fca-a374-4a0554cfa838" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:07:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0ac4e2b4-08ed-4e2f-90b2-eb35eead6727 req-f5618822-81b6-4ec9-a177-caa9078342a0 service nova] Acquired lock "refresh_cache-01f7d4a1-2aec-4fca-a374-4a0554cfa838" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:07:34 user nova-compute[75210]: DEBUG nova.network.neutron [req-0ac4e2b4-08ed-4e2f-90b2-eb35eead6727 req-f5618822-81b6-4ec9-a177-caa9078342a0 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Refreshing network info cache for port ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:07:34 user nova-compute[75210]: DEBUG nova.network.neutron [req-0ac4e2b4-08ed-4e2f-90b2-eb35eead6727 req-f5618822-81b6-4ec9-a177-caa9078342a0 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Updated VIF entry in instance network info cache for port ab9a6b12-575e-4a8a-8fd8-8aa908140219. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:07:34 user nova-compute[75210]: DEBUG nova.network.neutron [req-0ac4e2b4-08ed-4e2f-90b2-eb35eead6727 req-f5618822-81b6-4ec9-a177-caa9078342a0 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Updating instance_info_cache with network_info: [{"id": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "address": "fa:16:3e:26:99:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9a6b12-57", "ovs_interfaceid": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:07:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0ac4e2b4-08ed-4e2f-90b2-eb35eead6727 req-f5618822-81b6-4ec9-a177-caa9078342a0 service nova] Releasing lock "refresh_cache-01f7d4a1-2aec-4fca-a374-4a0554cfa838" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:07:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:36 user nova-compute[75210]: DEBUG nova.objects.instance [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'flavor' on Instance uuid 01f7d4a1-2aec-4fca-a374-4a0554cfa838 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:07:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:36 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:36 user nova-compute[75210]: INFO nova.compute.manager [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Attaching volume a3534240-427c-4edb-9c90-042153ce9091 to /dev/vdb
Nov 29 02:07:36 user nova-compute[75210]: DEBUG os_brick.utils [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c997a32e-f8a1-4416-9b45-f0ba301a4bb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eff146-9881-4fe4-88f6-918775066c7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09cf0fc-9ffb-464a-886b-cd2f04d1414a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d5bcb3-e1b1-4d51-b375-4f8f4d5ba012]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:07:37 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:07:37 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[184ea089-c50e-40db-a637-4897354cb6cc]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG os_brick.utils [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Updating existing volume attachment record: 46e6f3ed-8f0b-4204-8b33-b3c33de3f7ff {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:07:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:40 user nova-compute[75210]: INFO nova.compute.manager [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Detaching volume 36d0d40d-1411-4019-af37-cb6154504220
Nov 29 02:07:40 user nova-compute[75210]: INFO nova.virt.block_device [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Attempting to driver detach volume 36d0d40d-1411-4019-af37-cb6154504220 from mountpoint /dev/vdc
Nov 29 02:07:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Attempting to detach device vdc from instance b9fabd34-7143-4b40-bca8-15b6d2bde253 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:07:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:07:40 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:07:40 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:07:40 user nova-compute[75210]:   <target dev="vdc" bus="virtio"/>
Nov 29 02:07:40 user nova-compute[75210]:   <serial>36d0d40d-1411-4019-af37-cb6154504220</serial>
Nov 29 02:07:40 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 02:07:40 user nova-compute[75210]: </disk>
Nov 29 02:07:40 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:07:40 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Successfully detached device vdc from instance b9fabd34-7143-4b40-bca8-15b6d2bde253 from the persistent domain config.
Nov 29 02:07:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b9fabd34-7143-4b40-bca8-15b6d2bde253 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:07:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:07:40 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:07:40 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:07:40 user nova-compute[75210]:   <target dev="vdc" bus="virtio"/>
Nov 29 02:07:40 user nova-compute[75210]:   <serial>36d0d40d-1411-4019-af37-cb6154504220</serial>
Nov 29 02:07:40 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 02:07:40 user nova-compute[75210]: </disk>
Nov 29 02:07:40 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:07:41 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b9fabd34-7143-4b40-bca8-15b6d2bde253 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:07:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:07:42 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:07:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:07:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:07:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:07:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:07:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:07:43 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:07:43 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updating instance_info_cache with network_info: [{"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkCcmbsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:07:44 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:07:44 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:07:44 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[41444d26-4593-4d23-acb7-161e36252c61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:07:44 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75d0e18-19eb-4e3d-995f-b85bdec360cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091] added
Nov 29 02:07:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82be35f-1c52-43db-a826-8f738906d501]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[47321293-507a-4c52-87a0-f1170812f17e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkCcmbsx {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nkCcmbsx" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5871ea41-79f0-490a-baef-2afaccc3dfac]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nkCcmbsx'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2639ea59-5aa9-44a6-ac5b-a62c92dccc19]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9aac75-0f71-4924-87ce-85590ff464a2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bf3464-ed58-483a-bca5-55025e14964d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091, portal: 172.16.0.220,3260]
Nov 29 02:07:44 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091, portal: 172.16.0.220,3260] successful.
Nov 29 02:07:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e5551c-62fc-4c46-a604-9308f26d28ba]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee6fd23-8266-4a33-ad83-183599308e01]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)
Nov 29 02:07:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] HCTL ('36', '-', '-', 0) found on session 55 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e37c6f-b53d-48b2-b03d-dcafe838cbc1]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching for a device in session 55 and hctl ['36', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:07:45 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:07:45 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching for a device in session 55 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:07:45 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkCcmbsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:07:45 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:07:45 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23332376262393634', 'path': '/dev/sde'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:07:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332376262393634', 'path': '/dev/sde'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:07:45 user nova-compute[75210]: DEBUG nova.objects.instance [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'flavor' on Instance uuid 01f7d4a1-2aec-4fca-a374-4a0554cfa838 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:07:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 02:07:45 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:07:45 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 02:07:45 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:07:45 user nova-compute[75210]:   <serial>a3534240-427c-4edb-9c90-042153ce9091</serial>
Nov 29 02:07:45 user nova-compute[75210]: </disk>
Nov 29 02:07:45 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 02:07:46 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:07:46 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:07:46 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No VIF found with MAC fa:16:3e:26:99:90, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:07:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8568e4f7-1db9-41f0-9de5-d2e32485945e tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.276s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:07:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:07:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:07:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:47 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:47 user nova-compute[75210]: INFO nova.compute.manager [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Detaching volume aacbbd71-3d67-40ae-9a3c-008f778e3e32
Nov 29 02:07:47 user nova-compute[75210]: INFO nova.virt.block_device [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Attempting to driver detach volume aacbbd71-3d67-40ae-9a3c-008f778e3e32 from mountpoint /dev/vdb
Nov 29 02:07:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Attempting to detach device vdb from instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:07:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:07:47 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:07:47 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 02:07:47 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:07:47 user nova-compute[75210]:   <serial>aacbbd71-3d67-40ae-9a3c-008f778e3e32</serial>
Nov 29 02:07:47 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:07:47 user nova-compute[75210]: </disk>
Nov 29 02:07:47 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:07:47 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Successfully detached device vdb from instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 from the persistent domain config.
Nov 29 02:07:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:07:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:07:47 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:07:47 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 02:07:47 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:07:47 user nova-compute[75210]:   <serial>aacbbd71-3d67-40ae-9a3c-008f778e3e32</serial>
Nov 29 02:07:47 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:07:47 user nova-compute[75210]: </disk>
Nov 29 02:07:47 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:07:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'flavor' on Instance uuid 01f7d4a1-2aec-4fca-a374-4a0554cfa838 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:50 user nova-compute[75210]: INFO nova.compute.manager [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Attaching volume be5c6176-4a23-4428-93cb-1b809ad84ac0 to /dev/vdc
Nov 29 02:07:50 user nova-compute[75210]: DEBUG os_brick.utils [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dd6f87-c9b0-4c77-b4b4-6b68cdbdb446]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eefefd3-cc9e-4a1e-892d-c5d78fbe60aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[93347c3f-b35e-472e-bcfb-3ab43d54358e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97fd02c-8cee-444c-bfe0-580cb4fd70c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:07:50 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:07:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0186050-ea46-4d35-9efa-9bd9fb4f3c3f]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG os_brick.utils [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:07:50 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Updating existing volume attachment record: 56dfef22-f138-462b-81d3-dc77f2677a92 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:07:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:07:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:52 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:07:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:07:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:07:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:52 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:07:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:54 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:07:54 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8391MB free_disk=25.028587341308594GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance b9fabd34-7143-4b40-bca8-15b6d2bde253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing inventories for resource provider 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating ProviderTree inventory for provider 28871a06-d5c8-43d0-87af-3689cd143011 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating inventory in ProviderTree for provider 28871a06-d5c8-43d0-87af-3689cd143011 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing aggregate associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, aggregates: None {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing trait associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, traits: HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:07:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:07:56 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:07:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances with incomplete migration  {{(pid=75210) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 02:07:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:07:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:07:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkAYgLnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:07:57 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:07:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:07:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:07:57 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:07:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:07:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:07:57 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:07:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[42165b77-5d8e-48f5-b8be-c3372ba4114f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:07:57 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5d7ed4-ba2d-4373-90b3-7e400db5122d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0] added
Nov 29 02:07:57 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d60f53-337a-4f7b-8e13-f2443f59689f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca46f953-47f9-4290-9757-64a46c387849]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkAYgLnE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkAYgLnE" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[31888ce8-8657-42df-b89c-5629a532b16f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CkAYgLnE'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b7ee20-24cf-4ef4-9aaf-2d62952d09c4]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f383b686-53f6-4b50-802b-34c353497ddb]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56eab36-f7cf-4403-b4b2-4a2ae041b683]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0, portal: 172.16.0.220,3260]
Nov 29 02:07:58 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0, portal: 172.16.0.220,3260] successful.
Nov 29 02:07:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7961fda6-c418-4566-905f-4864464a9701]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b153a3ff-ea0a-469c-a2e8-37c737f81a06]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)
Nov 29 02:07:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] HCTL ('37', '-', '-', 0) found on session 56 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4b231f-e998-4a16-bbbf-4d8db2b191e2]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Searching for a device in session 56 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:07:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkAYgLnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:07:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:07:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23664643866636235', 'path': '/dev/sdf'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:07:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664643866636235', 'path': '/dev/sdf'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:07:59 user nova-compute[75210]: DEBUG nova.objects.instance [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'flavor' on Instance uuid 01f7d4a1-2aec-4fca-a374-4a0554cfa838 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:07:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 02:07:59 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:07:59 user nova-compute[75210]:   <source dev="/dev/sdf"/>
Nov 29 02:07:59 user nova-compute[75210]:   <target dev="vdc" bus="virtio"/>
Nov 29 02:07:59 user nova-compute[75210]:   <serial>be5c6176-4a23-4428-93cb-1b809ad84ac0</serial>
Nov 29 02:07:59 user nova-compute[75210]: </disk>
Nov 29 02:07:59 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 02:07:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:07:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:07:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:07:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] No VIF found with MAC fa:16:3e:26:99:90, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:07:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-76d5de5f-e6d8-498b-9613-8d0773264052 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.268s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:00 user nova-compute[75210]: INFO nova.compute.manager [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Detaching volume a3534240-427c-4edb-9c90-042153ce9091
Nov 29 02:08:00 user nova-compute[75210]: INFO nova.virt.block_device [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Attempting to driver detach volume a3534240-427c-4edb-9c90-042153ce9091 from mountpoint /dev/vdb
Nov 29 02:08:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Attempting to detach device vdb from instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:08:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:08:00 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:08:00 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 02:08:00 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:08:00 user nova-compute[75210]:   <serial>a3534240-427c-4edb-9c90-042153ce9091</serial>
Nov 29 02:08:00 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:08:00 user nova-compute[75210]: </disk>
Nov 29 02:08:00 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:08:00 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully detached device vdb from instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 from the persistent domain config.
Nov 29 02:08:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:08:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:08:00 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:08:00 user nova-compute[75210]:   <source dev="/dev/sde"/>
Nov 29 02:08:00 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:08:00 user nova-compute[75210]:   <serial>a3534240-427c-4edb-9c90-042153ce9091</serial>
Nov 29 02:08:00 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:08:00 user nova-compute[75210]: </disk>
Nov 29 02:08:00 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:08:01 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance b9fabd34-7143-4b40-bca8-15b6d2bde253 is timed out.
Nov 29 02:08:01 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Successfully detached device vdc from instance b9fabd34-7143-4b40-bca8-15b6d2bde253 from the live domain config.
Nov 29 02:08:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eKPyBtjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:08:01 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b77209-b89f-4069-af19-74ac47ff5dc7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:08:01 user nova-compute[75210]: No targets found.
Nov 29 02:08:01 user nova-compute[75210]: iSNS:
Nov 29 02:08:01 user nova-compute[75210]: No targets found.
Nov 29 02:08:01 user nova-compute[75210]: STATIC:
Nov 29 02:08:01 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091
Nov 29 02:08:01 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:01 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:01 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220
Nov 29 02:08:01 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:01 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:01 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18
Nov 29 02:08:01 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:01 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:01 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32
Nov 29 02:08:01 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:01 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:01 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0
Nov 29 02:08:01 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:01 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:01 user nova-compute[75210]: FIRMWARE:
Nov 29 02:08:01 user nova-compute[75210]: No targets found.
Nov 29 02:08:01 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:08:01 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:08:01 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[007a1cc2-1252-471e-b9a4-eb502dcec80a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[09762e59-2468-41da-ae6b-bf08e76e7fcb]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:08:01 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:08:01 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:08:01 user nova-compute[75210]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)
Nov 29 02:08:01 user nova-compute[75210]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)
Nov 29 02:08:01 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:08:01 user nova-compute[75210]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 (non-flash)
Nov 29 02:08:01 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:08:01 user nova-compute[75210]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)
Nov 29 02:08:01 user nova-compute[75210]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)
Nov 29 02:08:01 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4e5dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95c0e38-421c-428f-8d2f-809efbf9d3a5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eef507c-e688-47bc-a8f1-70b00d30ff5c]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b6f2d2-ff35-4d33-9ae3-eafc11aa1584]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b8967b-bad9-43c8-a3b8-3c9a0f77ebfa]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5af69e4-0f25-4804-878a-5b2b20a6b595]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7375974-659f-4096-bcba-38da12a396f0]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220, portal: 172.16.0.220,3260]
Nov 29 02:08:01 user nova-compute[75210]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220, portal: 172.16.0.220,3260] successful.
Nov 29 02:08:01 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d0d40d-1411-4019-af37-cb6154504220 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4b6442-aae1-4209-a50d-e94249949b43]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] <== disconnect_volume: return (335ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:08:01 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:08:02 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'flavor' on Instance uuid b9fabd34-7143-4b40-bca8-15b6d2bde253 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:08:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c19939c6-9434-49c3-bd9c-ec6374ae467b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.701s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:05 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:08:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 02:08:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] There are 0 instances to clean {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 02:08:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:08 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 is timed out.
Nov 29 02:08:08 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Successfully detached device vdb from instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 from the live domain config.
Nov 29 02:08:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RdYrTybo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:08:08 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:08:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5d0987-28f9-4bb6-af26-c6f5d1fe058d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:08:08 user nova-compute[75210]: No targets found.
Nov 29 02:08:08 user nova-compute[75210]: iSNS:
Nov 29 02:08:08 user nova-compute[75210]: No targets found.
Nov 29 02:08:08 user nova-compute[75210]: STATIC:
Nov 29 02:08:08 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091
Nov 29 02:08:08 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:08 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:08 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18
Nov 29 02:08:08 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:08 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:08 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32
Nov 29 02:08:08 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:08 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:08 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0
Nov 29 02:08:08 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:08 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:08 user nova-compute[75210]: FIRMWARE:
Nov 29 02:08:08 user nova-compute[75210]: No targets found.
Nov 29 02:08:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:08:08 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:08:08 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f5d119-6683-4b92-b78a-192d44a51e51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[521e8f90-e8d4-4b03-90ba-cf39458ddc93]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:08:08 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:08:08 user nova-compute[75210]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)
Nov 29 02:08:08 user nova-compute[75210]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)
Nov 29 02:08:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 (non-flash)
Nov 29 02:08:08 user nova-compute[75210]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:08:08 user nova-compute[75210]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)
Nov 29 02:08:08 user nova-compute[75210]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)
Nov 29 02:08:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e870b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3303d5a6-0863-46be-ad5e-1d3871fd68f4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2765e5-a6a3-4976-9ba5-6d05e19ea552]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ead79e-14a7-404f-b92e-a059c6dcf136]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc46e1b9-91f4-4c90-8669-a5de2c78b006]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d7974-65eb-42e6-b1f6-32e82246f89f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6609997d-89d1-4b8f-a615-bc94cea7a674]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32, portal: 172.16.0.220,3260]
Nov 29 02:08:09 user nova-compute[75210]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32, portal: 172.16.0.220,3260] successful.
Nov 29 02:08:09 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aacbbd71-3d67-40ae-9a3c-008f778e3e32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[48be0d18-90b2-499e-a02d-9286c8990e4e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] <== disconnect_volume: return (296ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:08:09 user nova-compute[75210]: DEBUG nova.objects.instance [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lazy-loading 'flavor' on Instance uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:08:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-ac36d48a-d31c-44ce-a131-1b948b55c932 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.366s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:21 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 is timed out.
Nov 29 02:08:21 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully detached device vdb from instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 from the live domain config.
Nov 29 02:08:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nkCcmbsx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:08:21 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fab731d-000e-4ae0-a956-3199cb95ff53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:08:21 user nova-compute[75210]: No targets found.
Nov 29 02:08:21 user nova-compute[75210]: iSNS:
Nov 29 02:08:21 user nova-compute[75210]: No targets found.
Nov 29 02:08:21 user nova-compute[75210]: STATIC:
Nov 29 02:08:21 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091
Nov 29 02:08:21 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:21 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:21 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18
Nov 29 02:08:21 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:21 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:21 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0
Nov 29 02:08:21 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:21 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:21 user nova-compute[75210]: FIRMWARE:
Nov 29 02:08:21 user nova-compute[75210]: No targets found.
Nov 29 02:08:21 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:08:21 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:08:21 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[af311d38-171b-41c5-b811-8fb664c9308e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae02b03-3774-46d4-ac24-682640d6f423]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:08:21 user nova-compute[75210]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)
Nov 29 02:08:21 user nova-compute[75210]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)
Nov 29 02:08:21 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:08:21 user nova-compute[75210]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 (non-flash)
Nov 29 02:08:21 user nova-compute[75210]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)
Nov 29 02:08:21 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e870add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091'): ({'sde'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Removing single pathed devices sde {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.047s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e154f822-d435-4fea-9132-146e60e9b8a4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9f7453-681c-45d0-a23f-4ec2d4a87ab4]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Flushing IO for device /dev/sde {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b28875-b889-459d-b7d2-dbe7524a5783]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeec5d8-6ba3-4c9b-a88b-757cae79cb23]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] SCSI volumes sde have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c220fdde-e945-4dee-b350-ec151ad1f8e0]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[433fca3e-80c9-4696-9f98-3e30513ec8a9]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091, portal: 172.16.0.220,3260]
Nov 29 02:08:21 user nova-compute[75210]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091, portal: 172.16.0.220,3260] successful.
Nov 29 02:08:21 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3534240-427c-4edb-9c90-042153ce9091 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a927ac-a17d-4efa-9744-6a31cb11d76d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] <== disconnect_volume: return (309ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:08:21 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:08:22 user nova-compute[75210]: DEBUG nova.objects.instance [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'flavor' on Instance uuid 01f7d4a1-2aec-4fca-a374-4a0554cfa838 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:08:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-83bbc820-affe-447d-b511-8873c13a83d7 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:23 user nova-compute[75210]: INFO nova.compute.manager [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Detaching volume be5c6176-4a23-4428-93cb-1b809ad84ac0
Nov 29 02:08:23 user nova-compute[75210]: INFO nova.virt.block_device [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Attempting to driver detach volume be5c6176-4a23-4428-93cb-1b809ad84ac0 from mountpoint /dev/vdc
Nov 29 02:08:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Attempting to detach device vdc from instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:08:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:08:23 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:08:23 user nova-compute[75210]:   <source dev="/dev/sdf"/>
Nov 29 02:08:23 user nova-compute[75210]:   <target dev="vdc" bus="virtio"/>
Nov 29 02:08:23 user nova-compute[75210]:   <serial>be5c6176-4a23-4428-93cb-1b809ad84ac0</serial>
Nov 29 02:08:23 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 02:08:23 user nova-compute[75210]: </disk>
Nov 29 02:08:23 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:08:23 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully detached device vdc from instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 from the persistent domain config.
Nov 29 02:08:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:08:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:08:23 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:08:23 user nova-compute[75210]:   <source dev="/dev/sdf"/>
Nov 29 02:08:23 user nova-compute[75210]:   <target dev="vdc" bus="virtio"/>
Nov 29 02:08:23 user nova-compute[75210]:   <serial>be5c6176-4a23-4428-93cb-1b809ad84ac0</serial>
Nov 29 02:08:23 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 29 02:08:23 user nova-compute[75210]: </disk>
Nov 29 02:08:23 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:08:24 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:08:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:31 user nova-compute[75210]: INFO nova.compute.manager [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Terminating instance
Nov 29 02:08:31 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-bdf95be0-ac32-44af-8724-ce79810ef4a6 req-17bb5f18-34b3-4e75-95b2-a8328bb8477d service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-vif-unplugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bdf95be0-ac32-44af-8724-ce79810ef4a6 req-17bb5f18-34b3-4e75-95b2-a8328bb8477d service nova] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bdf95be0-ac32-44af-8724-ce79810ef4a6 req-17bb5f18-34b3-4e75-95b2-a8328bb8477d service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bdf95be0-ac32-44af-8724-ce79810ef4a6 req-17bb5f18-34b3-4e75-95b2-a8328bb8477d service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-bdf95be0-ac32-44af-8724-ce79810ef4a6 req-17bb5f18-34b3-4e75-95b2-a8328bb8477d service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] No waiting events found dispatching network-vif-unplugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:08:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-bdf95be0-ac32-44af-8724-ce79810ef4a6 req-17bb5f18-34b3-4e75-95b2-a8328bb8477d service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-vif-unplugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:08:31 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Instance destroyed successfully.
Nov 29 02:08:31 user nova-compute[75210]: DEBUG nova.objects.instance [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'resources' on Instance uuid b9fabd34-7143-4b40-bca8-15b6d2bde253 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T02:02:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1647236808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1647236808',id=42,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdVWiwc5/SKu6fnoi3dYT1LiowcWPktBHEWHutt6M7BjBMCEx/7qjI8dA26d5mga/+5Ur17Ya2Iw/PaVNqxoVhIUUQMZFzVL8AOmpHosZ7kB+Ok5bzb5xIphm/Xt4BzHQ==',key_name='tempest-keypair-785264678',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:06:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55934a4b47ab45a4a7f389919225c156',ramdisk_id='',reservation_id='r-ygxad600',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2088736241',owner_user_name='tempest-AttachVolumeShelveTestJSON-2088736241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:06:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f7a67a01104567b3e96f9d150dddd2',uuid=b9fabd34-7143-4b40-bca8-15b6d2bde253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converting VIF {"id": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "address": "fa:16:3e:16:a1:c9", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.71", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f0dfb9d-2c", "ovs_interfaceid": "6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG os_vif [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f0dfb9d-2c, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1df271ee-717b-45b0-a704-6e2b6a6a397e) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:32 user nova-compute[75210]: INFO os_vif [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a1:c9,bridge_name='br-int',has_traffic_filtering=True,id=6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f0dfb9d-2c')
Nov 29 02:08:32 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Deleting instance files /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253_del
Nov 29 02:08:32 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Deletion of /opt/stack/data/nova/instances/b9fabd34-7143-4b40-bca8-15b6d2bde253_del complete
Nov 29 02:08:32 user nova-compute[75210]: INFO nova.compute.manager [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 29 02:08:32 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:08:32 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Took 0.69 seconds to deallocate network for instance.
Nov 29 02:08:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:33 user nova-compute[75210]: DEBUG nova.compute.manager [req-5c02e0fb-ec84-48a9-ae39-2607dbab6a63 req-a8b688e3-e11b-4c11-835c-7cc869dfe785 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-vif-deleted-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:08:33 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:08:33 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:08:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:33 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Deleted allocations for instance b9fabd34-7143-4b40-bca8-15b6d2bde253
Nov 29 02:08:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e2fc205e-96cd-422c-a587-96f34ed593db tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.111s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-d4bf7fd9-1f02-49cd-9e39-cb3de1704e44 req-76b0e70a-7066-4c5e-a3c2-053507aeffe9 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received event network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:08:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d4bf7fd9-1f02-49cd-9e39-cb3de1704e44 req-76b0e70a-7066-4c5e-a3c2-053507aeffe9 service nova] Acquiring lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d4bf7fd9-1f02-49cd-9e39-cb3de1704e44 req-76b0e70a-7066-4c5e-a3c2-053507aeffe9 service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:34 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d4bf7fd9-1f02-49cd-9e39-cb3de1704e44 req-76b0e70a-7066-4c5e-a3c2-053507aeffe9 service nova] Lock "b9fabd34-7143-4b40-bca8-15b6d2bde253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:34 user nova-compute[75210]: DEBUG nova.compute.manager [req-d4bf7fd9-1f02-49cd-9e39-cb3de1704e44 req-76b0e70a-7066-4c5e-a3c2-053507aeffe9 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] No waiting events found dispatching network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:08:34 user nova-compute[75210]: WARNING nova.compute.manager [req-d4bf7fd9-1f02-49cd-9e39-cb3de1704e44 req-76b0e70a-7066-4c5e-a3c2-053507aeffe9 service nova] [instance: b9fabd34-7143-4b40-bca8-15b6d2bde253] Received unexpected event network-vif-plugged-6f0dfb9d-2c07-4665-a09f-30b25eb5e4f7 for instance with vm_state deleted and task_state None.
Nov 29 02:08:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:38 user nova-compute[75210]: INFO nova.compute.manager [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Terminating instance
Nov 29 02:08:38 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-be84306e-c3f3-4a22-a055-3cfe2097041b req-30e346a6-b72f-4149-b529-6027442b1e6e service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-unplugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be84306e-c3f3-4a22-a055-3cfe2097041b req-30e346a6-b72f-4149-b529-6027442b1e6e service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be84306e-c3f3-4a22-a055-3cfe2097041b req-30e346a6-b72f-4149-b529-6027442b1e6e service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-be84306e-c3f3-4a22-a055-3cfe2097041b req-30e346a6-b72f-4149-b529-6027442b1e6e service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-be84306e-c3f3-4a22-a055-3cfe2097041b req-30e346a6-b72f-4149-b529-6027442b1e6e service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-unplugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:08:38 user nova-compute[75210]: DEBUG nova.compute.manager [req-be84306e-c3f3-4a22-a055-3cfe2097041b req-30e346a6-b72f-4149-b529-6027442b1e6e service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-unplugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:08:39 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Instance destroyed successfully.
Nov 29 02:08:39 user nova-compute[75210]: DEBUG nova.objects.instance [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lazy-loading 'resources' on Instance uuid cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1135885355',display_name='tempest-ServerStableDeviceRescueTest-server-1135885355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1135885355',id=41,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPSG3qE+VgrQNXmELqi5qSXBwBzUp8vZZBB9/REK7ixhkyDD6falVEmw2R1+zJ071dQTIbR39IgcId6lzef4D9VzKYNeqf+7J8rcwF1girVO8dNsvkXLI7BMPoX9/gWEQ==',key_name='tempest-keypair-376857331',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:05:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de78c813716a4a3fa74e92b498e9ed2e',ramdisk_id='',reservation_id='r-w40b89pl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-515826915',owner_user_name='tempest-ServerStableDeviceRescueTest-515826915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:07:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a388bda7f1454c898a458fc7aa276a1c',uuid=cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Converting VIF {"id": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "address": "fa:16:3e:88:3c:bd", "network": {"id": "7a102cdd-460e-4998-aae7-f6d0237ed234", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1676597302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de78c813716a4a3fa74e92b498e9ed2e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24af94e3-44", "ovs_interfaceid": "24af94e3-44d6-4bd9-8dbb-ded94daa2b62", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:3c:bd,bridge_name='br-int',has_traffic_filtering=True,id=24af94e3-44d6-4bd9-8dbb-ded94daa2b62,network=Network(7a102cdd-460e-4998-aae7-f6d0237ed234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24af94e3-44') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG os_vif [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:3c:bd,bridge_name='br-int',has_traffic_filtering=True,id=24af94e3-44d6-4bd9-8dbb-ded94daa2b62,network=Network(7a102cdd-460e-4998-aae7-f6d0237ed234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24af94e3-44') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24af94e3-44, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a2a8d8b-99d3-4c84-bfe3-970573594341) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:39 user nova-compute[75210]: INFO os_vif [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:3c:bd,bridge_name='br-int',has_traffic_filtering=True,id=24af94e3-44d6-4bd9-8dbb-ded94daa2b62,network=Network(7a102cdd-460e-4998-aae7-f6d0237ed234),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24af94e3-44')
Nov 29 02:08:39 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Deleting instance files /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6_del
Nov 29 02:08:39 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Deletion of /opt/stack/data/nova/instances/cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6_del complete
Nov 29 02:08:39 user nova-compute[75210]: INFO nova.compute.manager [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 02:08:39 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:08:39 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Took 0.70 seconds to deallocate network for instance.
Nov 29 02:08:39 user nova-compute[75210]: DEBUG nova.compute.manager [req-7af999df-a221-40e0-8bdb-2bf7f5a407b5 req-4e864c1c-4340-49a0-9861-0e765ea8b5b6 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-deleted-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:08:39 user nova-compute[75210]: INFO nova.compute.manager [req-7af999df-a221-40e0-8bdb-2bf7f5a407b5 req-4e864c1c-4340-49a0-9861-0e765ea8b5b6 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Neutron deleted interface 24af94e3-44d6-4bd9-8dbb-ded94daa2b62; detaching it from the instance and deleting it from the info cache
Nov 29 02:08:39 user nova-compute[75210]: DEBUG nova.network.neutron [req-7af999df-a221-40e0-8bdb-2bf7f5a407b5 req-4e864c1c-4340-49a0-9861-0e765ea8b5b6 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:08:39 user nova-compute[75210]: DEBUG nova.compute.manager [req-7af999df-a221-40e0-8bdb-2bf7f5a407b5 req-4e864c1c-4340-49a0-9861-0e765ea8b5b6 service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Detach interface failed, port_id=24af94e3-44d6-4bd9-8dbb-ded94daa2b62, reason: Instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 02:08:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:40 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:08:40 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:08:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:40 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Deleted allocations for instance cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6
Nov 29 02:08:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5171b8b9-a9aa-4aac-961c-8e422dcf1029 tempest-ServerStableDeviceRescueTest-515826915 tempest-ServerStableDeviceRescueTest-515826915-project-member] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.986s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:40 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:08:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-dbe7df1e-2d0e-4ba7-8847-86576e048a8a req-e398a4d8-c230-4aca-a0a7-91abe285bd3e service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:08:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dbe7df1e-2d0e-4ba7-8847-86576e048a8a req-e398a4d8-c230-4aca-a0a7-91abe285bd3e service nova] Acquiring lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dbe7df1e-2d0e-4ba7-8847-86576e048a8a req-e398a4d8-c230-4aca-a0a7-91abe285bd3e service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dbe7df1e-2d0e-4ba7-8847-86576e048a8a req-e398a4d8-c230-4aca-a0a7-91abe285bd3e service nova] Lock "cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:40 user nova-compute[75210]: DEBUG nova.compute.manager [req-dbe7df1e-2d0e-4ba7-8847-86576e048a8a req-e398a4d8-c230-4aca-a0a7-91abe285bd3e service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] No waiting events found dispatching network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:08:40 user nova-compute[75210]: WARNING nova.compute.manager [req-dbe7df1e-2d0e-4ba7-8847-86576e048a8a req-e398a4d8-c230-4aca-a0a7-91abe285bd3e service nova] [instance: cf6c6e94-6aaf-4b0c-8b47-0598ec0841e6] Received unexpected event network-vif-plugged-24af94e3-44d6-4bd9-8dbb-ded94daa2b62 for instance with vm_state deleted and task_state None.
Nov 29 02:08:41 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:08:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-efc0616b-e21a-4b5b-84f2-6b9932149954 req-3c4a64a1-ddbc-4e76-9033-97aaa7a1d5ef service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Received event network-changed-57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:08:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-efc0616b-e21a-4b5b-84f2-6b9932149954 req-3c4a64a1-ddbc-4e76-9033-97aaa7a1d5ef service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Refreshing instance network info cache due to event network-changed-57a63d91-cd0f-42a7-ac0f-d29e291ee465. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:08:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-efc0616b-e21a-4b5b-84f2-6b9932149954 req-3c4a64a1-ddbc-4e76-9033-97aaa7a1d5ef service nova] Acquiring lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:08:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-efc0616b-e21a-4b5b-84f2-6b9932149954 req-3c4a64a1-ddbc-4e76-9033-97aaa7a1d5ef service nova] Acquired lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:08:42 user nova-compute[75210]: DEBUG nova.network.neutron [req-efc0616b-e21a-4b5b-84f2-6b9932149954 req-3c4a64a1-ddbc-4e76-9033-97aaa7a1d5ef service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Refreshing network info cache for port 57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:08:42 user nova-compute[75210]: DEBUG nova.network.neutron [req-efc0616b-e21a-4b5b-84f2-6b9932149954 req-3c4a64a1-ddbc-4e76-9033-97aaa7a1d5ef service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Updated VIF entry in instance network info cache for port 57a63d91-cd0f-42a7-ac0f-d29e291ee465. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:08:42 user nova-compute[75210]: DEBUG nova.network.neutron [req-efc0616b-e21a-4b5b-84f2-6b9932149954 req-3c4a64a1-ddbc-4e76-9033-97aaa7a1d5ef service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Updating instance_info_cache with network_info: [{"id": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "address": "fa:16:3e:0b:6e:84", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a63d91-cd", "ovs_interfaceid": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:08:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-efc0616b-e21a-4b5b-84f2-6b9932149954 req-3c4a64a1-ddbc-4e76-9033-97aaa7a1d5ef service nova] Releasing lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:08:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:08:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:08:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:08:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-01f7d4a1-2aec-4fca-a374-4a0554cfa838" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:08:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-01f7d4a1-2aec-4fca-a374-4a0554cfa838" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:08:43 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:08:44 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 is timed out.
Nov 29 02:08:44 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully detached device vdc from instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838 from the live domain config.
Nov 29 02:08:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkAYgLnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:08:44 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1fc9f3-4522-4a3f-a685-537bdb66f85d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:08:44 user nova-compute[75210]: No targets found.
Nov 29 02:08:44 user nova-compute[75210]: iSNS:
Nov 29 02:08:44 user nova-compute[75210]: No targets found.
Nov 29 02:08:44 user nova-compute[75210]: STATIC:
Nov 29 02:08:44 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18
Nov 29 02:08:44 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:44 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:44 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0
Nov 29 02:08:44 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:08:44 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:08:44 user nova-compute[75210]: FIRMWARE:
Nov 29 02:08:44 user nova-compute[75210]: No targets found.
Nov 29 02:08:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:08:44 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:08:44 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3199e75c-9c09-418a-8bb5-8033addc36ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[685a46e8-2342-47ff-8be5-13a666a7af31]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:08:44 user nova-compute[75210]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)
Nov 29 02:08:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:08:44 user nova-compute[75210]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 (non-flash)
Nov 29 02:08:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4d60e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0'): ({'sdf'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Removing single pathed devices sdf {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d70ebe4-f0b7-44c0-a7ab-7ad1c15d39ab]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c2848d-f717-4f1d-b3f2-69be080f053b]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Flushing IO for device /dev/sdf {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0a8bee-57ee-4708-b8a3-71b4b6c69ce8]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9198c704-229c-466f-a7f0-bd5e683f5108]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] SCSI volumes sdf have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17d9e9e-b54c-4e03-9fa8-95fa85d4a680]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Updating instance_info_cache with network_info: [{"id": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "address": "fa:16:3e:26:99:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9a6b12-57", "ovs_interfaceid": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-01f7d4a1-2aec-4fca-a374-4a0554cfa838" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[541cb529-ecd2-4647-a9fe-a20f6b623182]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0, portal: 172.16.0.220,3260]
Nov 29 02:08:44 user nova-compute[75210]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0, portal: 172.16.0.220,3260] successful.
Nov 29 02:08:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5c6176-4a23-4428-93cb-1b809ad84ac0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c077b5c-b9d0-4d9d-8c24-facc735eab7b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] <== disconnect_volume: return (298ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:08:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:08:45 user nova-compute[75210]: DEBUG nova.objects.instance [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'flavor' on Instance uuid 01f7d4a1-2aec-4fca-a374-4a0554cfa838 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:08:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-17422080-2522-4857-9a67-426a74750943 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.727s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:46 user nova-compute[75210]: INFO nova.compute.manager [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Terminating instance
Nov 29 02:08:46 user nova-compute[75210]: DEBUG nova.compute.manager [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-00d28fc5-a35c-436f-ade9-0449b09f474e req-11d88a0e-535f-42ba-b598-7911094c3efe service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Received event network-vif-unplugged-ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-00d28fc5-a35c-436f-ade9-0449b09f474e req-11d88a0e-535f-42ba-b598-7911094c3efe service nova] Acquiring lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-00d28fc5-a35c-436f-ade9-0449b09f474e req-11d88a0e-535f-42ba-b598-7911094c3efe service nova] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-00d28fc5-a35c-436f-ade9-0449b09f474e req-11d88a0e-535f-42ba-b598-7911094c3efe service nova] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-00d28fc5-a35c-436f-ade9-0449b09f474e req-11d88a0e-535f-42ba-b598-7911094c3efe service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] No waiting events found dispatching network-vif-unplugged-ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:08:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-00d28fc5-a35c-436f-ade9-0449b09f474e req-11d88a0e-535f-42ba-b598-7911094c3efe service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Received event network-vif-unplugged-ab9a6b12-575e-4a8a-8fd8-8aa908140219 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:08:47 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Instance destroyed successfully.
Nov 29 02:08:47 user nova-compute[75210]: DEBUG nova.objects.instance [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lazy-loading 'resources' on Instance uuid 01f7d4a1-2aec-4fca-a374-4a0554cfa838 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1414050662',display_name='tempest-AttachVolumeTestJSON-server-1414050662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1414050662',id=45,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnJEpIhGEUtzspNudloUDCqPdfW9cYZ2sQlzVx9tGUt/0scbS1iKZfEcu2ljSQv3C5J4amLs1qUmSdg9EDaH/uyEqSH7wkYN/aN65iQBsd4njMlhqQFcrheRR5tIujZFg==',key_name='tempest-keypair-1543632751',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:05:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64aac75090884257a9c33f94ec9aa367',ramdisk_id='',reservation_id='r-yw0ada9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-91454133',owner_user_name='tempest-AttachVolumeTestJSON-91454133-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ee2d9a0f7574bad97338a59b8ce8968',uuid=01f7d4a1-2aec-4fca-a374-4a0554cfa838,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "address": "fa:16:3e:26:99:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9a6b12-57", "ovs_interfaceid": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converting VIF {"id": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "address": "fa:16:3e:26:99:90", "network": {"id": "e837bce3-8576-4fcd-a334-9cd0e3a21293", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-981663537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64aac75090884257a9c33f94ec9aa367", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab9a6b12-57", "ovs_interfaceid": "ab9a6b12-575e-4a8a-8fd8-8aa908140219", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:99:90,bridge_name='br-int',has_traffic_filtering=True,id=ab9a6b12-575e-4a8a-8fd8-8aa908140219,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9a6b12-57') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG os_vif [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:99:90,bridge_name='br-int',has_traffic_filtering=True,id=ab9a6b12-575e-4a8a-8fd8-8aa908140219,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9a6b12-57') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab9a6b12-57, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5bb09c8-95da-49e8-a3bc-4f50b916be45) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:47 user nova-compute[75210]: INFO os_vif [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:99:90,bridge_name='br-int',has_traffic_filtering=True,id=ab9a6b12-575e-4a8a-8fd8-8aa908140219,network=Network(e837bce3-8576-4fcd-a334-9cd0e3a21293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab9a6b12-57')
Nov 29 02:08:47 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Deleting instance files /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838_del
Nov 29 02:08:47 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Deletion of /opt/stack/data/nova/instances/01f7d4a1-2aec-4fca-a374-4a0554cfa838_del complete
Nov 29 02:08:47 user nova-compute[75210]: INFO nova.compute.manager [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 29 02:08:47 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:08:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:08:48 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:08:48 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Took 0.72 seconds to deallocate network for instance.
Nov 29 02:08:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:48 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:08:48 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:08:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:48 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Deleted allocations for instance 01f7d4a1-2aec-4fca-a374-4a0554cfa838
Nov 29 02:08:48 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:08:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-803c5bf2-89a5-4657-bacd-4197d5f60b08 tempest-AttachVolumeTestJSON-91454133 tempest-AttachVolumeTestJSON-91454133-project-member] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.293s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:48 user nova-compute[75210]: DEBUG nova.compute.manager [req-e4245d88-3147-4452-a31e-ddb2aea6c76d req-d70d8bcb-bef2-4282-bf25-6eed169a6281 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Received event network-vif-plugged-ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:08:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e4245d88-3147-4452-a31e-ddb2aea6c76d req-d70d8bcb-bef2-4282-bf25-6eed169a6281 service nova] Acquiring lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e4245d88-3147-4452-a31e-ddb2aea6c76d req-d70d8bcb-bef2-4282-bf25-6eed169a6281 service nova] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e4245d88-3147-4452-a31e-ddb2aea6c76d req-d70d8bcb-bef2-4282-bf25-6eed169a6281 service nova] Lock "01f7d4a1-2aec-4fca-a374-4a0554cfa838-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:48 user nova-compute[75210]: DEBUG nova.compute.manager [req-e4245d88-3147-4452-a31e-ddb2aea6c76d req-d70d8bcb-bef2-4282-bf25-6eed169a6281 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] No waiting events found dispatching network-vif-plugged-ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:08:48 user nova-compute[75210]: WARNING nova.compute.manager [req-e4245d88-3147-4452-a31e-ddb2aea6c76d req-d70d8bcb-bef2-4282-bf25-6eed169a6281 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Received unexpected event network-vif-plugged-ab9a6b12-575e-4a8a-8fd8-8aa908140219 for instance with vm_state deleted and task_state None.
Nov 29 02:08:48 user nova-compute[75210]: DEBUG nova.compute.manager [req-e4245d88-3147-4452-a31e-ddb2aea6c76d req-d70d8bcb-bef2-4282-bf25-6eed169a6281 service nova] [instance: 01f7d4a1-2aec-4fca-a374-4a0554cfa838] Received event network-vif-deleted-ab9a6b12-575e-4a8a-8fd8-8aa908140219 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:08:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:49 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:08:50 user nova-compute[75210]: INFO nova.compute.claims [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Claim successful on node user
Nov 29 02:08:50 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG nova.network.neutron [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:08:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:08:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG nova.policy [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '080bcd228b454b03995b0f3e116df917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f70d8cbb4232433cbd0db9e9448d897f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:08:50 user nova-compute[75210]: INFO nova.virt.block_device [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Booting with volume cad90634-d6ed-4e57-9d57-eb032e60f3e4 at /dev/vda
Nov 29 02:08:50 user nova-compute[75210]: DEBUG os_brick.utils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[763c7557-dabc-49e7-b26c-3c0d6499706c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[264614d7-abe4-41a4-9834-3c4f10aa579b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7f9b7e-17f5-453a-bf75-c5d99b90bb41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01fc42c-6238-49f0-8e58-6c54e0619d20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:08:50 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:08:50 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[618a5de3-a543-4bcb-ab22-3a710a94ccea]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG os_brick.utils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:08:50 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Updating existing volume attachment record: 720dd181-b0f4-45a6-b149-660518ad842b {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:08:51 user nova-compute[75210]: DEBUG nova.network.neutron [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Successfully created port: 4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:08:51 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:08:51 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:08:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Successfully updated port: 4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "refresh_cache-5f6a65bd-976d-4412-8c3f-7e20b108fe17" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquired lock "refresh_cache-5f6a65bd-976d-4412-8c3f-7e20b108fe17" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-d40587c5-46a8-4343-b0be-8310106bbc92 req-83d24254-a88f-4988-9a94-a56ed8c16156 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Received event network-changed-4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG nova.compute.manager [req-d40587c5-46a8-4343-b0be-8310106bbc92 req-83d24254-a88f-4988-9a94-a56ed8c16156 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Refreshing instance network info cache due to event network-changed-4353ea61-fa75-4867-a743-ca02a2e36320. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d40587c5-46a8-4343-b0be-8310106bbc92 req-83d24254-a88f-4988-9a94-a56ed8c16156 service nova] Acquiring lock "refresh_cache-5f6a65bd-976d-4412-8c3f-7e20b108fe17" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Updating instance_info_cache with network_info: [{"id": "4353ea61-fa75-4867-a743-ca02a2e36320", "address": "fa:16:3e:c2:e8:a6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4353ea61-fa", "ovs_interfaceid": "4353ea61-fa75-4867-a743-ca02a2e36320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Releasing lock "refresh_cache-5f6a65bd-976d-4412-8c3f-7e20b108fe17" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Instance network_info: |[{"id": "4353ea61-fa75-4867-a743-ca02a2e36320", "address": "fa:16:3e:c2:e8:a6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4353ea61-fa", "ovs_interfaceid": "4353ea61-fa75-4867-a743-ca02a2e36320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d40587c5-46a8-4343-b0be-8310106bbc92 req-83d24254-a88f-4988-9a94-a56ed8c16156 service nova] Acquired lock "refresh_cache-5f6a65bd-976d-4412-8c3f-7e20b108fe17" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG nova.network.neutron [req-d40587c5-46a8-4343-b0be-8310106bbc92 req-83d24254-a88f-4988-9a94-a56ed8c16156 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Refreshing network info cache for port 4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:08:52 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:08:52 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:08:52 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8830MB free_disk=25.20632553100586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:53 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:08:53 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 5f6a65bd-976d-4412-8c3f-7e20b108fe17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:08:53 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:08:53 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:08:53 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:08:53 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:08:53 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:08:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:53 user nova-compute[75210]: DEBUG nova.network.neutron [req-d40587c5-46a8-4343-b0be-8310106bbc92 req-83d24254-a88f-4988-9a94-a56ed8c16156 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Updated VIF entry in instance network info cache for port 4353ea61-fa75-4867-a743-ca02a2e36320. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:08:53 user nova-compute[75210]: DEBUG nova.network.neutron [req-d40587c5-46a8-4343-b0be-8310106bbc92 req-83d24254-a88f-4988-9a94-a56ed8c16156 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Updating instance_info_cache with network_info: [{"id": "4353ea61-fa75-4867-a743-ca02a2e36320", "address": "fa:16:3e:c2:e8:a6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4353ea61-fa", "ovs_interfaceid": "4353ea61-fa75-4867-a743-ca02a2e36320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:08:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d40587c5-46a8-4343-b0be-8310106bbc92 req-83d24254-a88f-4988-9a94-a56ed8c16156 service nova] Releasing lock "refresh_cache-5f6a65bd-976d-4412-8c3f-7e20b108fe17" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:08:57 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Creating image(s)
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Did not create local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Ensure instance console log exists: /opt/stack/data/nova/instances/5f6a65bd-976d-4412-8c3f-7e20b108fe17/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Start _get_guest_xml network_info=[{"id": "4353ea61-fa75-4867-a743-ca02a2e36320", "address": "fa:16:3e:c2:e8:a6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4353ea61-fa", "ovs_interfaceid": "4353ea61-fa75-4867-a743-ca02a2e36320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': '720dd181-b0f4-45a6-b149-660518ad842b', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DriVuEUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5f6a65bd-976d-4412-8c3f-7e20b108fe17', 'attached_at': '', 'detached_at': '', 'volume_id': 'cad90634-d6ed-4e57-9d57-eb032e60f3e4', 'serial': 'cad90634-d6ed-4e57-9d57-eb032e60f3e4'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:08:57 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:08:57 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DriVuEUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:08:57 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:08:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:08:57 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:08:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:08:57 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b6e2a3-d886-4bbf-811f-540db5739fec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:08:57 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaec87d-b472-405a-9c32-784283ea6ff1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4] added
Nov 29 02:08:57 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c105bf6-8e4d-4eb1-b96a-0e46489770e0]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fc43fb-5675-46c6-9a6d-2092a82111cf]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DriVuEUg {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DriVuEUg" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e613dcc9-0004-469d-9596-c9d30b302d9c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DriVuEUg'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9642ea90-d8f6-4c80-82a3-8271bffb5524]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31f44df-8344-49ae-b330-844b9d235c19]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:08:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:08:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[288c283f-1b9a-47ad-840f-15d5d0109d26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4, portal: 172.16.0.220,3260]
Nov 29 02:08:58 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4, portal: 172.16.0.220,3260] successful.
Nov 29 02:08:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26df809-0a37-4168-aba7-2089e3db4b53]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5879fdb8-a585-471c-9c5c-ef5bbe3b6cc0]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:08:58 user nova-compute[75210]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 (non-flash)
Nov 29 02:08:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:08:58 user nova-compute[75210]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 (non-flash)
Nov 29 02:08:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[313eaa34-9196-466e-8084-c297069799de]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:08:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DriVuEUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26639656636356466', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639656636356466', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1517112362',display_name='tempest-TestVolumeBootPattern-server-1517112362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1517112362',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbeEJ035qedgw6ffpy9AgBMNgjtmpEug1BnI4ukxa+OzSVx7eUZOgpnD5Ot84IR7Q55P3We053ESM83PfYsrIt51L3Ie8cNeSPyWbkxkw4BsGC2WohQHJL8Q1MriTltHA==',key_name='tempest-TestVolumeBootPattern-274321318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-tn49xdmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:08:50Z,user_data=None,user_id='080bcd228b454b03995b0f3e116df917',uuid=5f6a65bd-976d-4412-8c3f-7e20b108fe17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4353ea61-fa75-4867-a743-ca02a2e36320", "address": "fa:16:3e:c2:e8:a6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4353ea61-fa", "ovs_interfaceid": "4353ea61-fa75-4867-a743-ca02a2e36320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "4353ea61-fa75-4867-a743-ca02a2e36320", "address": "fa:16:3e:c2:e8:a6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4353ea61-fa", "ovs_interfaceid": "4353ea61-fa75-4867-a743-ca02a2e36320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=4353ea61-fa75-4867-a743-ca02a2e36320,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4353ea61-fa') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG nova.objects.instance [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f6a65bd-976d-4412-8c3f-7e20b108fe17 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:08:59 user nova-compute[75210]:   <uuid>5f6a65bd-976d-4412-8c3f-7e20b108fe17</uuid>
Nov 29 02:08:59 user nova-compute[75210]:   <name>instance-0000002f</name>
Nov 29 02:08:59 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:08:59 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:08:59 user nova-compute[75210]:   <metadata>
Nov 29 02:08:59 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:08:59 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:08:59 user nova-compute[75210]:       <nova:name>tempest-TestVolumeBootPattern-server-1517112362</nova:name>
Nov 29 02:08:59 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:08:57</nova:creationTime>
Nov 29 02:08:59 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:08:59 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:08:59 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:08:59 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:08:59 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:08:59 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:08:59 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:08:59 user nova-compute[75210]:       <nova:owner>
Nov 29 02:08:59 user nova-compute[75210]:         <nova:user uuid="080bcd228b454b03995b0f3e116df917">tempest-TestVolumeBootPattern-670838009-project-member</nova:user>
Nov 29 02:08:59 user nova-compute[75210]:         <nova:project uuid="f70d8cbb4232433cbd0db9e9448d897f">tempest-TestVolumeBootPattern-670838009</nova:project>
Nov 29 02:08:59 user nova-compute[75210]:       </nova:owner>
Nov 29 02:08:59 user nova-compute[75210]:       <nova:ports>
Nov 29 02:08:59 user nova-compute[75210]:         <nova:port uuid="4353ea61-fa75-4867-a743-ca02a2e36320">
Nov 29 02:08:59 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 29 02:08:59 user nova-compute[75210]:         </nova:port>
Nov 29 02:08:59 user nova-compute[75210]:       </nova:ports>
Nov 29 02:08:59 user nova-compute[75210]:     </nova:instance>
Nov 29 02:08:59 user nova-compute[75210]:   </metadata>
Nov 29 02:08:59 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:08:59 user nova-compute[75210]:     <system>
Nov 29 02:08:59 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:08:59 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:08:59 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:08:59 user nova-compute[75210]:       <entry name="serial">5f6a65bd-976d-4412-8c3f-7e20b108fe17</entry>
Nov 29 02:08:59 user nova-compute[75210]:       <entry name="uuid">5f6a65bd-976d-4412-8c3f-7e20b108fe17</entry>
Nov 29 02:08:59 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:08:59 user nova-compute[75210]:     </system>
Nov 29 02:08:59 user nova-compute[75210]:   </sysinfo>
Nov 29 02:08:59 user nova-compute[75210]:   <os>
Nov 29 02:08:59 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:08:59 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:08:59 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:08:59 user nova-compute[75210]:   </os>
Nov 29 02:08:59 user nova-compute[75210]:   <features>
Nov 29 02:08:59 user nova-compute[75210]:     <acpi/>
Nov 29 02:08:59 user nova-compute[75210]:     <apic/>
Nov 29 02:08:59 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:08:59 user nova-compute[75210]:   </features>
Nov 29 02:08:59 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:08:59 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:08:59 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:08:59 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:08:59 user nova-compute[75210]:   </clock>
Nov 29 02:08:59 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:08:59 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:08:59 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:08:59 user nova-compute[75210]:   </cpu>
Nov 29 02:08:59 user nova-compute[75210]:   <devices>
Nov 29 02:08:59 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 02:08:59 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:08:59 user nova-compute[75210]:       <source dev="/dev/sdb"/>
Nov 29 02:08:59 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:08:59 user nova-compute[75210]:       <serial>cad90634-d6ed-4e57-9d57-eb032e60f3e4</serial>
Nov 29 02:08:59 user nova-compute[75210]:     </disk>
Nov 29 02:08:59 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:08:59 user nova-compute[75210]:       <mac address="fa:16:3e:c2:e8:a6"/>
Nov 29 02:08:59 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:08:59 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:08:59 user nova-compute[75210]:       <target dev="tap4353ea61-fa"/>
Nov 29 02:08:59 user nova-compute[75210]:     </interface>
Nov 29 02:08:59 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:08:59 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/5f6a65bd-976d-4412-8c3f-7e20b108fe17/console.log" append="off"/>
Nov 29 02:08:59 user nova-compute[75210]:     </serial>
Nov 29 02:08:59 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:08:59 user nova-compute[75210]:     <video>
Nov 29 02:08:59 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:08:59 user nova-compute[75210]:     </video>
Nov 29 02:08:59 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:08:59 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:08:59 user nova-compute[75210]:     </rng>
Nov 29 02:08:59 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:08:59 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:08:59 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:08:59 user nova-compute[75210]:     </memballoon>
Nov 29 02:08:59 user nova-compute[75210]:   </devices>
Nov 29 02:08:59 user nova-compute[75210]: </domain>
Nov 29 02:08:59 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1517112362',display_name='tempest-TestVolumeBootPattern-server-1517112362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1517112362',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbeEJ035qedgw6ffpy9AgBMNgjtmpEug1BnI4ukxa+OzSVx7eUZOgpnD5Ot84IR7Q55P3We053ESM83PfYsrIt51L3Ie8cNeSPyWbkxkw4BsGC2WohQHJL8Q1MriTltHA==',key_name='tempest-TestVolumeBootPattern-274321318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-tn49xdmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:08:50Z,user_data=None,user_id='080bcd228b454b03995b0f3e116df917',uuid=5f6a65bd-976d-4412-8c3f-7e20b108fe17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4353ea61-fa75-4867-a743-ca02a2e36320", "address": "fa:16:3e:c2:e8:a6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4353ea61-fa", "ovs_interfaceid": "4353ea61-fa75-4867-a743-ca02a2e36320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "4353ea61-fa75-4867-a743-ca02a2e36320", "address": "fa:16:3e:c2:e8:a6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4353ea61-fa", "ovs_interfaceid": "4353ea61-fa75-4867-a743-ca02a2e36320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=4353ea61-fa75-4867-a743-ca02a2e36320,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4353ea61-fa') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG os_vif [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=4353ea61-fa75-4867-a743-ca02a2e36320,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4353ea61-fa') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a1eed40-4a30-52fa-aeef-a20312ec02c4', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4353ea61-fa, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4353ea61-fa, col_values=(('qos', UUID('1b62ab74-857a-4248-b99f-477bd73dec41')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4353ea61-fa, col_values=(('external_ids', {'iface-id': '4353ea61-fa75-4867-a743-ca02a2e36320', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:e8:a6', 'vm-uuid': '5f6a65bd-976d-4412-8c3f-7e20b108fe17'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:08:59 user nova-compute[75210]: INFO os_vif [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=4353ea61-fa75-4867-a743-ca02a2e36320,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4353ea61-fa')
Nov 29 02:08:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:08:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] No VIF found with MAC fa:16:3e:c2:e8:a6, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:09:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-130f330e-d5ae-4f04-b48a-116cc35cafcf req-8a49c7aa-4ee8-424c-ac28-1d54c07229e3 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Received event network-vif-plugged-4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:09:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-130f330e-d5ae-4f04-b48a-116cc35cafcf req-8a49c7aa-4ee8-424c-ac28-1d54c07229e3 service nova] Acquiring lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:09:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-130f330e-d5ae-4f04-b48a-116cc35cafcf req-8a49c7aa-4ee8-424c-ac28-1d54c07229e3 service nova] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:09:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-130f330e-d5ae-4f04-b48a-116cc35cafcf req-8a49c7aa-4ee8-424c-ac28-1d54c07229e3 service nova] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:09:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-130f330e-d5ae-4f04-b48a-116cc35cafcf req-8a49c7aa-4ee8-424c-ac28-1d54c07229e3 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] No waiting events found dispatching network-vif-plugged-4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:09:00 user nova-compute[75210]: WARNING nova.compute.manager [req-130f330e-d5ae-4f04-b48a-116cc35cafcf req-8a49c7aa-4ee8-424c-ac28-1d54c07229e3 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Received unexpected event network-vif-plugged-4353ea61-fa75-4867-a743-ca02a2e36320 for instance with vm_state building and task_state spawning.
Nov 29 02:09:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:09:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:09:02 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Instance spawned successfully.
Nov 29 02:09:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:09:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:09:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:09:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:09:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:09:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:09:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:09:02 user nova-compute[75210]: INFO nova.compute.manager [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Took 4.86 seconds to spawn the instance on the hypervisor.
Nov 29 02:09:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:09:02 user nova-compute[75210]: INFO nova.compute.manager [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Took 12.71 seconds to build instance.
Nov 29 02:09:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba342e7-93a6-4c1f-ae2a-f83f26093f12 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.822s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:09:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-b5a5bdb5-f63f-4600-b82c-05806b05d64b req-c5b4211f-58b0-492d-b18b-d635f1bb91e2 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Received event network-vif-plugged-4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:09:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b5a5bdb5-f63f-4600-b82c-05806b05d64b req-c5b4211f-58b0-492d-b18b-d635f1bb91e2 service nova] Acquiring lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:09:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b5a5bdb5-f63f-4600-b82c-05806b05d64b req-c5b4211f-58b0-492d-b18b-d635f1bb91e2 service nova] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:09:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b5a5bdb5-f63f-4600-b82c-05806b05d64b req-c5b4211f-58b0-492d-b18b-d635f1bb91e2 service nova] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:09:02 user nova-compute[75210]: DEBUG nova.compute.manager [req-b5a5bdb5-f63f-4600-b82c-05806b05d64b req-c5b4211f-58b0-492d-b18b-d635f1bb91e2 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] No waiting events found dispatching network-vif-plugged-4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:09:02 user nova-compute[75210]: WARNING nova.compute.manager [req-b5a5bdb5-f63f-4600-b82c-05806b05d64b req-c5b4211f-58b0-492d-b18b-d635f1bb91e2 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Received unexpected event network-vif-plugged-4353ea61-fa75-4867-a743-ca02a2e36320 for instance with vm_state active and task_state None.
Nov 29 02:09:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:09:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:09:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:09:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:09:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:09:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:09:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:09:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:09:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:09:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:09:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:09:24 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:09:24 user nova-compute[75210]: INFO nova.compute.claims [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Claim successful on node user
Nov 29 02:09:25 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG nova.compute.manager [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG nova.compute.manager [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG nova.network.neutron [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:09:25 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:09:25 user nova-compute[75210]: DEBUG nova.compute.manager [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG nova.policy [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4f7a67a01104567b3e96f9d150dddd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55934a4b47ab45a4a7f389919225c156', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG nova.compute.manager [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:09:25 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Creating image(s)
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "/opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "/opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "/opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.181s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.185s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk 1073741824" returned: 0 in 0.051s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:09:25 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG nova.network.neutron [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Successfully created port: 52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.202s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Checking if we can resize image /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Cannot resize image /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Ensure instance console log exists: /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG nova.network.neutron [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Successfully updated port: 52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquired lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG nova.network.neutron [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-f8731dba-f37a-4ffd-a099-ad8fe337862a req-ea3da704-1e10-40a2-a730-daedbedda578 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-changed-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG nova.compute.manager [req-f8731dba-f37a-4ffd-a099-ad8fe337862a req-ea3da704-1e10-40a2-a730-daedbedda578 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Refreshing instance network info cache due to event network-changed-52e85b3f-0dac-43f8-a484-7993e2ac7729. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8731dba-f37a-4ffd-a099-ad8fe337862a req-ea3da704-1e10-40a2-a730-daedbedda578 service nova] Acquiring lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG nova.network.neutron [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:09:26 user nova-compute[75210]: DEBUG nova.network.neutron [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updating instance_info_cache with network_info: [{"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Releasing lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.compute.manager [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Instance network_info: |[{"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8731dba-f37a-4ffd-a099-ad8fe337862a req-ea3da704-1e10-40a2-a730-daedbedda578 service nova] Acquired lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.network.neutron [req-f8731dba-f37a-4ffd-a099-ad8fe337862a req-ea3da704-1e10-40a2-a730-daedbedda578 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Refreshing network info cache for port 52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Start _get_guest_xml network_info=[{"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:09:27 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:09:27 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-245300826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-245300826',id=48,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/oV2YiOdLrZqfATbxLr3cZ5gGa2Kz3qZy2t4wfNFvC3WzI4dq8STr3miU4QP3DJkFHguyIAPBNWk6n3gDtLcSqOunITTo/1Aw3sSrsaSfRA5NV9S9D77R1Vk1L+/OX9g==',key_name='tempest-keypair-673500543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55934a4b47ab45a4a7f389919225c156',ramdisk_id='',reservation_id='r-azvatg0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2088736241',owner_user_name='tempest-AttachVolumeShelveTestJSON-2088736241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:09:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f7a67a01104567b3e96f9d150dddd2',uuid=953a63c8-a86d-420c-98fe-bdaa77f85904,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converting VIF {"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.objects.instance [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'pci_devices' on Instance uuid 953a63c8-a86d-420c-98fe-bdaa77f85904 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:09:27 user nova-compute[75210]:   <uuid>953a63c8-a86d-420c-98fe-bdaa77f85904</uuid>
Nov 29 02:09:27 user nova-compute[75210]:   <name>instance-00000030</name>
Nov 29 02:09:27 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:09:27 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:09:27 user nova-compute[75210]:   <metadata>
Nov 29 02:09:27 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:09:27 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:09:27 user nova-compute[75210]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-245300826</nova:name>
Nov 29 02:09:27 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:09:27</nova:creationTime>
Nov 29 02:09:27 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:09:27 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:09:27 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:09:27 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:09:27 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:09:27 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:09:27 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:09:27 user nova-compute[75210]:       <nova:owner>
Nov 29 02:09:27 user nova-compute[75210]:         <nova:user uuid="f4f7a67a01104567b3e96f9d150dddd2">tempest-AttachVolumeShelveTestJSON-2088736241-project-member</nova:user>
Nov 29 02:09:27 user nova-compute[75210]:         <nova:project uuid="55934a4b47ab45a4a7f389919225c156">tempest-AttachVolumeShelveTestJSON-2088736241</nova:project>
Nov 29 02:09:27 user nova-compute[75210]:       </nova:owner>
Nov 29 02:09:27 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 02:09:27 user nova-compute[75210]:       <nova:ports>
Nov 29 02:09:27 user nova-compute[75210]:         <nova:port uuid="52e85b3f-0dac-43f8-a484-7993e2ac7729">
Nov 29 02:09:27 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 02:09:27 user nova-compute[75210]:         </nova:port>
Nov 29 02:09:27 user nova-compute[75210]:       </nova:ports>
Nov 29 02:09:27 user nova-compute[75210]:     </nova:instance>
Nov 29 02:09:27 user nova-compute[75210]:   </metadata>
Nov 29 02:09:27 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:09:27 user nova-compute[75210]:     <system>
Nov 29 02:09:27 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:09:27 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:09:27 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:09:27 user nova-compute[75210]:       <entry name="serial">953a63c8-a86d-420c-98fe-bdaa77f85904</entry>
Nov 29 02:09:27 user nova-compute[75210]:       <entry name="uuid">953a63c8-a86d-420c-98fe-bdaa77f85904</entry>
Nov 29 02:09:27 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:09:27 user nova-compute[75210]:     </system>
Nov 29 02:09:27 user nova-compute[75210]:   </sysinfo>
Nov 29 02:09:27 user nova-compute[75210]:   <os>
Nov 29 02:09:27 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:09:27 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:09:27 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:09:27 user nova-compute[75210]:   </os>
Nov 29 02:09:27 user nova-compute[75210]:   <features>
Nov 29 02:09:27 user nova-compute[75210]:     <acpi/>
Nov 29 02:09:27 user nova-compute[75210]:     <apic/>
Nov 29 02:09:27 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:09:27 user nova-compute[75210]:   </features>
Nov 29 02:09:27 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:09:27 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:09:27 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:09:27 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:09:27 user nova-compute[75210]:   </clock>
Nov 29 02:09:27 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:09:27 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:09:27 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:09:27 user nova-compute[75210]:   </cpu>
Nov 29 02:09:27 user nova-compute[75210]:   <devices>
Nov 29 02:09:27 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:09:27 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:09:27 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk"/>
Nov 29 02:09:27 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:09:27 user nova-compute[75210]:     </disk>
Nov 29 02:09:27 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:09:27 user nova-compute[75210]:       <mac address="fa:16:3e:ed:3b:3e"/>
Nov 29 02:09:27 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:09:27 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:09:27 user nova-compute[75210]:       <target dev="tap52e85b3f-0d"/>
Nov 29 02:09:27 user nova-compute[75210]:     </interface>
Nov 29 02:09:27 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:09:27 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/console.log" append="off"/>
Nov 29 02:09:27 user nova-compute[75210]:     </serial>
Nov 29 02:09:27 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:09:27 user nova-compute[75210]:     <video>
Nov 29 02:09:27 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:09:27 user nova-compute[75210]:     </video>
Nov 29 02:09:27 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:09:27 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:09:27 user nova-compute[75210]:     </rng>
Nov 29 02:09:27 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:09:27 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:09:27 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:09:27 user nova-compute[75210]:     </memballoon>
Nov 29 02:09:27 user nova-compute[75210]:   </devices>
Nov 29 02:09:27 user nova-compute[75210]: </domain>
Nov 29 02:09:27 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-245300826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-245300826',id=48,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/oV2YiOdLrZqfATbxLr3cZ5gGa2Kz3qZy2t4wfNFvC3WzI4dq8STr3miU4QP3DJkFHguyIAPBNWk6n3gDtLcSqOunITTo/1Aw3sSrsaSfRA5NV9S9D77R1Vk1L+/OX9g==',key_name='tempest-keypair-673500543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55934a4b47ab45a4a7f389919225c156',ramdisk_id='',reservation_id='r-azvatg0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2088736241',owner_user_name='tempest-AttachVolumeShelveTestJSON-2088736241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:09:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f7a67a01104567b3e96f9d150dddd2',uuid=953a63c8-a86d-420c-98fe-bdaa77f85904,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converting VIF {"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG os_vif [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89fcc709-61d8-568c-917e-d14f51340ce4', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52e85b3f-0d, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52e85b3f-0d, col_values=(('qos', UUID('f5b176fa-5b9b-496e-b185-1ed4ab99a59c')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52e85b3f-0d, col_values=(('external_ids', {'iface-id': '52e85b3f-0dac-43f8-a484-7993e2ac7729', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:3b:3e', 'vm-uuid': '953a63c8-a86d-420c-98fe-bdaa77f85904'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:27 user nova-compute[75210]: INFO os_vif [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d')
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] No VIF found with MAC fa:16:3e:ed:3b:3e, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.network.neutron [req-f8731dba-f37a-4ffd-a099-ad8fe337862a req-ea3da704-1e10-40a2-a730-daedbedda578 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updated VIF entry in instance network info cache for port 52e85b3f-0dac-43f8-a484-7993e2ac7729. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG nova.network.neutron [req-f8731dba-f37a-4ffd-a099-ad8fe337862a req-ea3da704-1e10-40a2-a730-daedbedda578 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updating instance_info_cache with network_info: [{"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:09:27 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8731dba-f37a-4ffd-a099-ad8fe337862a req-ea3da704-1e10-40a2-a730-daedbedda578 service nova] Releasing lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:09:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-9e0253c3-5511-455b-af1b-a890bcedefa0 req-50861d88-633c-47db-bb91-1b0076b78287 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:09:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9e0253c3-5511-455b-af1b-a890bcedefa0 req-50861d88-633c-47db-bb91-1b0076b78287 service nova] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:09:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9e0253c3-5511-455b-af1b-a890bcedefa0 req-50861d88-633c-47db-bb91-1b0076b78287 service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:09:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9e0253c3-5511-455b-af1b-a890bcedefa0 req-50861d88-633c-47db-bb91-1b0076b78287 service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:09:28 user nova-compute[75210]: DEBUG nova.compute.manager [req-9e0253c3-5511-455b-af1b-a890bcedefa0 req-50861d88-633c-47db-bb91-1b0076b78287 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] No waiting events found dispatching network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:09:28 user nova-compute[75210]: WARNING nova.compute.manager [req-9e0253c3-5511-455b-af1b-a890bcedefa0 req-50861d88-633c-47db-bb91-1b0076b78287 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received unexpected event network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 for instance with vm_state building and task_state spawning.
Nov 29 02:09:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-2d70699b-f48a-4b41-a8d4-5ca9de10ba34 req-030e2d43-b01f-44bd-bf24-97185b13f5ba service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:09:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2d70699b-f48a-4b41-a8d4-5ca9de10ba34 req-030e2d43-b01f-44bd-bf24-97185b13f5ba service nova] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:09:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2d70699b-f48a-4b41-a8d4-5ca9de10ba34 req-030e2d43-b01f-44bd-bf24-97185b13f5ba service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:09:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2d70699b-f48a-4b41-a8d4-5ca9de10ba34 req-030e2d43-b01f-44bd-bf24-97185b13f5ba service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:09:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-2d70699b-f48a-4b41-a8d4-5ca9de10ba34 req-030e2d43-b01f-44bd-bf24-97185b13f5ba service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] No waiting events found dispatching network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:09:30 user nova-compute[75210]: WARNING nova.compute.manager [req-2d70699b-f48a-4b41-a8d4-5ca9de10ba34 req-030e2d43-b01f-44bd-bf24-97185b13f5ba service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received unexpected event network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 for instance with vm_state building and task_state spawning.
Nov 29 02:09:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:09:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:09:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Instance spawned successfully.
Nov 29 02:09:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:09:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:09:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:09:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:09:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:09:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:09:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:09:30 user nova-compute[75210]: INFO nova.compute.manager [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 29 02:09:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:09:30 user nova-compute[75210]: INFO nova.compute.manager [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Took 5.94 seconds to build instance.
Nov 29 02:09:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-8e1c6196-1347-4c77-a859-3b3336599bc3 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.045s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:09:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:09:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:09:45 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:09:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:09:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:09:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:09:45 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:09:45 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Updating instance_info_cache with network_info: [{"id": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "address": "fa:16:3e:0b:6e:84", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a63d91-cd", "ovs_interfaceid": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:09:45 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:09:45 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:09:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:09:48 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:09:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:09:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:51 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:09:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:09:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:09:53 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:09:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:09:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:09:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:09:53 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:09:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:09:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:09:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:09:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:09:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:09:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:09:54 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:09:54 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:09:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8638MB free_disk=25.166908264160156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:09:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:09:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:09:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:09:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 5f6a65bd-976d-4412-8c3f-7e20b108fe17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:09:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 953a63c8-a86d-420c-98fe-bdaa77f85904 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:09:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:09:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:09:54 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:09:54 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:09:54 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:09:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:09:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:09:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:10:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:10:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:10:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:10:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:10:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:10:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:10:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:10:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:10:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:10:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:10:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:10:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:10:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:10:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:10:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:10:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:10:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:10:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:10:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:10:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:10:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:10:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:10:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-0eebe67b-8f8b-4bce-bd04-d6f6396ec496 req-d45c936e-3ca8-41c6-98a8-8cc7fccd73cb service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Received event network-changed-4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:10:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-0eebe67b-8f8b-4bce-bd04-d6f6396ec496 req-d45c936e-3ca8-41c6-98a8-8cc7fccd73cb service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Refreshing instance network info cache due to event network-changed-4353ea61-fa75-4867-a743-ca02a2e36320. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:10:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0eebe67b-8f8b-4bce-bd04-d6f6396ec496 req-d45c936e-3ca8-41c6-98a8-8cc7fccd73cb service nova] Acquiring lock "refresh_cache-5f6a65bd-976d-4412-8c3f-7e20b108fe17" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:10:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0eebe67b-8f8b-4bce-bd04-d6f6396ec496 req-d45c936e-3ca8-41c6-98a8-8cc7fccd73cb service nova] Acquired lock "refresh_cache-5f6a65bd-976d-4412-8c3f-7e20b108fe17" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:10:42 user nova-compute[75210]: DEBUG nova.network.neutron [req-0eebe67b-8f8b-4bce-bd04-d6f6396ec496 req-d45c936e-3ca8-41c6-98a8-8cc7fccd73cb service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Refreshing network info cache for port 4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:10:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:10:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:10:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:10:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:10:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:10:42 user nova-compute[75210]: DEBUG nova.network.neutron [req-0eebe67b-8f8b-4bce-bd04-d6f6396ec496 req-d45c936e-3ca8-41c6-98a8-8cc7fccd73cb service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Updated VIF entry in instance network info cache for port 4353ea61-fa75-4867-a743-ca02a2e36320. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:10:42 user nova-compute[75210]: DEBUG nova.network.neutron [req-0eebe67b-8f8b-4bce-bd04-d6f6396ec496 req-d45c936e-3ca8-41c6-98a8-8cc7fccd73cb service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Updating instance_info_cache with network_info: [{"id": "4353ea61-fa75-4867-a743-ca02a2e36320", "address": "fa:16:3e:c2:e8:a6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4353ea61-fa", "ovs_interfaceid": "4353ea61-fa75-4867-a743-ca02a2e36320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:10:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-0eebe67b-8f8b-4bce-bd04-d6f6396ec496 req-d45c936e-3ca8-41c6-98a8-8cc7fccd73cb service nova] Releasing lock "refresh_cache-5f6a65bd-976d-4412-8c3f-7e20b108fe17" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:10:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-75b19d2c-0745-439f-bf17-c474b238d3c0 req-9de32546-f697-42c8-89d6-f405e04981c1 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Received event network-changed-4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:10:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-75b19d2c-0745-439f-bf17-c474b238d3c0 req-9de32546-f697-42c8-89d6-f405e04981c1 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Refreshing instance network info cache due to event network-changed-4353ea61-fa75-4867-a743-ca02a2e36320. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:10:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-75b19d2c-0745-439f-bf17-c474b238d3c0 req-9de32546-f697-42c8-89d6-f405e04981c1 service nova] Acquiring lock "refresh_cache-5f6a65bd-976d-4412-8c3f-7e20b108fe17" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:10:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-75b19d2c-0745-439f-bf17-c474b238d3c0 req-9de32546-f697-42c8-89d6-f405e04981c1 service nova] Acquired lock "refresh_cache-5f6a65bd-976d-4412-8c3f-7e20b108fe17" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:10:43 user nova-compute[75210]: DEBUG nova.network.neutron [req-75b19d2c-0745-439f-bf17-c474b238d3c0 req-9de32546-f697-42c8-89d6-f405e04981c1 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Refreshing network info cache for port 4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:10:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:10:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:10:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:10:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:10:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:10:43 user nova-compute[75210]: INFO nova.compute.manager [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Terminating instance
Nov 29 02:10:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:10:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG nova.network.neutron [req-75b19d2c-0745-439f-bf17-c474b238d3c0 req-9de32546-f697-42c8-89d6-f405e04981c1 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Updated VIF entry in instance network info cache for port 4353ea61-fa75-4867-a743-ca02a2e36320. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG nova.network.neutron [req-75b19d2c-0745-439f-bf17-c474b238d3c0 req-9de32546-f697-42c8-89d6-f405e04981c1 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Updating instance_info_cache with network_info: [{"id": "4353ea61-fa75-4867-a743-ca02a2e36320", "address": "fa:16:3e:c2:e8:a6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4353ea61-fa", "ovs_interfaceid": "4353ea61-fa75-4867-a743-ca02a2e36320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-75b19d2c-0745-439f-bf17-c474b238d3c0 req-9de32546-f697-42c8-89d6-f405e04981c1 service nova] Releasing lock "refresh_cache-5f6a65bd-976d-4412-8c3f-7e20b108fe17" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-3bbb8dc0-acbd-478a-b614-ac551af6c44b req-0ba120fc-ff85-4ee2-b84e-1e6b80c05df2 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Received event network-vif-unplugged-4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3bbb8dc0-acbd-478a-b614-ac551af6c44b req-0ba120fc-ff85-4ee2-b84e-1e6b80c05df2 service nova] Acquiring lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3bbb8dc0-acbd-478a-b614-ac551af6c44b req-0ba120fc-ff85-4ee2-b84e-1e6b80c05df2 service nova] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3bbb8dc0-acbd-478a-b614-ac551af6c44b req-0ba120fc-ff85-4ee2-b84e-1e6b80c05df2 service nova] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-3bbb8dc0-acbd-478a-b614-ac551af6c44b req-0ba120fc-ff85-4ee2-b84e-1e6b80c05df2 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] No waiting events found dispatching network-vif-unplugged-4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-3bbb8dc0-acbd-478a-b614-ac551af6c44b req-0ba120fc-ff85-4ee2-b84e-1e6b80c05df2 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Received event network-vif-unplugged-4353ea61-fa75-4867-a743-ca02a2e36320 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:44 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Instance destroyed successfully.
Nov 29 02:10:44 user nova-compute[75210]: DEBUG nova.objects.instance [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lazy-loading 'resources' on Instance uuid 5f6a65bd-976d-4412-8c3f-7e20b108fe17 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1517112362',display_name='tempest-TestVolumeBootPattern-server-1517112362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1517112362',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbeEJ035qedgw6ffpy9AgBMNgjtmpEug1BnI4ukxa+OzSVx7eUZOgpnD5Ot84IR7Q55P3We053ESM83PfYsrIt51L3Ie8cNeSPyWbkxkw4BsGC2WohQHJL8Q1MriTltHA==',key_name='tempest-TestVolumeBootPattern-274321318',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:09:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-tn49xdmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:09:03Z,user_data=None,user_id='080bcd228b454b03995b0f3e116df917',uuid=5f6a65bd-976d-4412-8c3f-7e20b108fe17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4353ea61-fa75-4867-a743-ca02a2e36320", "address": "fa:16:3e:c2:e8:a6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4353ea61-fa", "ovs_interfaceid": "4353ea61-fa75-4867-a743-ca02a2e36320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "4353ea61-fa75-4867-a743-ca02a2e36320", "address": "fa:16:3e:c2:e8:a6", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4353ea61-fa", "ovs_interfaceid": "4353ea61-fa75-4867-a743-ca02a2e36320", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=4353ea61-fa75-4867-a743-ca02a2e36320,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4353ea61-fa') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_vif [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=4353ea61-fa75-4867-a743-ca02a2e36320,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4353ea61-fa') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4353ea61-fa, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b62ab74-857a-4248-b99f-477bd73dec41) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:10:44 user nova-compute[75210]: INFO os_vif [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:e8:a6,bridge_name='br-int',has_traffic_filtering=True,id=4353ea61-fa75-4867-a743-ca02a2e36320,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4353ea61-fa')
Nov 29 02:10:44 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DriVuEUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:10:44 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af3a2a1-1f3d-4cc1-a539-01f064b80ee3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:10:44 user nova-compute[75210]: No targets found.
Nov 29 02:10:44 user nova-compute[75210]: iSNS:
Nov 29 02:10:44 user nova-compute[75210]: No targets found.
Nov 29 02:10:44 user nova-compute[75210]: STATIC:
Nov 29 02:10:44 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18
Nov 29 02:10:44 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:10:44 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:10:44 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4
Nov 29 02:10:44 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:10:44 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:10:44 user nova-compute[75210]: FIRMWARE:
Nov 29 02:10:44 user nova-compute[75210]: No targets found.
Nov 29 02:10:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:10:44 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:10:44 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8eba50-c322-418d-b04b-c1d2950a0087]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[130cb7d9-d8ab-4676-a66c-545cc89ed9a1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:10:44 user nova-compute[75210]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 (non-flash)
Nov 29 02:10:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:10:44 user nova-compute[75210]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 (non-flash)
Nov 29 02:10:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f001f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0dbdba-2c11-4909-bbd8-e3a72feb83c2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb88f4b9-9f5b-47e7-b795-12eb67098c62]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bf63cc-e338-46b5-81d1-5fefcd15c845]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d7d974-e06f-45b2-b6d5-edb8f72ce308]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_323afebd', '/dev/disk/by-id/scsi-1SCST_BIO323afebd-f9ef65df1e3533f3', '/dev/disk/by-id/scsi-26639656636356466') {{(pid=85542) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 02:10:44 user nova-compute[75210]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_323afebd
Nov 29 02:10:44 user nova-compute[75210]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO323afebd-f9ef65df1e3533f3
Nov 29 02:10:44 user nova-compute[75210]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26639656636356466
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c6f35e-f9f5-4d79-ab0b-a417ffd17198]: (4, None) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d447b34-1874-4941-a5cd-3e99a8cabc26]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d08eb5-5dda-4e29-9911-0585a1743b57]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4, portal: 172.16.0.220,3260]
Nov 29 02:10:44 user nova-compute[75210]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4, portal: 172.16.0.220,3260] successful.
Nov 29 02:10:44 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad90634-d6ed-4e57-9d57-eb032e60f3e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:10:44 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc3f177-5045-4f1f-8c3f-27896b9c44a9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:10:45 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:10:45 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:10:45 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== disconnect_volume: return (313ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:10:45 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:10:45 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Deleting instance files /opt/stack/data/nova/instances/5f6a65bd-976d-4412-8c3f-7e20b108fe17_del
Nov 29 02:10:45 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Deletion of /opt/stack/data/nova/instances/5f6a65bd-976d-4412-8c3f-7e20b108fe17_del complete
Nov 29 02:10:45 user nova-compute[75210]: INFO nova.compute.manager [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 29 02:10:45 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:10:45 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:10:45 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:10:45 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:10:45 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Took 0.49 seconds to deallocate network for instance.
Nov 29 02:10:45 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:10:45 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:10:45 user nova-compute[75210]: DEBUG nova.compute.manager [req-a1d3da8d-784e-48b4-a466-dc86414073dc req-b15dd481-6e0e-4d85-a45a-f62d647a34c6 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Received event network-vif-deleted-4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:10:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-4ba2d4f3-78b0-4618-8735-bf78c36a3900 req-d4e7f938-4845-4182-8e1e-c579cb821f49 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Received event network-vif-plugged-4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:10:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4ba2d4f3-78b0-4618-8735-bf78c36a3900 req-d4e7f938-4845-4182-8e1e-c579cb821f49 service nova] Acquiring lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:10:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4ba2d4f3-78b0-4618-8735-bf78c36a3900 req-d4e7f938-4845-4182-8e1e-c579cb821f49 service nova] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:10:46 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4ba2d4f3-78b0-4618-8735-bf78c36a3900 req-d4e7f938-4845-4182-8e1e-c579cb821f49 service nova] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:10:46 user nova-compute[75210]: DEBUG nova.compute.manager [req-4ba2d4f3-78b0-4618-8735-bf78c36a3900 req-d4e7f938-4845-4182-8e1e-c579cb821f49 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] No waiting events found dispatching network-vif-plugged-4353ea61-fa75-4867-a743-ca02a2e36320 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:10:46 user nova-compute[75210]: WARNING nova.compute.manager [req-4ba2d4f3-78b0-4618-8735-bf78c36a3900 req-d4e7f938-4845-4182-8e1e-c579cb821f49 service nova] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Received unexpected event network-vif-plugged-4353ea61-fa75-4867-a743-ca02a2e36320 for instance with vm_state active and task_state deleting.
Nov 29 02:10:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:10:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:10:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:10:47 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Didn't find any instances for network info cache update. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 02:10:48 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:10:48 user nova-compute[75210]: INFO nova.compute.manager [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: 5f6a65bd-976d-4412-8c3f-7e20b108fe17] Took 2.95 seconds to detach 1 volumes for instance.
Nov 29 02:10:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:10:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:10:48 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:10:48 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:10:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:10:48 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Deleted allocations for instance 5f6a65bd-976d-4412-8c3f-7e20b108fe17
Nov 29 02:10:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6cad5f00-17ff-4108-9f74-60c3fffcb10d tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "5f6a65bd-976d-4412-8c3f-7e20b108fe17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.024s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:10:49 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:10:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:10:51 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:10:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:10:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:10:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:55 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:10:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:10:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:10:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:10:55 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:10:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:10:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:10:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:10:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:10:55 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:10:56 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:10:56 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:10:56 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8742MB free_disk=25.1619873046875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:10:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:10:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:10:56 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:10:56 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 953a63c8-a86d-420c-98fe-bdaa77f85904 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:10:56 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:10:56 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:10:56 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:10:56 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:10:56 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:10:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:10:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:10:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:11:07 user nova-compute[75210]: INFO nova.compute.claims [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Claim successful on node user
Nov 29 02:11:07 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:11:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:11:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG nova.policy [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c401b408dbfd40abb3d75d44a56d0e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ac2027baf41d6bfe9db163fe672f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:11:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Creating image(s)
Nov 29 02:11:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "/opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "/opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "5188f8a2a6ceda9a6c5433dbf26e6357bc84b664" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "5188f8a2a6ceda9a6c5433dbf26e6357bc84b664" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664.part --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Successfully created port: d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "51f35c78-7012-45df-9036-a88ac0433fc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "51f35c78-7012-45df-9036-a88ac0433fc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.virt.images [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] a50c7532-d681-41c1-bb4c-54e19f2d6620 was qcow2, converting to raw {{(pid=75210) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664.part /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664.converted {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:11:08 user nova-compute[75210]: INFO nova.compute.claims [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Claim successful on node user
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664.part /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664.converted" returned: 0 in 0.398s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664.converted --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:11:08 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "5188f8a2a6ceda9a6c5433dbf26e6357bc84b664" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.151s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.policy [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc97635cf0684427b552af6ea29e5ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eeb31f8c5e4610a53597d0c38f4c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Successfully updated port: d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquired lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-3de5baba-ea1a-4eb7-b63f-068164719579 req-91ca3439-ec6f-4e71-9910-6510fb32aa75 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-changed-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-3de5baba-ea1a-4eb7-b63f-068164719579 req-91ca3439-ec6f-4e71-9910-6510fb32aa75 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Refreshing instance network info cache due to event network-changed-d4aeab3f-f791-43b6-8309-2faff06c372c. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3de5baba-ea1a-4eb7-b63f-068164719579 req-91ca3439-ec6f-4e71-9910-6510fb32aa75 service nova] Acquiring lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:11:08 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Creating image(s)
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "/opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "/opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "/opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664 --force-share --output=json" returned: 0 in 0.194s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "5188f8a2a6ceda9a6c5433dbf26e6357bc84b664" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "5188f8a2a6ceda9a6c5433dbf26e6357bc84b664" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664 --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664,backing_fmt=raw /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664,backing_fmt=raw /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk 1073741824" returned: 0 in 0.053s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "5188f8a2a6ceda9a6c5433dbf26e6357bc84b664" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.186s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk 1073741824" returned: 0 in 0.066s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664 --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updating instance_info_cache with network_info: [{"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Releasing lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Instance network_info: |[{"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3de5baba-ea1a-4eb7-b63f-068164719579 req-91ca3439-ec6f-4e71-9910-6510fb32aa75 service nova] Acquired lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.network.neutron [req-3de5baba-ea1a-4eb7-b63f-068164719579 req-91ca3439-ec6f-4e71-9910-6510fb32aa75 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Refreshing network info cache for port d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Cannot resize image /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Ensure instance console log exists: /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Start _get_guest_xml network_info=[{"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T02:11:04Z,direct_url=<?>,disk_format='qcow2',id=a50c7532-d681-41c1-bb4c-54e19f2d6620,min_disk=0,min_ram=0,name='tempest-scenario-img--420674007',owner='912ac2027baf41d6bfe9db163fe672f6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T02:11:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': 'a50c7532-d681-41c1-bb4c-54e19f2d6620'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:11:09 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:11:09 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T02:11:04Z,direct_url=<?>,disk_format='qcow2',id=a50c7532-d681-41c1-bb4c-54e19f2d6620,min_disk=0,min_ram=0,name='tempest-scenario-img--420674007',owner='912ac2027baf41d6bfe9db163fe672f6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T02:11:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1681739102',display_name='tempest-TestMinimumBasicScenario-server-1681739102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1681739102',id=49,image_ref='a50c7532-d681-41c1-bb4c-54e19f2d6620',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFE9YWpLQ+jIgfd51Ql6tVDm7Uvvks+ZtZ46busjWVEWvoifewvMIwNROH6r3cIs9Wp93SxsJMGDPkgRK2S2mYXjz19TPExjnVGoqJpYEAhRGD+5erIr0cn682A47nxL0Q==',key_name='tempest-TestMinimumBasicScenario-839367194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912ac2027baf41d6bfe9db163fe672f6',ramdisk_id='',reservation_id='r-vr4oo58x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a50c7532-d681-41c1-bb4c-54e19f2d6620',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-717689186',owner_user_name='tempest-TestMinimumBasicScenario-717689186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:11:08Z,user_data=None,user_id='c401b408dbfd40abb3d75d44a56d0e6d',uuid=a2e85f85-ec9b-4db2-b456-b1ef4894df6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converting VIF {"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'pci_devices' on Instance uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:11:09 user nova-compute[75210]:   <uuid>a2e85f85-ec9b-4db2-b456-b1ef4894df6a</uuid>
Nov 29 02:11:09 user nova-compute[75210]:   <name>instance-00000031</name>
Nov 29 02:11:09 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:11:09 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:11:09 user nova-compute[75210]:   <metadata>
Nov 29 02:11:09 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:11:09 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:11:09 user nova-compute[75210]:       <nova:name>tempest-TestMinimumBasicScenario-server-1681739102</nova:name>
Nov 29 02:11:09 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:11:09</nova:creationTime>
Nov 29 02:11:09 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:11:09 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:11:09 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:11:09 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:11:09 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:11:09 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:11:09 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:11:09 user nova-compute[75210]:       <nova:owner>
Nov 29 02:11:09 user nova-compute[75210]:         <nova:user uuid="c401b408dbfd40abb3d75d44a56d0e6d">tempest-TestMinimumBasicScenario-717689186-project-member</nova:user>
Nov 29 02:11:09 user nova-compute[75210]:         <nova:project uuid="912ac2027baf41d6bfe9db163fe672f6">tempest-TestMinimumBasicScenario-717689186</nova:project>
Nov 29 02:11:09 user nova-compute[75210]:       </nova:owner>
Nov 29 02:11:09 user nova-compute[75210]:       <nova:root type="image" uuid="a50c7532-d681-41c1-bb4c-54e19f2d6620"/>
Nov 29 02:11:09 user nova-compute[75210]:       <nova:ports>
Nov 29 02:11:09 user nova-compute[75210]:         <nova:port uuid="d4aeab3f-f791-43b6-8309-2faff06c372c">
Nov 29 02:11:09 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 02:11:09 user nova-compute[75210]:         </nova:port>
Nov 29 02:11:09 user nova-compute[75210]:       </nova:ports>
Nov 29 02:11:09 user nova-compute[75210]:     </nova:instance>
Nov 29 02:11:09 user nova-compute[75210]:   </metadata>
Nov 29 02:11:09 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:11:09 user nova-compute[75210]:     <system>
Nov 29 02:11:09 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:11:09 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:11:09 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:11:09 user nova-compute[75210]:       <entry name="serial">a2e85f85-ec9b-4db2-b456-b1ef4894df6a</entry>
Nov 29 02:11:09 user nova-compute[75210]:       <entry name="uuid">a2e85f85-ec9b-4db2-b456-b1ef4894df6a</entry>
Nov 29 02:11:09 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:11:09 user nova-compute[75210]:     </system>
Nov 29 02:11:09 user nova-compute[75210]:   </sysinfo>
Nov 29 02:11:09 user nova-compute[75210]:   <os>
Nov 29 02:11:09 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:11:09 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:11:09 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:11:09 user nova-compute[75210]:   </os>
Nov 29 02:11:09 user nova-compute[75210]:   <features>
Nov 29 02:11:09 user nova-compute[75210]:     <acpi/>
Nov 29 02:11:09 user nova-compute[75210]:     <apic/>
Nov 29 02:11:09 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:11:09 user nova-compute[75210]:   </features>
Nov 29 02:11:09 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:11:09 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:11:09 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:11:09 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:11:09 user nova-compute[75210]:   </clock>
Nov 29 02:11:09 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:11:09 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:11:09 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:11:09 user nova-compute[75210]:   </cpu>
Nov 29 02:11:09 user nova-compute[75210]:   <devices>
Nov 29 02:11:09 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:11:09 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:11:09 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk"/>
Nov 29 02:11:09 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:11:09 user nova-compute[75210]:     </disk>
Nov 29 02:11:09 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:11:09 user nova-compute[75210]:       <mac address="fa:16:3e:ef:ca:f9"/>
Nov 29 02:11:09 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:11:09 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:11:09 user nova-compute[75210]:       <target dev="tapd4aeab3f-f7"/>
Nov 29 02:11:09 user nova-compute[75210]:     </interface>
Nov 29 02:11:09 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:11:09 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/console.log" append="off"/>
Nov 29 02:11:09 user nova-compute[75210]:     </serial>
Nov 29 02:11:09 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:11:09 user nova-compute[75210]:     <video>
Nov 29 02:11:09 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:11:09 user nova-compute[75210]:     </video>
Nov 29 02:11:09 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:11:09 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:11:09 user nova-compute[75210]:     </rng>
Nov 29 02:11:09 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:11:09 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:11:09 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:11:09 user nova-compute[75210]:     </memballoon>
Nov 29 02:11:09 user nova-compute[75210]:   </devices>
Nov 29 02:11:09 user nova-compute[75210]: </domain>
Nov 29 02:11:09 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1681739102',display_name='tempest-TestMinimumBasicScenario-server-1681739102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1681739102',id=49,image_ref='a50c7532-d681-41c1-bb4c-54e19f2d6620',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFE9YWpLQ+jIgfd51Ql6tVDm7Uvvks+ZtZ46busjWVEWvoifewvMIwNROH6r3cIs9Wp93SxsJMGDPkgRK2S2mYXjz19TPExjnVGoqJpYEAhRGD+5erIr0cn682A47nxL0Q==',key_name='tempest-TestMinimumBasicScenario-839367194',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912ac2027baf41d6bfe9db163fe672f6',ramdisk_id='',reservation_id='r-vr4oo58x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a50c7532-d681-41c1-bb4c-54e19f2d6620',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-717689186',owner_user_name='tempest-TestMinimumBasicScenario-717689186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:11:08Z,user_data=None,user_id='c401b408dbfd40abb3d75d44a56d0e6d',uuid=a2e85f85-ec9b-4db2-b456-b1ef4894df6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converting VIF {"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG os_vif [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3828c872-6bdf-5095-a894-938b168a91db', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4aeab3f-f7, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4aeab3f-f7, col_values=(('qos', UUID('16e21d08-79c7-43b2-99c1-5ebfe4a4e4fc')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4aeab3f-f7, col_values=(('external_ids', {'iface-id': 'd4aeab3f-f791-43b6-8309-2faff06c372c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:ca:f9', 'vm-uuid': 'a2e85f85-ec9b-4db2-b456-b1ef4894df6a'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:09 user nova-compute[75210]: INFO os_vif [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7')
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.network.neutron [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Successfully created port: 6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Cannot resize image /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Ensure instance console log exists: /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:11:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] No VIF found with MAC fa:16:3e:ef:ca:f9, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:11:10 user nova-compute[75210]: DEBUG nova.network.neutron [req-3de5baba-ea1a-4eb7-b63f-068164719579 req-91ca3439-ec6f-4e71-9910-6510fb32aa75 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updated VIF entry in instance network info cache for port d4aeab3f-f791-43b6-8309-2faff06c372c. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:11:10 user nova-compute[75210]: DEBUG nova.network.neutron [req-3de5baba-ea1a-4eb7-b63f-068164719579 req-91ca3439-ec6f-4e71-9910-6510fb32aa75 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updating instance_info_cache with network_info: [{"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:11:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3de5baba-ea1a-4eb7-b63f-068164719579 req-91ca3439-ec6f-4e71-9910-6510fb32aa75 service nova] Releasing lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:11:10 user nova-compute[75210]: DEBUG nova.network.neutron [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Successfully updated port: 6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:11:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "refresh_cache-51f35c78-7012-45df-9036-a88ac0433fc1" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:11:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquired lock "refresh_cache-51f35c78-7012-45df-9036-a88ac0433fc1" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:11:10 user nova-compute[75210]: DEBUG nova.network.neutron [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:11:10 user nova-compute[75210]: DEBUG nova.network.neutron [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:11:10 user nova-compute[75210]: DEBUG nova.network.neutron [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Updating instance_info_cache with network_info: [{"id": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "address": "fa:16:3e:17:3d:17", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7db7f2-32", "ovs_interfaceid": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-f61aa045-ec01-4b3b-b989-b3129b11430d req-3bac4f4f-23f5-4c85-9d54-8468c6680095 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Received event network-changed-6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-f61aa045-ec01-4b3b-b989-b3129b11430d req-3bac4f4f-23f5-4c85-9d54-8468c6680095 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Refreshing instance network info cache due to event network-changed-6c7db7f2-3297-4464-b2ed-9071afa7af3e. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f61aa045-ec01-4b3b-b989-b3129b11430d req-3bac4f4f-23f5-4c85-9d54-8468c6680095 service nova] Acquiring lock "refresh_cache-51f35c78-7012-45df-9036-a88ac0433fc1" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Releasing lock "refresh_cache-51f35c78-7012-45df-9036-a88ac0433fc1" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Instance network_info: |[{"id": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "address": "fa:16:3e:17:3d:17", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7db7f2-32", "ovs_interfaceid": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f61aa045-ec01-4b3b-b989-b3129b11430d req-3bac4f4f-23f5-4c85-9d54-8468c6680095 service nova] Acquired lock "refresh_cache-51f35c78-7012-45df-9036-a88ac0433fc1" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.network.neutron [req-f61aa045-ec01-4b3b-b989-b3129b11430d req-3bac4f4f-23f5-4c85-9d54-8468c6680095 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Refreshing network info cache for port 6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Start _get_guest_xml network_info=[{"id": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "address": "fa:16:3e:17:3d:17", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7db7f2-32", "ovs_interfaceid": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:11:11 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:11:11 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-507889322',display_name='tempest-VolumesSnapshotTestJSON-instance-507889322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-507889322',id=50,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9b335eGTVb0ubFsf6+1NzxwuPGsavEtHPGG8e3b4W6A4rR0UMf4PyRbk6/wCinZIQKhX3Fsg39GFeEtaKJarsg0JgWr2B2bXtEIfMmMOIHj3Nz9lvj8hDO9n8O5uE+8w==',key_name='tempest-keypair-2033507639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8eeb31f8c5e4610a53597d0c38f4c90',ramdisk_id='',reservation_id='r-o1if72l7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2023644237',owner_user_name='tempest-VolumesSnapshotTestJSON-2023644237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc97635cf0684427b552af6ea29e5ccc',uuid=51f35c78-7012-45df-9036-a88ac0433fc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "address": "fa:16:3e:17:3d:17", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7db7f2-32", "ovs_interfaceid": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Converting VIF {"id": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "address": "fa:16:3e:17:3d:17", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7db7f2-32", "ovs_interfaceid": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=6c7db7f2-3297-4464-b2ed-9071afa7af3e,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7db7f2-32') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.objects.instance [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lazy-loading 'pci_devices' on Instance uuid 51f35c78-7012-45df-9036-a88ac0433fc1 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:11:11 user nova-compute[75210]:   <uuid>51f35c78-7012-45df-9036-a88ac0433fc1</uuid>
Nov 29 02:11:11 user nova-compute[75210]:   <name>instance-00000032</name>
Nov 29 02:11:11 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:11:11 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:11:11 user nova-compute[75210]:   <metadata>
Nov 29 02:11:11 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:11:11 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:11:11 user nova-compute[75210]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-507889322</nova:name>
Nov 29 02:11:11 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:11:11</nova:creationTime>
Nov 29 02:11:11 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:11:11 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:11:11 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:11:11 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:11:11 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:11:11 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:11:11 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:11:11 user nova-compute[75210]:       <nova:owner>
Nov 29 02:11:11 user nova-compute[75210]:         <nova:user uuid="dc97635cf0684427b552af6ea29e5ccc">tempest-VolumesSnapshotTestJSON-2023644237-project-member</nova:user>
Nov 29 02:11:11 user nova-compute[75210]:         <nova:project uuid="f8eeb31f8c5e4610a53597d0c38f4c90">tempest-VolumesSnapshotTestJSON-2023644237</nova:project>
Nov 29 02:11:11 user nova-compute[75210]:       </nova:owner>
Nov 29 02:11:11 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 02:11:11 user nova-compute[75210]:       <nova:ports>
Nov 29 02:11:11 user nova-compute[75210]:         <nova:port uuid="6c7db7f2-3297-4464-b2ed-9071afa7af3e">
Nov 29 02:11:11 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 29 02:11:11 user nova-compute[75210]:         </nova:port>
Nov 29 02:11:11 user nova-compute[75210]:       </nova:ports>
Nov 29 02:11:11 user nova-compute[75210]:     </nova:instance>
Nov 29 02:11:11 user nova-compute[75210]:   </metadata>
Nov 29 02:11:11 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:11:11 user nova-compute[75210]:     <system>
Nov 29 02:11:11 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:11:11 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:11:11 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:11:11 user nova-compute[75210]:       <entry name="serial">51f35c78-7012-45df-9036-a88ac0433fc1</entry>
Nov 29 02:11:11 user nova-compute[75210]:       <entry name="uuid">51f35c78-7012-45df-9036-a88ac0433fc1</entry>
Nov 29 02:11:11 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:11:11 user nova-compute[75210]:     </system>
Nov 29 02:11:11 user nova-compute[75210]:   </sysinfo>
Nov 29 02:11:11 user nova-compute[75210]:   <os>
Nov 29 02:11:11 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:11:11 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:11:11 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:11:11 user nova-compute[75210]:   </os>
Nov 29 02:11:11 user nova-compute[75210]:   <features>
Nov 29 02:11:11 user nova-compute[75210]:     <acpi/>
Nov 29 02:11:11 user nova-compute[75210]:     <apic/>
Nov 29 02:11:11 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:11:11 user nova-compute[75210]:   </features>
Nov 29 02:11:11 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:11:11 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:11:11 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:11:11 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:11:11 user nova-compute[75210]:   </clock>
Nov 29 02:11:11 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:11:11 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:11:11 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:11:11 user nova-compute[75210]:   </cpu>
Nov 29 02:11:11 user nova-compute[75210]:   <devices>
Nov 29 02:11:11 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:11:11 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:11:11 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk"/>
Nov 29 02:11:11 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:11:11 user nova-compute[75210]:     </disk>
Nov 29 02:11:11 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:11:11 user nova-compute[75210]:       <mac address="fa:16:3e:17:3d:17"/>
Nov 29 02:11:11 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:11:11 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:11:11 user nova-compute[75210]:       <target dev="tap6c7db7f2-32"/>
Nov 29 02:11:11 user nova-compute[75210]:     </interface>
Nov 29 02:11:11 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:11:11 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/console.log" append="off"/>
Nov 29 02:11:11 user nova-compute[75210]:     </serial>
Nov 29 02:11:11 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:11:11 user nova-compute[75210]:     <video>
Nov 29 02:11:11 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:11:11 user nova-compute[75210]:     </video>
Nov 29 02:11:11 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:11:11 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:11:11 user nova-compute[75210]:     </rng>
Nov 29 02:11:11 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:11:11 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:11:11 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:11:11 user nova-compute[75210]:     </memballoon>
Nov 29 02:11:11 user nova-compute[75210]:   </devices>
Nov 29 02:11:11 user nova-compute[75210]: </domain>
Nov 29 02:11:11 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-507889322',display_name='tempest-VolumesSnapshotTestJSON-instance-507889322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-507889322',id=50,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9b335eGTVb0ubFsf6+1NzxwuPGsavEtHPGG8e3b4W6A4rR0UMf4PyRbk6/wCinZIQKhX3Fsg39GFeEtaKJarsg0JgWr2B2bXtEIfMmMOIHj3Nz9lvj8hDO9n8O5uE+8w==',key_name='tempest-keypair-2033507639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8eeb31f8c5e4610a53597d0c38f4c90',ramdisk_id='',reservation_id='r-o1if72l7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2023644237',owner_user_name='tempest-VolumesSnapshotTestJSON-2023644237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc97635cf0684427b552af6ea29e5ccc',uuid=51f35c78-7012-45df-9036-a88ac0433fc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "address": "fa:16:3e:17:3d:17", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7db7f2-32", "ovs_interfaceid": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Converting VIF {"id": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "address": "fa:16:3e:17:3d:17", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7db7f2-32", "ovs_interfaceid": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=6c7db7f2-3297-4464-b2ed-9071afa7af3e,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7db7f2-32') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG os_vif [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=6c7db7f2-3297-4464-b2ed-9071afa7af3e,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7db7f2-32') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e780aef-48f1-54df-87c0-cccdd72d0211', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c7db7f2-32, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c7db7f2-32, col_values=(('qos', UUID('2dd8ba52-0b33-498d-b46a-cf9269df1d46')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c7db7f2-32, col_values=(('external_ids', {'iface-id': '6c7db7f2-3297-4464-b2ed-9071afa7af3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:3d:17', 'vm-uuid': '51f35c78-7012-45df-9036-a88ac0433fc1'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:11 user nova-compute[75210]: INFO os_vif [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=6c7db7f2-3297-4464-b2ed-9071afa7af3e,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7db7f2-32')
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] No VIF found with MAC fa:16:3e:17:3d:17, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.network.neutron [req-f61aa045-ec01-4b3b-b989-b3129b11430d req-3bac4f4f-23f5-4c85-9d54-8468c6680095 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Updated VIF entry in instance network info cache for port 6c7db7f2-3297-4464-b2ed-9071afa7af3e. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG nova.network.neutron [req-f61aa045-ec01-4b3b-b989-b3129b11430d req-3bac4f4f-23f5-4c85-9d54-8468c6680095 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Updating instance_info_cache with network_info: [{"id": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "address": "fa:16:3e:17:3d:17", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7db7f2-32", "ovs_interfaceid": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f61aa045-ec01-4b3b-b989-b3129b11430d req-3bac4f4f-23f5-4c85-9d54-8468c6680095 service nova] Releasing lock "refresh_cache-51f35c78-7012-45df-9036-a88ac0433fc1" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-5b8a77ad-8fd8-4a09-aaa3-253498762e84 req-64d3b4d3-88c4-491a-9325-8417d4472665 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Received event network-vif-plugged-6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5b8a77ad-8fd8-4a09-aaa3-253498762e84 req-64d3b4d3-88c4-491a-9325-8417d4472665 service nova] Acquiring lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5b8a77ad-8fd8-4a09-aaa3-253498762e84 req-64d3b4d3-88c4-491a-9325-8417d4472665 service nova] Lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5b8a77ad-8fd8-4a09-aaa3-253498762e84 req-64d3b4d3-88c4-491a-9325-8417d4472665 service nova] Lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-5b8a77ad-8fd8-4a09-aaa3-253498762e84 req-64d3b4d3-88c4-491a-9325-8417d4472665 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] No waiting events found dispatching network-vif-plugged-6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:11:12 user nova-compute[75210]: WARNING nova.compute.manager [req-5b8a77ad-8fd8-4a09-aaa3-253498762e84 req-64d3b4d3-88c4-491a-9325-8417d4472665 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Received unexpected event network-vif-plugged-6c7db7f2-3297-4464-b2ed-9071afa7af3e for instance with vm_state building and task_state spawning.
Nov 29 02:11:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-3aa285fb-2120-4740-acd5-2ccc0f800f87 req-4268112e-212b-40f7-86ec-40e8a2c331fa service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3aa285fb-2120-4740-acd5-2ccc0f800f87 req-4268112e-212b-40f7-86ec-40e8a2c331fa service nova] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3aa285fb-2120-4740-acd5-2ccc0f800f87 req-4268112e-212b-40f7-86ec-40e8a2c331fa service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3aa285fb-2120-4740-acd5-2ccc0f800f87 req-4268112e-212b-40f7-86ec-40e8a2c331fa service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-3aa285fb-2120-4740-acd5-2ccc0f800f87 req-4268112e-212b-40f7-86ec-40e8a2c331fa service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] No waiting events found dispatching network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:11:13 user nova-compute[75210]: WARNING nova.compute.manager [req-3aa285fb-2120-4740-acd5-2ccc0f800f87 req-4268112e-212b-40f7-86ec-40e8a2c331fa service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received unexpected event network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c for instance with vm_state building and task_state spawning.
Nov 29 02:11:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-3aa285fb-2120-4740-acd5-2ccc0f800f87 req-4268112e-212b-40f7-86ec-40e8a2c331fa service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3aa285fb-2120-4740-acd5-2ccc0f800f87 req-4268112e-212b-40f7-86ec-40e8a2c331fa service nova] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3aa285fb-2120-4740-acd5-2ccc0f800f87 req-4268112e-212b-40f7-86ec-40e8a2c331fa service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3aa285fb-2120-4740-acd5-2ccc0f800f87 req-4268112e-212b-40f7-86ec-40e8a2c331fa service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-3aa285fb-2120-4740-acd5-2ccc0f800f87 req-4268112e-212b-40f7-86ec-40e8a2c331fa service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] No waiting events found dispatching network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:11:13 user nova-compute[75210]: WARNING nova.compute.manager [req-3aa285fb-2120-4740-acd5-2ccc0f800f87 req-4268112e-212b-40f7-86ec-40e8a2c331fa service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received unexpected event network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c for instance with vm_state building and task_state spawning.
Nov 29 02:11:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:11:14 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Instance spawned successfully.
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:11:14 user nova-compute[75210]: INFO nova.compute.manager [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Took 6.84 seconds to spawn the instance on the hypervisor.
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:11:14 user nova-compute[75210]: INFO nova.compute.manager [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Took 7.45 seconds to build instance.
Nov 29 02:11:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c9505315-d97b-422f-b89f-64467d330961 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.549s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:11:14 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Instance spawned successfully.
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:11:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:11:15 user nova-compute[75210]: DEBUG nova.compute.manager [req-a26710b9-220b-4824-8197-4f04972f2f44 req-319255e4-cfa8-4e74-9fb8-0b525560050a service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Received event network-vif-plugged-6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a26710b9-220b-4824-8197-4f04972f2f44 req-319255e4-cfa8-4e74-9fb8-0b525560050a service nova] Acquiring lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a26710b9-220b-4824-8197-4f04972f2f44 req-319255e4-cfa8-4e74-9fb8-0b525560050a service nova] Lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a26710b9-220b-4824-8197-4f04972f2f44 req-319255e4-cfa8-4e74-9fb8-0b525560050a service nova] Lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:15 user nova-compute[75210]: DEBUG nova.compute.manager [req-a26710b9-220b-4824-8197-4f04972f2f44 req-319255e4-cfa8-4e74-9fb8-0b525560050a service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] No waiting events found dispatching network-vif-plugged-6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:11:15 user nova-compute[75210]: WARNING nova.compute.manager [req-a26710b9-220b-4824-8197-4f04972f2f44 req-319255e4-cfa8-4e74-9fb8-0b525560050a service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Received unexpected event network-vif-plugged-6c7db7f2-3297-4464-b2ed-9071afa7af3e for instance with vm_state building and task_state spawning.
Nov 29 02:11:15 user nova-compute[75210]: INFO nova.compute.manager [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 29 02:11:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:11:15 user nova-compute[75210]: INFO nova.compute.manager [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Took 6.98 seconds to build instance.
Nov 29 02:11:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-aa57fecb-baae-4ad6-97e0-aca911d48585 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "51f35c78-7012-45df-9036-a88ac0433fc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.098s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:15 user nova-compute[75210]: DEBUG nova.compute.manager [req-b204f96c-7080-4b61-ba61-e4ecb20b0c32 req-b24ed201-b848-4742-a3d6-efe31fb588dc service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-changed-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:15 user nova-compute[75210]: DEBUG nova.compute.manager [req-b204f96c-7080-4b61-ba61-e4ecb20b0c32 req-b24ed201-b848-4742-a3d6-efe31fb588dc service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Refreshing instance network info cache due to event network-changed-52e85b3f-0dac-43f8-a484-7993e2ac7729. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:11:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b204f96c-7080-4b61-ba61-e4ecb20b0c32 req-b24ed201-b848-4742-a3d6-efe31fb588dc service nova] Acquiring lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:11:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b204f96c-7080-4b61-ba61-e4ecb20b0c32 req-b24ed201-b848-4742-a3d6-efe31fb588dc service nova] Acquired lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:11:15 user nova-compute[75210]: DEBUG nova.network.neutron [req-b204f96c-7080-4b61-ba61-e4ecb20b0c32 req-b24ed201-b848-4742-a3d6-efe31fb588dc service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Refreshing network info cache for port 52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:11:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:16 user nova-compute[75210]: DEBUG nova.network.neutron [req-b204f96c-7080-4b61-ba61-e4ecb20b0c32 req-b24ed201-b848-4742-a3d6-efe31fb588dc service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updated VIF entry in instance network info cache for port 52e85b3f-0dac-43f8-a484-7993e2ac7729. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:11:16 user nova-compute[75210]: DEBUG nova.network.neutron [req-b204f96c-7080-4b61-ba61-e4ecb20b0c32 req-b24ed201-b848-4742-a3d6-efe31fb588dc service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updating instance_info_cache with network_info: [{"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:11:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-b204f96c-7080-4b61-ba61-e4ecb20b0c32 req-b24ed201-b848-4742-a3d6-efe31fb588dc service nova] Releasing lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:11:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:20 user nova-compute[75210]: INFO nova.compute.manager [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Shelving
Nov 29 02:11:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:20 user nova-compute[75210]: DEBUG nova.compute.manager [req-2dfc7d3a-6757-4ccc-998c-00493caa4991 req-6f49b7d2-3646-4de4-a606-9d22abc964c6 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-vif-unplugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2dfc7d3a-6757-4ccc-998c-00493caa4991 req-6f49b7d2-3646-4de4-a606-9d22abc964c6 service nova] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2dfc7d3a-6757-4ccc-998c-00493caa4991 req-6f49b7d2-3646-4de4-a606-9d22abc964c6 service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2dfc7d3a-6757-4ccc-998c-00493caa4991 req-6f49b7d2-3646-4de4-a606-9d22abc964c6 service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:20 user nova-compute[75210]: DEBUG nova.compute.manager [req-2dfc7d3a-6757-4ccc-998c-00493caa4991 req-6f49b7d2-3646-4de4-a606-9d22abc964c6 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] No waiting events found dispatching network-vif-unplugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:11:20 user nova-compute[75210]: WARNING nova.compute.manager [req-2dfc7d3a-6757-4ccc-998c-00493caa4991 req-6f49b7d2-3646-4de4-a606-9d22abc964c6 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received unexpected event network-vif-unplugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 for instance with vm_state active and task_state shelving.
Nov 29 02:11:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:21 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Instance destroyed successfully.
Nov 29 02:11:21 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Beginning cold snapshot process
Nov 29 02:11:21 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 02:11:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk /opt/stack/data/nova/instances/snapshots/tmpt902h3lp/8d6a9abc0ddb4bc496f00b317c95bb60 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk /opt/stack/data/nova/instances/snapshots/tmpt902h3lp/8d6a9abc0ddb4bc496f00b317c95bb60" returned: 0 in 0.622s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:22 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Snapshot extracted, beginning image upload
Nov 29 02:11:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-d777b980-9feb-4a6d-8fb0-4f90bedfbc16 req-98a71da7-a3c4-47e8-8d8e-d153c251d962 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d777b980-9feb-4a6d-8fb0-4f90bedfbc16 req-98a71da7-a3c4-47e8-8d8e-d153c251d962 service nova] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d777b980-9feb-4a6d-8fb0-4f90bedfbc16 req-98a71da7-a3c4-47e8-8d8e-d153c251d962 service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-d777b980-9feb-4a6d-8fb0-4f90bedfbc16 req-98a71da7-a3c4-47e8-8d8e-d153c251d962 service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-d777b980-9feb-4a6d-8fb0-4f90bedfbc16 req-98a71da7-a3c4-47e8-8d8e-d153c251d962 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] No waiting events found dispatching network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:11:22 user nova-compute[75210]: WARNING nova.compute.manager [req-d777b980-9feb-4a6d-8fb0-4f90bedfbc16 req-98a71da7-a3c4-47e8-8d8e-d153c251d962 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received unexpected event network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 for instance with vm_state active and task_state shelving_image_uploading.
Nov 29 02:11:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Snapshot image upload complete
Nov 29 02:11:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:11:24 user nova-compute[75210]: INFO nova.compute.manager [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Shelve offloading
Nov 29 02:11:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Instance destroyed successfully.
Nov 29 02:11:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:11:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:11:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquired lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:11:24 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:11:24 user nova-compute[75210]: DEBUG nova.network.neutron [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updating instance_info_cache with network_info: [{"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:11:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Releasing lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:25 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Instance destroyed successfully.
Nov 29 02:11:25 user nova-compute[75210]: DEBUG nova.objects.instance [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'resources' on Instance uuid 953a63c8-a86d-420c-98fe-bdaa77f85904 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-245300826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-245300826',id=48,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/oV2YiOdLrZqfATbxLr3cZ5gGa2Kz3qZy2t4wfNFvC3WzI4dq8STr3miU4QP3DJkFHguyIAPBNWk6n3gDtLcSqOunITTo/1Aw3sSrsaSfRA5NV9S9D77R1Vk1L+/OX9g==',key_name='tempest-keypair-673500543',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:09:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='55934a4b47ab45a4a7f389919225c156',ramdisk_id='',reservation_id='r-azvatg0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2088736241',owner_user_name='tempest-AttachVolumeShelveTestJSON-2088736241-project-member',shelved_at='2023-11-29T02:11:24.406841',shelved_host='user',shelved_image_id='9bc18d5c-80de-4899-acf1-c7cdfc7858b6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:11:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f7a67a01104567b3e96f9d150dddd2',uuid=953a63c8-a86d-420c-98fe-bdaa77f85904,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converting VIF {"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG os_vif [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52e85b3f-0d, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG nova.compute.manager [req-7f75816f-c72e-4235-bafc-fcae742551c4 req-3e80016b-6015-47dd-ab3b-661cf305b5a5 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-changed-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG nova.compute.manager [req-7f75816f-c72e-4235-bafc-fcae742551c4 req-3e80016b-6015-47dd-ab3b-661cf305b5a5 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Refreshing instance network info cache due to event network-changed-52e85b3f-0dac-43f8-a484-7993e2ac7729. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7f75816f-c72e-4235-bafc-fcae742551c4 req-3e80016b-6015-47dd-ab3b-661cf305b5a5 service nova] Acquiring lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7f75816f-c72e-4235-bafc-fcae742551c4 req-3e80016b-6015-47dd-ab3b-661cf305b5a5 service nova] Acquired lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG nova.network.neutron [req-7f75816f-c72e-4235-bafc-fcae742551c4 req-3e80016b-6015-47dd-ab3b-661cf305b5a5 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Refreshing network info cache for port 52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5b176fa-5b9b-496e-b185-1ed4ab99a59c) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:11:25 user nova-compute[75210]: INFO os_vif [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d')
Nov 29 02:11:25 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Deleting instance files /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904_del
Nov 29 02:11:25 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Deletion of /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904_del complete
Nov 29 02:11:25 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Deleted allocations for instance 953a63c8-a86d-420c-98fe-bdaa77f85904
Nov 29 02:11:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG nova.objects.instance [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'numa_topology' on Instance uuid 953a63c8-a86d-420c-98fe-bdaa77f85904 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG nova.objects.base [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Object Instance<953a63c8-a86d-420c-98fe-bdaa77f85904> lazy-loaded attributes: resources,numa_topology {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG nova.network.neutron [req-7f75816f-c72e-4235-bafc-fcae742551c4 req-3e80016b-6015-47dd-ab3b-661cf305b5a5 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updated VIF entry in instance network info cache for port 52e85b3f-0dac-43f8-a484-7993e2ac7729. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG nova.network.neutron [req-7f75816f-c72e-4235-bafc-fcae742551c4 req-3e80016b-6015-47dd-ab3b-661cf305b5a5 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updating instance_info_cache with network_info: [{"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7f75816f-c72e-4235-bafc-fcae742551c4 req-3e80016b-6015-47dd-ab3b-661cf305b5a5 service nova] Releasing lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:11:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-5f7c7e8d-d197-4fd7-a9ea-2e710ca2348b tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.628s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG nova.compute.manager [req-fc523ab4-950c-4983-826e-c0ad8f479aa9 req-76816a9f-f7a7-45a3-aa76-4d6a596c38e0 service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Received event network-changed-57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG nova.compute.manager [req-fc523ab4-950c-4983-826e-c0ad8f479aa9 req-76816a9f-f7a7-45a3-aa76-4d6a596c38e0 service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Refreshing instance network info cache due to event network-changed-57a63d91-cd0f-42a7-ac0f-d29e291ee465. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fc523ab4-950c-4983-826e-c0ad8f479aa9 req-76816a9f-f7a7-45a3-aa76-4d6a596c38e0 service nova] Acquiring lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fc523ab4-950c-4983-826e-c0ad8f479aa9 req-76816a9f-f7a7-45a3-aa76-4d6a596c38e0 service nova] Acquired lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG nova.network.neutron [req-fc523ab4-950c-4983-826e-c0ad8f479aa9 req-76816a9f-f7a7-45a3-aa76-4d6a596c38e0 service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Refreshing network info cache for port 57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:41 user nova-compute[75210]: INFO nova.compute.manager [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Terminating instance
Nov 29 02:11:41 user nova-compute[75210]: DEBUG nova.compute.manager [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-e230ff3b-ff5a-4b71-939f-3d255f9dfc24 req-41637a12-c668-4284-8a91-c98fdfe1766d service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Received event network-vif-unplugged-57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e230ff3b-ff5a-4b71-939f-3d255f9dfc24 req-41637a12-c668-4284-8a91-c98fdfe1766d service nova] Acquiring lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e230ff3b-ff5a-4b71-939f-3d255f9dfc24 req-41637a12-c668-4284-8a91-c98fdfe1766d service nova] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e230ff3b-ff5a-4b71-939f-3d255f9dfc24 req-41637a12-c668-4284-8a91-c98fdfe1766d service nova] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-e230ff3b-ff5a-4b71-939f-3d255f9dfc24 req-41637a12-c668-4284-8a91-c98fdfe1766d service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] No waiting events found dispatching network-vif-unplugged-57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG nova.compute.manager [req-e230ff3b-ff5a-4b71-939f-3d255f9dfc24 req-41637a12-c668-4284-8a91-c98fdfe1766d service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Received event network-vif-unplugged-57a63d91-cd0f-42a7-ac0f-d29e291ee465 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG nova.network.neutron [req-fc523ab4-950c-4983-826e-c0ad8f479aa9 req-76816a9f-f7a7-45a3-aa76-4d6a596c38e0 service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Updated VIF entry in instance network info cache for port 57a63d91-cd0f-42a7-ac0f-d29e291ee465. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG nova.network.neutron [req-fc523ab4-950c-4983-826e-c0ad8f479aa9 req-76816a9f-f7a7-45a3-aa76-4d6a596c38e0 service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Updating instance_info_cache with network_info: [{"id": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "address": "fa:16:3e:0b:6e:84", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a63d91-cd", "ovs_interfaceid": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-fc523ab4-950c-4983-826e-c0ad8f479aa9 req-76816a9f-f7a7-45a3-aa76-4d6a596c38e0 service nova] Releasing lock "refresh_cache-f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:11:42 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Instance destroyed successfully.
Nov 29 02:11:42 user nova-compute[75210]: DEBUG nova.objects.instance [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lazy-loading 'resources' on Instance uuid f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:06:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-912707013',display_name='tempest-TestVolumeBootPattern-server-912707013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-912707013',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbeEJ035qedgw6ffpy9AgBMNgjtmpEug1BnI4ukxa+OzSVx7eUZOgpnD5Ot84IR7Q55P3We053ESM83PfYsrIt51L3Ie8cNeSPyWbkxkw4BsGC2WohQHJL8Q1MriTltHA==',key_name='tempest-TestVolumeBootPattern-274321318',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:07:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f70d8cbb4232433cbd0db9e9448d897f',ramdisk_id='',reservation_id='r-kq2ou3uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-670838009',owner_user_name='tempest-TestVolumeBootPattern-670838009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:07:06Z,user_data=None,user_id='080bcd228b454b03995b0f3e116df917',uuid=f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "address": "fa:16:3e:0b:6e:84", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a63d91-cd", "ovs_interfaceid": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converting VIF {"id": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "address": "fa:16:3e:0b:6e:84", "network": {"id": "b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-667497619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f70d8cbb4232433cbd0db9e9448d897f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57a63d91-cd", "ovs_interfaceid": "57a63d91-cd0f-42a7-ac0f-d29e291ee465", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:6e:84,bridge_name='br-int',has_traffic_filtering=True,id=57a63d91-cd0f-42a7-ac0f-d29e291ee465,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a63d91-cd') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_vif [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:6e:84,bridge_name='br-int',has_traffic_filtering=True,id=57a63d91-cd0f-42a7-ac0f-d29e291ee465,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a63d91-cd') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57a63d91-cd, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26a276e5-8252-41ed-9239-4427cbf65234) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:11:42 user nova-compute[75210]: INFO os_vif [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:6e:84,bridge_name='br-int',has_traffic_filtering=True,id=57a63d91-cd0f-42a7-ac0f-d29e291ee465,network=Network(b016f8f2-ffbe-4ff8-9d5d-db4c8bbe2b4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57a63d91-cd')
Nov 29 02:11:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpNytGVo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:11:42 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bb6357-58c4-4413-8935-c679ff03ca50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:11:42 user nova-compute[75210]: No targets found.
Nov 29 02:11:42 user nova-compute[75210]: iSNS:
Nov 29 02:11:42 user nova-compute[75210]: No targets found.
Nov 29 02:11:42 user nova-compute[75210]: STATIC:
Nov 29 02:11:42 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18
Nov 29 02:11:42 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:11:42 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:11:42 user nova-compute[75210]: FIRMWARE:
Nov 29 02:11:42 user nova-compute[75210]: No targets found.
Nov 29 02:11:42 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:11:42 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:11:42 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a911b8fe-7b74-4842-a32f-6fa4b49b8c89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ea3d6a-a422-434d-a9fe-1884301a2209]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:11:42 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 (non-flash)
Nov 29 02:11:42 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4d2dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18'): ({'sdd'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Removing single pathed devices sdd {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1358303d-47fd-4da9-baed-80d61c3cd95e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[25794860-1326-41d7-87b9-f37bbd4009be]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Flushing IO for device /dev/sdd {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f021a5-86f8-4f9d-aa4c-f1c82a4a2d06]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b95069c-bb69-4170-aa47-d89bddfaf2e2]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] SCSI volumes sdd have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a4ac125d', '/dev/disk/by-id/scsi-1SCST_BIOa4ac125d-97a7ec7db6257116', '/dev/disk/by-id/scsi-23937613765633764') {{(pid=85542) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32c0afd-198d-4dda-9133-801182bb0ddb]: (4, None) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c84e6c-ee93-4ef6-81c5-1e25e326de5a]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[54643b9d-150f-4fb2-a3ce-ebfd6f8fb50d]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260]
Nov 29 02:11:42 user nova-compute[75210]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18, portal: 172.16.0.220,3260] successful.
Nov 29 02:11:42 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85345339-62fb-4ea2-93e5-5ece2bae3b18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[620e3f76-6de4-4fae-bdec-04a4c537d07b]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] <== disconnect_volume: return (285ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:11:42 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Deleting instance files /opt/stack/data/nova/instances/f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d_del
Nov 29 02:11:42 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Deletion of /opt/stack/data/nova/instances/f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d_del complete
Nov 29 02:11:42 user nova-compute[75210]: INFO nova.compute.manager [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 29 02:11:42 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:11:42 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:11:43 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:11:43 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Took 0.45 seconds to deallocate network for instance.
Nov 29 02:11:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-2b6b6dd8-df63-4bb3-b3f4-e4b7604c090e req-7cef512a-7d66-46d4-bafd-4074ecd9d502 service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Received event network-vif-deleted-57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:43 user nova-compute[75210]: INFO nova.compute.manager [req-2b6b6dd8-df63-4bb3-b3f4-e4b7604c090e req-7cef512a-7d66-46d4-bafd-4074ecd9d502 service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Neutron deleted interface 57a63d91-cd0f-42a7-ac0f-d29e291ee465; detaching it from the instance and deleting it from the info cache
Nov 29 02:11:43 user nova-compute[75210]: DEBUG nova.network.neutron [req-2b6b6dd8-df63-4bb3-b3f4-e4b7604c090e req-7cef512a-7d66-46d4-bafd-4074ecd9d502 service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:11:43 user nova-compute[75210]: DEBUG nova.compute.manager [req-2b6b6dd8-df63-4bb3-b3f4-e4b7604c090e req-7cef512a-7d66-46d4-bafd-4074ecd9d502 service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Detach interface failed, port_id=57a63d91-cd0f-42a7-ac0f-d29e291ee465, reason: Instance f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 02:11:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-53a551a3-c3a1-4856-a50c-f3c04d1357f5 req-61ff5c07-0fb5-4dba-83cc-6198bac5b99f service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Received event network-vif-plugged-57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:11:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-53a551a3-c3a1-4856-a50c-f3c04d1357f5 req-61ff5c07-0fb5-4dba-83cc-6198bac5b99f service nova] Acquiring lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-53a551a3-c3a1-4856-a50c-f3c04d1357f5 req-61ff5c07-0fb5-4dba-83cc-6198bac5b99f service nova] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-53a551a3-c3a1-4856-a50c-f3c04d1357f5 req-61ff5c07-0fb5-4dba-83cc-6198bac5b99f service nova] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:44 user nova-compute[75210]: DEBUG nova.compute.manager [req-53a551a3-c3a1-4856-a50c-f3c04d1357f5 req-61ff5c07-0fb5-4dba-83cc-6198bac5b99f service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] No waiting events found dispatching network-vif-plugged-57a63d91-cd0f-42a7-ac0f-d29e291ee465 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:11:44 user nova-compute[75210]: WARNING nova.compute.manager [req-53a551a3-c3a1-4856-a50c-f3c04d1357f5 req-61ff5c07-0fb5-4dba-83cc-6198bac5b99f service nova] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Received unexpected event network-vif-plugged-57a63d91-cd0f-42a7-ac0f-d29e291ee465 for instance with vm_state active and task_state deleting.
Nov 29 02:11:44 user nova-compute[75210]: INFO nova.compute.manager [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] [instance: f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d] Took 0.73 seconds to detach 1 volumes for instance.
Nov 29 02:11:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:44 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:11:44 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:11:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:44 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Deleted allocations for instance f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d
Nov 29 02:11:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-48bc71ad-692f-41b4-b235-6644e6971a53 tempest-TestVolumeBootPattern-670838009 tempest-TestVolumeBootPattern-670838009-project-member] Lock "f89578d1-aafb-4cdc-a6c3-8579b5ecbe4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.686s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:45 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:11:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:11:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:48 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:11:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:11:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:11:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:11:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:11:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:11:48 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:11:48 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updating instance_info_cache with network_info: [{"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:11:48 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:11:48 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:11:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:11:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:11:51 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:11:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:11:53 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:11:53 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:11:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:11:56 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:11:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:11:56 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:11:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:11:57 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:11:57 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:11:57 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8627MB free_disk=25.012481689453125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance a2e85f85-ec9b-4db2-b456-b1ef4894df6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 51f35c78-7012-45df-9036-a88ac0433fc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:11:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:12:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:12:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Verify base images {{(pid=75210) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Image id 7071ee05-5aa5-4613-b78b-8f17b0ec59bc yields fingerprint f9b181358d6e12401ff067a4ff508cef838edbd8 {{(pid=75210) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 02:12:10 user nova-compute[75210]: INFO nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] image 7071ee05-5aa5-4613-b78b-8f17b0ec59bc at (/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8): checking
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] image 7071ee05-5aa5-4613-b78b-8f17b0ec59bc at (/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8): image is in use {{(pid=75210) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75210) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Image id a50c7532-d681-41c1-bb4c-54e19f2d6620 yields fingerprint 5188f8a2a6ceda9a6c5433dbf26e6357bc84b664 {{(pid=75210) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 29 02:12:10 user nova-compute[75210]: INFO nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] image a50c7532-d681-41c1-bb4c-54e19f2d6620 at (/opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664): checking
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] image a50c7532-d681-41c1-bb4c-54e19f2d6620 at (/opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664): image is in use {{(pid=75210) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] 51f35c78-7012-45df-9036-a88ac0433fc1 is a valid instance name {{(pid=75210) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] 51f35c78-7012-45df-9036-a88ac0433fc1 has a disk file {{(pid=75210) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 51f35c78-7012-45df-9036-a88ac0433fc1 is backed by f9b181358d6e12401ff067a4ff508cef838edbd8 {{(pid=75210) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] a2e85f85-ec9b-4db2-b456-b1ef4894df6a is a valid instance name {{(pid=75210) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] a2e85f85-ec9b-4db2-b456-b1ef4894df6a has a disk file {{(pid=75210) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance a2e85f85-ec9b-4db2-b456-b1ef4894df6a is backed by 5188f8a2a6ceda9a6c5433dbf26e6357bc84b664 {{(pid=75210) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 29 02:12:10 user nova-compute[75210]: WARNING nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Unknown base file: /opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2
Nov 29 02:12:10 user nova-compute[75210]: WARNING nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Unknown base file: /opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f
Nov 29 02:12:10 user nova-compute[75210]: WARNING nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Unknown base file: /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62
Nov 29 02:12:10 user nova-compute[75210]: WARNING nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Unknown base file: /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb
Nov 29 02:12:10 user nova-compute[75210]: WARNING nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Unknown base file: /opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5
Nov 29 02:12:10 user nova-compute[75210]: WARNING nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Unknown base file: /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5
Nov 29 02:12:10 user nova-compute[75210]: INFO nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Active base files: /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664
Nov 29 02:12:10 user nova-compute[75210]: INFO nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Removable base files: /opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2 /opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62 /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb /opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5 /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5
Nov 29 02:12:10 user nova-compute[75210]: INFO nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e1fa1ab8112b2634631d09050abc90d04a72b8b2
Nov 29 02:12:10 user nova-compute[75210]: INFO nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6867d81137c063bdbdaa6ed095076fd1fb11d90f
Nov 29 02:12:10 user nova-compute[75210]: INFO nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8cb6d9aefb62b86ca4007043af38b63d8a2c1c62
Nov 29 02:12:10 user nova-compute[75210]: INFO nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/11977382a99d9d182e0fc0150fea834ea7f9ccdb
Nov 29 02:12:10 user nova-compute[75210]: INFO nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/22880aeb1789ea0ee8244ab3eac089e19c8a6ff5
Nov 29 02:12:10 user nova-compute[75210]: INFO nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/597d766c9840d65bcfbfa75e9ee2f7caad1679f5
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Verification complete {{(pid=75210) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Verify swap images {{(pid=75210) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 29 02:12:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.imagecache [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Verify ephemeral images {{(pid=75210) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 29 02:12:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:12:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:12:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:12:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:12:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:12:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:12:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:12:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:12:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:12:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:12:46 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:12:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:12:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:12:49 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:12:49 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:12:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:12:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:12:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-51f35c78-7012-45df-9036-a88ac0433fc1" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:12:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-51f35c78-7012-45df-9036-a88ac0433fc1" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:12:50 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:12:51 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Updating instance_info_cache with network_info: [{"id": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "address": "fa:16:3e:17:3d:17", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7db7f2-32", "ovs_interfaceid": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:12:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-51f35c78-7012-45df-9036-a88ac0433fc1" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:12:51 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:12:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:12:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:12:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:12:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:12:53 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:12:55 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:12:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:12:56 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:12:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:12:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:12:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:12:56 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:12:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:12:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:12:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:12:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:12:56 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:12:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:12:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:12:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:12:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:12:57 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:12:57 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:12:57 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=25.002994537353516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:12:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:12:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:12:57 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance a2e85f85-ec9b-4db2-b456-b1ef4894df6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:12:57 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 51f35c78-7012-45df-9036-a88ac0433fc1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:12:57 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:12:57 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:12:57 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing inventories for resource provider 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 02:12:58 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating ProviderTree inventory for provider 28871a06-d5c8-43d0-87af-3689cd143011 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 02:12:58 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating inventory in ProviderTree for provider 28871a06-d5c8-43d0-87af-3689cd143011 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 02:12:58 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing aggregate associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, aggregates: None {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 02:12:58 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing trait associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, traits: HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 02:12:58 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:12:58 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:12:58 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:12:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:12:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-65b5bbf2-e577-4289-a472-ec92df0a066d req-884ea40f-2c6c-45eb-9cac-99d9b86b8688 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Received event network-changed-6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:12:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-65b5bbf2-e577-4289-a472-ec92df0a066d req-884ea40f-2c6c-45eb-9cac-99d9b86b8688 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Refreshing instance network info cache due to event network-changed-6c7db7f2-3297-4464-b2ed-9071afa7af3e. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:12:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-65b5bbf2-e577-4289-a472-ec92df0a066d req-884ea40f-2c6c-45eb-9cac-99d9b86b8688 service nova] Acquiring lock "refresh_cache-51f35c78-7012-45df-9036-a88ac0433fc1" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:12:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-65b5bbf2-e577-4289-a472-ec92df0a066d req-884ea40f-2c6c-45eb-9cac-99d9b86b8688 service nova] Acquired lock "refresh_cache-51f35c78-7012-45df-9036-a88ac0433fc1" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:12:58 user nova-compute[75210]: DEBUG nova.network.neutron [req-65b5bbf2-e577-4289-a472-ec92df0a066d req-884ea40f-2c6c-45eb-9cac-99d9b86b8688 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Refreshing network info cache for port 6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "51f35c78-7012-45df-9036-a88ac0433fc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "51f35c78-7012-45df-9036-a88ac0433fc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG nova.objects.instance [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lazy-loading 'flavor' on Instance uuid 51f35c78-7012-45df-9036-a88ac0433fc1 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:12:59 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Ignoring supplied device name: /dev/vdb
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "51f35c78-7012-45df-9036-a88ac0433fc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "51f35c78-7012-45df-9036-a88ac0433fc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "51f35c78-7012-45df-9036-a88ac0433fc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:12:59 user nova-compute[75210]: INFO nova.compute.manager [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Attaching volume d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 to /dev/vdb
Nov 29 02:12:59 user nova-compute[75210]: DEBUG nova.network.neutron [req-65b5bbf2-e577-4289-a472-ec92df0a066d req-884ea40f-2c6c-45eb-9cac-99d9b86b8688 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Updated VIF entry in instance network info cache for port 6c7db7f2-3297-4464-b2ed-9071afa7af3e. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG nova.network.neutron [req-65b5bbf2-e577-4289-a472-ec92df0a066d req-884ea40f-2c6c-45eb-9cac-99d9b86b8688 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Updating instance_info_cache with network_info: [{"id": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "address": "fa:16:3e:17:3d:17", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7db7f2-32", "ovs_interfaceid": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG os_brick.utils [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-65b5bbf2-e577-4289-a472-ec92df0a066d req-884ea40f-2c6c-45eb-9cac-99d9b86b8688 service nova] Releasing lock "refresh_cache-51f35c78-7012-45df-9036-a88ac0433fc1" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[534f3a87-c174-49d4-938d-c0f2270ae98c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8562e76b-3d74-4c43-b947-fe38c67c0a1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ccfdc5-f03c-4bdb-a072-978549020fd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7716c189-51a0-48bf-b014-99ede8f666b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:12:59 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:12:59 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcdd73f-91cf-4542-afeb-21f160a3a576]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG os_brick.utils [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:12:59 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Updating existing volume attachment record: 8001887d-aa88-48e6-a6b9-6f7a302110b2 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:13:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:00 user nova-compute[75210]: DEBUG nova.objects.instance [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'flavor' on Instance uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:00 user nova-compute[75210]: INFO nova.compute.manager [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Attaching volume 4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 to /dev/vdb
Nov 29 02:13:01 user nova-compute[75210]: DEBUG os_brick.utils [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4916f327-dcb6-4f2c-bb00-f315d9cb9632]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3ac677-55b4-495e-8101-1fd1c41a12a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ad7c4f-30f4-47f4-9e91-37e26d49deca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd57805-aa9c-455f-8f33-1d24f88b5dc7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:13:01 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[61599d7e-afcd-45cc-8505-9b175b9a7d31]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG os_brick.utils [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updating existing volume attachment record: f2c65338-b2f9-438f-94af-e4e7742b60d9 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances with incomplete migration  {{(pid=75210) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 02:13:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfWxNyJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:13:06 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:13:06 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:13:06 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c290bbe3-77f1-40c1-850b-ad7527ad34f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:13:06 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a710d2a3-8825-4946-accd-30302f8a7160]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7] added
Nov 29 02:13:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c07b8e-0ecc-4e78-bf8d-1da1540485a9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e614c595-5b82-49ec-a8e0-33b1e67bd24f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfWxNyJR {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfWxNyJR" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[947e1a26-3761-495c-b522-34228c452921]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OfWxNyJR'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46a4edb-d121-4b7a-a378-afa5116200a6]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05a7c52-0a92-4448-b3a9-970acdbb11ba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:13:06 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:13:06 user nova-compute[75210]:  {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:13:06 user nova-compute[75210]: WARNING os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 02:13:06 user nova-compute[75210]: 
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50b875a-793b-415c-8cf8-c51492c0ffb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7, portal: 172.16.0.220,3260]
Nov 29 02:13:06 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7, portal: 172.16.0.220,3260] successful.
Nov 29 02:13:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1aed315-9562-4754-9956-5d8b9923e6db]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0408b4-36b7-4ba5-8f43-f97f6765f72f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:13:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:13:06 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed61370-0532-4d9e-81c0-13ad257198f8]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:06 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:13:07 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:13:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 02:13:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] There are 0 instances to clean {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 02:13:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:07 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:13:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfWxNyJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:13:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:13:07 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26364333831313862', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:13:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364333831313862', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:13:07 user nova-compute[75210]: DEBUG nova.objects.instance [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lazy-loading 'flavor' on Instance uuid 51f35c78-7012-45df-9036-a88ac0433fc1 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 02:13:07 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:13:07 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:13:07 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:13:07 user nova-compute[75210]:   <serial>d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7</serial>
Nov 29 02:13:07 user nova-compute[75210]: </disk>
Nov 29 02:13:07 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] No VIF found with MAC fa:16:3e:17:3d:17, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzoPpYGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:13:08 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:13:08 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:13:08 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f5c351-dd38-4e39-82e4-5f8ccdf17938]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:13:08 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[776f8742-0f1f-4d22-8e1c-e1a1c1862d6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7] added
Nov 29 02:13:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72cb8aa-59c0-4ff9-8de9-85de88e9d522]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-b25c1a60-5452-47d1-8dfd-c4636ff8c3b9 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "51f35c78-7012-45df-9036-a88ac0433fc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.067s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ad95a3-edb5-48c5-a297-8dfaa6d2234d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rzoPpYGU {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rzoPpYGU" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca9e550-183e-46ef-8ac4-1ae87f09dfad]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rzoPpYGU'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ebd8ea-59aa-4692-9dee-f2d0033faff0]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a19e1a-305e-4010-921e-43a42fe4f428]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:13:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:13:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a156da3-7542-4a68-a275-82c0b6dd8fd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260]
Nov 29 02:13:08 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260] successful.
Nov 29 02:13:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfc49c0-7d6b-4207-a9f8-1d4bed00c349]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea393749-54c8-494e-a3d0-adb56dd0e2ba]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:13:08 user nova-compute[75210]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)
Nov 29 02:13:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:13:08 user nova-compute[75210]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)
Nov 29 02:13:08 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ab0114-70a7-4b2f-8d7a-bd9322c5eb33]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:08 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:13:09 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:13:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzoPpYGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:13:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:13:09 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23339666434306236', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:13:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339666434306236', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:13:09 user nova-compute[75210]: DEBUG nova.objects.instance [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'flavor' on Instance uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 02:13:09 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:13:09 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 02:13:09 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:13:09 user nova-compute[75210]:   <serial>4e6bd910-c1e0-478f-8a72-ffa4055bcdf7</serial>
Nov 29 02:13:09 user nova-compute[75210]: </disk>
Nov 29 02:13:09 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 02:13:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:13:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:13:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] No VIF found with MAC fa:16:3e:ef:ca:f9, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:13:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-77af8196-c1ed-45b7-b281-d08e5119ff35 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.398s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:12 user nova-compute[75210]: INFO nova.compute.manager [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Unshelving
Nov 29 02:13:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:13 user nova-compute[75210]: DEBUG nova.objects.instance [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'pci_requests' on Instance uuid 953a63c8-a86d-420c-98fe-bdaa77f85904 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:13 user nova-compute[75210]: DEBUG nova.objects.instance [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'numa_topology' on Instance uuid 953a63c8-a86d-420c-98fe-bdaa77f85904 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:13 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:13:13 user nova-compute[75210]: INFO nova.compute.claims [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Claim successful on node user
Nov 29 02:13:13 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:13:13 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:13:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:13 user nova-compute[75210]: INFO nova.network.neutron [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updating port 52e85b3f-0dac-43f8-a484-7993e2ac7729 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 29 02:13:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:13:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquired lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:13:13 user nova-compute[75210]: DEBUG nova.network.neutron [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-f3ef9c0f-d5bd-4e47-88b5-8fa51f1007a4 req-295f20a2-e40c-4538-bad5-dcd18e89008a service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-changed-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-f3ef9c0f-d5bd-4e47-88b5-8fa51f1007a4 req-295f20a2-e40c-4538-bad5-dcd18e89008a service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Refreshing instance network info cache due to event network-changed-52e85b3f-0dac-43f8-a484-7993e2ac7729. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f3ef9c0f-d5bd-4e47-88b5-8fa51f1007a4 req-295f20a2-e40c-4538-bad5-dcd18e89008a service nova] Acquiring lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG nova.network.neutron [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updating instance_info_cache with network_info: [{"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Releasing lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:13:14 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Creating image(s)
Nov 29 02:13:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "/opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "/opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "/opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG nova.objects.instance [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'trusted_certs' on Instance uuid 953a63c8-a86d-420c-98fe-bdaa77f85904 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f3ef9c0f-d5bd-4e47-88b5-8fa51f1007a4 req-295f20a2-e40c-4538-bad5-dcd18e89008a service nova] Acquired lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG nova.network.neutron [req-f3ef9c0f-d5bd-4e47-88b5-8fa51f1007a4 req-295f20a2-e40c-4538-bad5-dcd18e89008a service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Refreshing network info cache for port 52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG nova.objects.base [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Object Instance<953a63c8-a86d-420c-98fe-bdaa77f85904> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2.part --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:15 user nova-compute[75210]: DEBUG nova.virt.images [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] 9bc18d5c-80de-4899-acf1-c7cdfc7858b6 was qcow2, converting to raw {{(pid=75210) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 02:13:15 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 02:13:15 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2.part /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2.converted {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG nova.network.neutron [req-f3ef9c0f-d5bd-4e47-88b5-8fa51f1007a4 req-295f20a2-e40c-4538-bad5-dcd18e89008a service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updated VIF entry in instance network info cache for port 52e85b3f-0dac-43f8-a484-7993e2ac7729. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG nova.network.neutron [req-f3ef9c0f-d5bd-4e47-88b5-8fa51f1007a4 req-295f20a2-e40c-4538-bad5-dcd18e89008a service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updating instance_info_cache with network_info: [{"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f3ef9c0f-d5bd-4e47-88b5-8fa51f1007a4 req-295f20a2-e40c-4538-bad5-dcd18e89008a service nova] Releasing lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2.part /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2.converted" returned: 0 in 0.419s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2.converted --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.953s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-152b19a4-c70a-4ea5-bdce-6091ed5e6314 req-a323100f-00d7-4142-8ee1-059bdfb8d20c service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-changed-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-152b19a4-c70a-4ea5-bdce-6091ed5e6314 req-a323100f-00d7-4142-8ee1-059bdfb8d20c service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Refreshing instance network info cache due to event network-changed-d4aeab3f-f791-43b6-8309-2faff06c372c. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-152b19a4-c70a-4ea5-bdce-6091ed5e6314 req-a323100f-00d7-4142-8ee1-059bdfb8d20c service nova] Acquiring lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-152b19a4-c70a-4ea5-bdce-6091ed5e6314 req-a323100f-00d7-4142-8ee1-059bdfb8d20c service nova] Acquired lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG nova.network.neutron [req-152b19a4-c70a-4ea5-bdce-6091ed5e6314 req-a323100f-00d7-4142-8ee1-059bdfb8d20c service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Refreshing network info cache for port d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2 --force-share --output=json" returned: 0 in 0.190s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2 --force-share --output=json" returned: 0 in 0.234s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2,backing_fmt=raw /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2,backing_fmt=raw /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk 1073741824" returned: 0 in 0.050s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-152b19a4-c70a-4ea5-bdce-6091ed5e6314 req-a323100f-00d7-4142-8ee1-059bdfb8d20c service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updated VIF entry in instance network info cache for port d4aeab3f-f791-43b6-8309-2faff06c372c. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:13:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-152b19a4-c70a-4ea5-bdce-6091ed5e6314 req-a323100f-00d7-4142-8ee1-059bdfb8d20c service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updating instance_info_cache with network_info: [{"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:13:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-152b19a4-c70a-4ea5-bdce-6091ed5e6314 req-a323100f-00d7-4142-8ee1-059bdfb8d20c service nova] Releasing lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:13:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aacc76a9b6eac0b1faf6a1f5a192670fc91b86b2 --force-share --output=json" returned: 0 in 0.198s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:17 user nova-compute[75210]: DEBUG nova.objects.instance [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'migration_context' on Instance uuid 953a63c8-a86d-420c-98fe-bdaa77f85904 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:17 user nova-compute[75210]: DEBUG nova.objects.base [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Object Instance<953a63c8-a86d-420c-98fe-bdaa77f85904> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:13:17 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Rebasing disk image.
Nov 29 02:13:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.198s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:17 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 -F raw /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-1cc0251f-a113-4bed-a05f-af159312290d req-66c5c4bd-66b6-4a78-bbd7-7bf11db1ffd0 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-changed-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.compute.manager [req-1cc0251f-a113-4bed-a05f-af159312290d req-66c5c4bd-66b6-4a78-bbd7-7bf11db1ffd0 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Refreshing instance network info cache due to event network-changed-d4aeab3f-f791-43b6-8309-2faff06c372c. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1cc0251f-a113-4bed-a05f-af159312290d req-66c5c4bd-66b6-4a78-bbd7-7bf11db1ffd0 service nova] Acquiring lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1cc0251f-a113-4bed-a05f-af159312290d req-66c5c4bd-66b6-4a78-bbd7-7bf11db1ffd0 service nova] Acquired lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.network.neutron [req-1cc0251f-a113-4bed-a05f-af159312290d req-66c5c4bd-66b6-4a78-bbd7-7bf11db1ffd0 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Refreshing network info cache for port d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.network.neutron [req-1cc0251f-a113-4bed-a05f-af159312290d req-66c5c4bd-66b6-4a78-bbd7-7bf11db1ffd0 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updated VIF entry in instance network info cache for port d4aeab3f-f791-43b6-8309-2faff06c372c. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.network.neutron [req-1cc0251f-a113-4bed-a05f-af159312290d req-66c5c4bd-66b6-4a78-bbd7-7bf11db1ffd0 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updating instance_info_cache with network_info: [{"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1cc0251f-a113-4bed-a05f-af159312290d req-66c5c4bd-66b6-4a78-bbd7-7bf11db1ffd0 service nova] Releasing lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 -F raw /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk" returned: 0 in 2.352s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Ensure instance console log exists: /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Start _get_guest_xml network_info=[{"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='892e3192c0422ca6d82bc6cdd6b25f42',container_format='bare',created_at=2023-11-29T02:11:20Z,direct_url=<?>,disk_format='qcow2',id=9bc18d5c-80de-4899-acf1-c7cdfc7858b6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-245300826-shelved',owner='55934a4b47ab45a4a7f389919225c156',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T02:11:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:13:19 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:13:19 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='892e3192c0422ca6d82bc6cdd6b25f42',container_format='bare',created_at=2023-11-29T02:11:20Z,direct_url=<?>,disk_format='qcow2',id=9bc18d5c-80de-4899-acf1-c7cdfc7858b6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-245300826-shelved',owner='55934a4b47ab45a4a7f389919225c156',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-29T02:11:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.objects.instance [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'vcpu_model' on Instance uuid 953a63c8-a86d-420c-98fe-bdaa77f85904 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.objects.base [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Object Instance<953a63c8-a86d-420c-98fe-bdaa77f85904> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T02:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-245300826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-245300826',id=48,image_ref='9bc18d5c-80de-4899-acf1-c7cdfc7858b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-673500543',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:09:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='55934a4b47ab45a4a7f389919225c156',ramdisk_id='',reservation_id='r-azvatg0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2088736241',owner_user_name='tempest-AttachVolumeShelveTestJSON-2088736241-project-member',shelved_at='2023-11-29T02:11:24.406841',shelved_host='user',shelved_image_id='9bc18d5c-80de-4899-acf1-c7cdfc7858b6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f7a67a01104567b3e96f9d150dddd2',uuid=953a63c8-a86d-420c-98fe-bdaa77f85904,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converting VIF {"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.objects.instance [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'pci_devices' on Instance uuid 953a63c8-a86d-420c-98fe-bdaa77f85904 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.objects.base [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Object Instance<953a63c8-a86d-420c-98fe-bdaa77f85904> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:13:19 user nova-compute[75210]:   <uuid>953a63c8-a86d-420c-98fe-bdaa77f85904</uuid>
Nov 29 02:13:19 user nova-compute[75210]:   <name>instance-00000030</name>
Nov 29 02:13:19 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:13:19 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:13:19 user nova-compute[75210]:   <metadata>
Nov 29 02:13:19 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:13:19 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:13:19 user nova-compute[75210]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-245300826</nova:name>
Nov 29 02:13:19 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:13:19</nova:creationTime>
Nov 29 02:13:19 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:13:19 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:13:19 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:13:19 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:13:19 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:13:19 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:13:19 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:13:19 user nova-compute[75210]:       <nova:owner>
Nov 29 02:13:19 user nova-compute[75210]:         <nova:user uuid="f4f7a67a01104567b3e96f9d150dddd2">tempest-AttachVolumeShelveTestJSON-2088736241-project-member</nova:user>
Nov 29 02:13:19 user nova-compute[75210]:         <nova:project uuid="55934a4b47ab45a4a7f389919225c156">tempest-AttachVolumeShelveTestJSON-2088736241</nova:project>
Nov 29 02:13:19 user nova-compute[75210]:       </nova:owner>
Nov 29 02:13:19 user nova-compute[75210]:       <nova:root type="image" uuid="9bc18d5c-80de-4899-acf1-c7cdfc7858b6"/>
Nov 29 02:13:19 user nova-compute[75210]:       <nova:ports>
Nov 29 02:13:19 user nova-compute[75210]:         <nova:port uuid="52e85b3f-0dac-43f8-a484-7993e2ac7729">
Nov 29 02:13:19 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 29 02:13:19 user nova-compute[75210]:         </nova:port>
Nov 29 02:13:19 user nova-compute[75210]:       </nova:ports>
Nov 29 02:13:19 user nova-compute[75210]:     </nova:instance>
Nov 29 02:13:19 user nova-compute[75210]:   </metadata>
Nov 29 02:13:19 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:13:19 user nova-compute[75210]:     <system>
Nov 29 02:13:19 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:13:19 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:13:19 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:13:19 user nova-compute[75210]:       <entry name="serial">953a63c8-a86d-420c-98fe-bdaa77f85904</entry>
Nov 29 02:13:19 user nova-compute[75210]:       <entry name="uuid">953a63c8-a86d-420c-98fe-bdaa77f85904</entry>
Nov 29 02:13:19 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:13:19 user nova-compute[75210]:     </system>
Nov 29 02:13:19 user nova-compute[75210]:   </sysinfo>
Nov 29 02:13:19 user nova-compute[75210]:   <os>
Nov 29 02:13:19 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:13:19 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:13:19 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:13:19 user nova-compute[75210]:   </os>
Nov 29 02:13:19 user nova-compute[75210]:   <features>
Nov 29 02:13:19 user nova-compute[75210]:     <acpi/>
Nov 29 02:13:19 user nova-compute[75210]:     <apic/>
Nov 29 02:13:19 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:13:19 user nova-compute[75210]:   </features>
Nov 29 02:13:19 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:13:19 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:13:19 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:13:19 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:13:19 user nova-compute[75210]:   </clock>
Nov 29 02:13:19 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:13:19 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:13:19 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:13:19 user nova-compute[75210]:   </cpu>
Nov 29 02:13:19 user nova-compute[75210]:   <devices>
Nov 29 02:13:19 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:13:19 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:13:19 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk"/>
Nov 29 02:13:19 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:13:19 user nova-compute[75210]:     </disk>
Nov 29 02:13:19 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:13:19 user nova-compute[75210]:       <mac address="fa:16:3e:ed:3b:3e"/>
Nov 29 02:13:19 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:13:19 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:13:19 user nova-compute[75210]:       <target dev="tap52e85b3f-0d"/>
Nov 29 02:13:19 user nova-compute[75210]:     </interface>
Nov 29 02:13:19 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:13:19 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/console.log" append="off"/>
Nov 29 02:13:19 user nova-compute[75210]:     </serial>
Nov 29 02:13:19 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:13:19 user nova-compute[75210]:     <video>
Nov 29 02:13:19 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:13:19 user nova-compute[75210]:     </video>
Nov 29 02:13:19 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:13:19 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:13:19 user nova-compute[75210]:     </rng>
Nov 29 02:13:19 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:13:19 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:13:19 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:13:19 user nova-compute[75210]:     </memballoon>
Nov 29 02:13:19 user nova-compute[75210]:   </devices>
Nov 29 02:13:19 user nova-compute[75210]: </domain>
Nov 29 02:13:19 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T02:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-245300826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-245300826',id=48,image_ref='9bc18d5c-80de-4899-acf1-c7cdfc7858b6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-673500543',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:09:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='55934a4b47ab45a4a7f389919225c156',ramdisk_id='',reservation_id='r-azvatg0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2088736241',owner_user_name='tempest-AttachVolumeShelveTestJSON-2088736241-project-member',shelved_at='2023-11-29T02:11:24.406841',shelved_host='user',shelved_image_id='9bc18d5c-80de-4899-acf1-c7cdfc7858b6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:13:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f7a67a01104567b3e96f9d150dddd2',uuid=953a63c8-a86d-420c-98fe-bdaa77f85904,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converting VIF {"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG os_vif [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89fcc709-61d8-568c-917e-d14f51340ce4', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52e85b3f-0d, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52e85b3f-0d, col_values=(('qos', UUID('5512c941-5a08-444d-8248-41a59e9bd98c')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52e85b3f-0d, col_values=(('external_ids', {'iface-id': '52e85b3f-0dac-43f8-a484-7993e2ac7729', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:3b:3e', 'vm-uuid': '953a63c8-a86d-420c-98fe-bdaa77f85904'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:19 user nova-compute[75210]: INFO os_vif [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d')
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:13:19 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] No VIF found with MAC fa:16:3e:ed:3b:3e, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:13:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-3658e7e0-1362-4ccd-82de-11d08287f748 req-31bf86c7-49b4-4a17-80e9-ed64a938de1b service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:13:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3658e7e0-1362-4ccd-82de-11d08287f748 req-31bf86c7-49b4-4a17-80e9-ed64a938de1b service nova] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3658e7e0-1362-4ccd-82de-11d08287f748 req-31bf86c7-49b4-4a17-80e9-ed64a938de1b service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-3658e7e0-1362-4ccd-82de-11d08287f748 req-31bf86c7-49b4-4a17-80e9-ed64a938de1b service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-3658e7e0-1362-4ccd-82de-11d08287f748 req-31bf86c7-49b4-4a17-80e9-ed64a938de1b service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] No waiting events found dispatching network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:13:21 user nova-compute[75210]: WARNING nova.compute.manager [req-3658e7e0-1362-4ccd-82de-11d08287f748 req-31bf86c7-49b4-4a17-80e9-ed64a938de1b service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received unexpected event network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 02:13:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:13:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:13:23 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Instance spawned successfully.
Nov 29 02:13:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-7c3e85f5-73ed-4f86-bdb8-a820bbec0d0a req-9611a44e-b6ce-48f7-b3bc-e5c8b39168c4 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:13:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7c3e85f5-73ed-4f86-bdb8-a820bbec0d0a req-9611a44e-b6ce-48f7-b3bc-e5c8b39168c4 service nova] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7c3e85f5-73ed-4f86-bdb8-a820bbec0d0a req-9611a44e-b6ce-48f7-b3bc-e5c8b39168c4 service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7c3e85f5-73ed-4f86-bdb8-a820bbec0d0a req-9611a44e-b6ce-48f7-b3bc-e5c8b39168c4 service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:23 user nova-compute[75210]: DEBUG nova.compute.manager [req-7c3e85f5-73ed-4f86-bdb8-a820bbec0d0a req-9611a44e-b6ce-48f7-b3bc-e5c8b39168c4 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] No waiting events found dispatching network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:13:23 user nova-compute[75210]: WARNING nova.compute.manager [req-7c3e85f5-73ed-4f86-bdb8-a820bbec0d0a req-9611a44e-b6ce-48f7-b3bc-e5c8b39168c4 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received unexpected event network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 29 02:13:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:13:23 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-da29d0c3-6e3f-4838-af36-6ba6ec9e55b9 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.758s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:29 user nova-compute[75210]: INFO nova.compute.manager [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Rebooting instance
Nov 29 02:13:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:13:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquired lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:13:29 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:13:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG nova.network.neutron [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updating instance_info_cache with network_info: [{"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Releasing lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-7c798998-4a22-411e-9621-fe73676c6f06 req-e836fe5d-cd3c-4583-8b03-435e033e7d67 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-vif-unplugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7c798998-4a22-411e-9621-fe73676c6f06 req-e836fe5d-cd3c-4583-8b03-435e033e7d67 service nova] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7c798998-4a22-411e-9621-fe73676c6f06 req-e836fe5d-cd3c-4583-8b03-435e033e7d67 service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7c798998-4a22-411e-9621-fe73676c6f06 req-e836fe5d-cd3c-4583-8b03-435e033e7d67 service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-7c798998-4a22-411e-9621-fe73676c6f06 req-e836fe5d-cd3c-4583-8b03-435e033e7d67 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] No waiting events found dispatching network-vif-unplugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:13:30 user nova-compute[75210]: WARNING nova.compute.manager [req-7c798998-4a22-411e-9621-fe73676c6f06 req-e836fe5d-cd3c-4583-8b03-435e033e7d67 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received unexpected event network-vif-unplugged-d4aeab3f-f791-43b6-8309-2faff06c372c for instance with vm_state active and task_state reboot_started_hard.
Nov 29 02:13:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Instance destroyed successfully.
Nov 29 02:13:30 user nova-compute[75210]: DEBUG nova.objects.instance [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'resources' on Instance uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1681739102',display_name='tempest-TestMinimumBasicScenario-server-1681739102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1681739102',id=49,image_ref='a50c7532-d681-41c1-bb4c-54e19f2d6620',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFE9YWpLQ+jIgfd51Ql6tVDm7Uvvks+ZtZ46busjWVEWvoifewvMIwNROH6r3cIs9Wp93SxsJMGDPkgRK2S2mYXjz19TPExjnVGoqJpYEAhRGD+5erIr0cn682A47nxL0Q==',key_name='tempest-TestMinimumBasicScenario-839367194',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='912ac2027baf41d6bfe9db163fe672f6',ramdisk_id='',reservation_id='r-vr4oo58x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a50c7532-d681-41c1-bb4c-54e19f2d6620',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-717689186',owner_user_name='tempest-TestMinimumBasicScenario-717689186-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:13:30Z,user_data=None,user_id='c401b408dbfd40abb3d75d44a56d0e6d',uuid=a2e85f85-ec9b-4db2-b456-b1ef4894df6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converting VIF {"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG os_vif [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4aeab3f-f7, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16e21d08-79c7-43b2-99c1-5ebfe4a4e4fc) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:13:30 user nova-compute[75210]: INFO os_vif [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7')
Nov 29 02:13:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzoPpYGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:13:30 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:13:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:13:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baf539a-6bcb-4743-ad24-f09df4da7bae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:13:31 user nova-compute[75210]: No targets found.
Nov 29 02:13:31 user nova-compute[75210]: iSNS:
Nov 29 02:13:31 user nova-compute[75210]: No targets found.
Nov 29 02:13:31 user nova-compute[75210]: STATIC:
Nov 29 02:13:31 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7
Nov 29 02:13:31 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:13:31 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:13:31 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7
Nov 29 02:13:31 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:13:31 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:13:31 user nova-compute[75210]: FIRMWARE:
Nov 29 02:13:31 user nova-compute[75210]: No targets found.
Nov 29 02:13:31 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:13:31 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:13:31 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead9d605-0753-4f0b-a399-95a12c80e22b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1a4816-e385-4635-bd5e-45a192bbcae9]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:13:31 user nova-compute[75210]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)
Nov 29 02:13:31 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:13:31 user nova-compute[75210]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)
Nov 29 02:13:31 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e865e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c80304-695c-4d8c-bbc4-fa0136d5f679]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89b53b9-67ab-4dce-a846-df45a7fa64a9]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ab3cc8-0ac8-4233-add7-bc6f43a9ca1f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da87f92-6223-42b8-9ce6-74b12c12a326]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41b5ddf-6391-4935-a287-0af03a64c678]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ca2cab-4e5e-4fff-9732-d1f3a226ef73]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260]
Nov 29 02:13:31 user nova-compute[75210]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260] successful.
Nov 29 02:13:31 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac53057-329d-46db-b880-4d8ec8349be8]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] <== disconnect_volume: return (270ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Start _get_guest_xml network_info=[{"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a50c7532-d681-41c1-bb4c-54e19f2d6620,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': 'a50c7532-d681-41c1-bb4c-54e19f2d6620'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'f2c65338-b2f9-438f-94af-e4e7742b60d9', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzoPpYGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'a2e85f85-ec9b-4db2-b456-b1ef4894df6a', 'attached_at': '', 'detached_at': '', 'volume_id': '4e6bd910-c1e0-478f-8a72-ffa4055bcdf7', 'serial': '4e6bd910-c1e0-478f-8a72-ffa4055bcdf7'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:13:31 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:13:31 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a50c7532-d681-41c1-bb4c-54e19f2d6620,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.objects.instance [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'vcpu_model' on Instance uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.objects.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Object Instance<a2e85f85-ec9b-4db2-b456-b1ef4894df6a> lazy-loaded attributes: resources,vcpu_model {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzoPpYGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:13:31 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:13:31 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:13:31 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e1558e-c034-45ab-84d9-ec0ffdecd816]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:13:31 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1e70d9-f8df-4f01-ad73-9f71a2e255b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7] added
Nov 29 02:13:31 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4477fbc2-20fa-4af1-a02a-b62de03d3fe9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2b38f9-c453-4403-ba58-db797d1207cf]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rzoPpYGU {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rzoPpYGU" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[37550996-13f9-489f-8675-3daf30ecb546]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rzoPpYGU'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a15eee-8142-4772-ad03-7e44d7f2eaf4]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa44e793-20eb-41c8-b456-bc408343fe2f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:13:31 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:13:31 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3636a333-f814-4025-b87c-22e53daca997]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260]
Nov 29 02:13:31 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260] successful.
Nov 29 02:13:31 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf7c6ec-f178-49ed-9e34-4fe205dc3fb5]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05bfe31-bf22-4884-a875-9d98095d421c]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:13:31 user nova-compute[75210]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)
Nov 29 02:13:31 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:13:31 user nova-compute[75210]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)
Nov 29 02:13:31 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[36653111-94e2-4630-b489-be09ef26cf8a]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzoPpYGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:13:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-6bee60be-d93d-474d-a56a-78ce9ae1dfb9 req-90445a41-376d-4310-bafb-ba16a41aa641 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6bee60be-d93d-474d-a56a-78ce9ae1dfb9 req-90445a41-376d-4310-bafb-ba16a41aa641 service nova] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6bee60be-d93d-474d-a56a-78ce9ae1dfb9 req-90445a41-376d-4310-bafb-ba16a41aa641 service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6bee60be-d93d-474d-a56a-78ce9ae1dfb9 req-90445a41-376d-4310-bafb-ba16a41aa641 service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG nova.compute.manager [req-6bee60be-d93d-474d-a56a-78ce9ae1dfb9 req-90445a41-376d-4310-bafb-ba16a41aa641 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] No waiting events found dispatching network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:13:32 user nova-compute[75210]: WARNING nova.compute.manager [req-6bee60be-d93d-474d-a56a-78ce9ae1dfb9 req-90445a41-376d-4310-bafb-ba16a41aa641 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received unexpected event network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c for instance with vm_state active and task_state reboot_started_hard.
Nov 29 02:13:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23339666434306236', 'path': '/dev/sdc'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339666434306236', 'path': '/dev/sdc'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1681739102',display_name='tempest-TestMinimumBasicScenario-server-1681739102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1681739102',id=49,image_ref='a50c7532-d681-41c1-bb4c-54e19f2d6620',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFE9YWpLQ+jIgfd51Ql6tVDm7Uvvks+ZtZ46busjWVEWvoifewvMIwNROH6r3cIs9Wp93SxsJMGDPkgRK2S2mYXjz19TPExjnVGoqJpYEAhRGD+5erIr0cn682A47nxL0Q==',key_name='tempest-TestMinimumBasicScenario-839367194',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='912ac2027baf41d6bfe9db163fe672f6',ramdisk_id='',reservation_id='r-vr4oo58x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a50c7532-d681-41c1-bb4c-54e19f2d6620',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-717689186',owner_user_name='tempest-TestMinimumBasicScenario-717689186-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:13:30Z,user_data=None,user_id='c401b408dbfd40abb3d75d44a56d0e6d',uuid=a2e85f85-ec9b-4db2-b456-b1ef4894df6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converting VIF {"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG nova.objects.instance [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'pci_devices' on Instance uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG nova.objects.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Object Instance<a2e85f85-ec9b-4db2-b456-b1ef4894df6a> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:13:32 user nova-compute[75210]:   <uuid>a2e85f85-ec9b-4db2-b456-b1ef4894df6a</uuid>
Nov 29 02:13:32 user nova-compute[75210]:   <name>instance-00000031</name>
Nov 29 02:13:32 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:13:32 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:13:32 user nova-compute[75210]:   <metadata>
Nov 29 02:13:32 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:13:32 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:13:32 user nova-compute[75210]:       <nova:name>tempest-TestMinimumBasicScenario-server-1681739102</nova:name>
Nov 29 02:13:32 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:13:31</nova:creationTime>
Nov 29 02:13:32 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:13:32 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:13:32 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:13:32 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:13:32 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:13:32 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:13:32 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:13:32 user nova-compute[75210]:       <nova:owner>
Nov 29 02:13:32 user nova-compute[75210]:         <nova:user uuid="c401b408dbfd40abb3d75d44a56d0e6d">tempest-TestMinimumBasicScenario-717689186-project-member</nova:user>
Nov 29 02:13:32 user nova-compute[75210]:         <nova:project uuid="912ac2027baf41d6bfe9db163fe672f6">tempest-TestMinimumBasicScenario-717689186</nova:project>
Nov 29 02:13:32 user nova-compute[75210]:       </nova:owner>
Nov 29 02:13:32 user nova-compute[75210]:       <nova:root type="image" uuid="a50c7532-d681-41c1-bb4c-54e19f2d6620"/>
Nov 29 02:13:32 user nova-compute[75210]:       <nova:ports>
Nov 29 02:13:32 user nova-compute[75210]:         <nova:port uuid="d4aeab3f-f791-43b6-8309-2faff06c372c">
Nov 29 02:13:32 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 02:13:32 user nova-compute[75210]:         </nova:port>
Nov 29 02:13:32 user nova-compute[75210]:       </nova:ports>
Nov 29 02:13:32 user nova-compute[75210]:     </nova:instance>
Nov 29 02:13:32 user nova-compute[75210]:   </metadata>
Nov 29 02:13:32 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:13:32 user nova-compute[75210]:     <system>
Nov 29 02:13:32 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:13:32 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:13:32 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:13:32 user nova-compute[75210]:       <entry name="serial">a2e85f85-ec9b-4db2-b456-b1ef4894df6a</entry>
Nov 29 02:13:32 user nova-compute[75210]:       <entry name="uuid">a2e85f85-ec9b-4db2-b456-b1ef4894df6a</entry>
Nov 29 02:13:32 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:13:32 user nova-compute[75210]:     </system>
Nov 29 02:13:32 user nova-compute[75210]:   </sysinfo>
Nov 29 02:13:32 user nova-compute[75210]:   <os>
Nov 29 02:13:32 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:13:32 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:13:32 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:13:32 user nova-compute[75210]:   </os>
Nov 29 02:13:32 user nova-compute[75210]:   <features>
Nov 29 02:13:32 user nova-compute[75210]:     <acpi/>
Nov 29 02:13:32 user nova-compute[75210]:     <apic/>
Nov 29 02:13:32 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:13:32 user nova-compute[75210]:   </features>
Nov 29 02:13:32 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:13:32 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:13:32 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:13:32 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:13:32 user nova-compute[75210]:   </clock>
Nov 29 02:13:32 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:13:32 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:13:32 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:13:32 user nova-compute[75210]:   </cpu>
Nov 29 02:13:32 user nova-compute[75210]:   <devices>
Nov 29 02:13:32 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:13:32 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:13:32 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk"/>
Nov 29 02:13:32 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:13:32 user nova-compute[75210]:     </disk>
Nov 29 02:13:32 user nova-compute[75210]:     <disk type="block" device="disk">
Nov 29 02:13:32 user nova-compute[75210]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:13:32 user nova-compute[75210]:       <source dev="/dev/sdc"/>
Nov 29 02:13:32 user nova-compute[75210]:       <target dev="vdb" bus="virtio"/>
Nov 29 02:13:32 user nova-compute[75210]:       <serial>4e6bd910-c1e0-478f-8a72-ffa4055bcdf7</serial>
Nov 29 02:13:32 user nova-compute[75210]:     </disk>
Nov 29 02:13:32 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:13:32 user nova-compute[75210]:       <mac address="fa:16:3e:ef:ca:f9"/>
Nov 29 02:13:32 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:13:32 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:13:32 user nova-compute[75210]:       <target dev="tapd4aeab3f-f7"/>
Nov 29 02:13:32 user nova-compute[75210]:     </interface>
Nov 29 02:13:32 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:13:32 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/console.log" append="off"/>
Nov 29 02:13:32 user nova-compute[75210]:     </serial>
Nov 29 02:13:32 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:13:32 user nova-compute[75210]:     <video>
Nov 29 02:13:32 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:13:32 user nova-compute[75210]:     </video>
Nov 29 02:13:32 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:13:32 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:13:32 user nova-compute[75210]:     </rng>
Nov 29 02:13:32 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:13:32 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:13:32 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:13:32 user nova-compute[75210]:     </memballoon>
Nov 29 02:13:32 user nova-compute[75210]:   </devices>
Nov 29 02:13:32 user nova-compute[75210]: </domain>
Nov 29 02:13:32 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:32 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG nova.objects.instance [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'trusted_certs' on Instance uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG nova.objects.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Object Instance<a2e85f85-ec9b-4db2-b456-b1ef4894df6a> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5188f8a2a6ceda9a6c5433dbf26e6357bc84b664 --force-share --output=json" returned: 0 in 0.214s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Cannot resize image /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG nova.objects.instance [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'migration_context' on Instance uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG nova.objects.base [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Object Instance<a2e85f85-ec9b-4db2-b456-b1ef4894df6a> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75210) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1681739102',display_name='tempest-TestMinimumBasicScenario-server-1681739102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1681739102',id=49,image_ref='a50c7532-d681-41c1-bb4c-54e19f2d6620',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFE9YWpLQ+jIgfd51Ql6tVDm7Uvvks+ZtZ46busjWVEWvoifewvMIwNROH6r3cIs9Wp93SxsJMGDPkgRK2S2mYXjz19TPExjnVGoqJpYEAhRGD+5erIr0cn682A47nxL0Q==',key_name='tempest-TestMinimumBasicScenario-839367194',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='912ac2027baf41d6bfe9db163fe672f6',ramdisk_id='',reservation_id='r-vr4oo58x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a50c7532-d681-41c1-bb4c-54e19f2d6620',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-717689186',owner_user_name='tempest-TestMinimumBasicScenario-717689186-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:13:30Z,user_data=None,user_id='c401b408dbfd40abb3d75d44a56d0e6d',uuid=a2e85f85-ec9b-4db2-b456-b1ef4894df6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converting VIF {"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG os_vif [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3828c872-6bdf-5095-a894-938b168a91db', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4aeab3f-f7, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4aeab3f-f7, col_values=(('qos', UUID('49ff7598-6e21-45e5-b50f-0d5f75afb530')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4aeab3f-f7, col_values=(('external_ids', {'iface-id': 'd4aeab3f-f791-43b6-8309-2faff06c372c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:ca:f9', 'vm-uuid': 'a2e85f85-ec9b-4db2-b456-b1ef4894df6a'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:13:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:33 user nova-compute[75210]: INFO os_vif [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7')
Nov 29 02:13:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ba1f384-7417-4ea9-9a37-20cae856703e req-1d179d8d-f71c-4b04-bf13-7f1e8e9554df service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:13:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ba1f384-7417-4ea9-9a37-20cae856703e req-1d179d8d-f71c-4b04-bf13-7f1e8e9554df service nova] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ba1f384-7417-4ea9-9a37-20cae856703e req-1d179d8d-f71c-4b04-bf13-7f1e8e9554df service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5ba1f384-7417-4ea9-9a37-20cae856703e req-1d179d8d-f71c-4b04-bf13-7f1e8e9554df service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:35 user nova-compute[75210]: DEBUG nova.compute.manager [req-5ba1f384-7417-4ea9-9a37-20cae856703e req-1d179d8d-f71c-4b04-bf13-7f1e8e9554df service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] No waiting events found dispatching network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:13:35 user nova-compute[75210]: WARNING nova.compute.manager [req-5ba1f384-7417-4ea9-9a37-20cae856703e req-1d179d8d-f71c-4b04-bf13-7f1e8e9554df service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received unexpected event network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c for instance with vm_state active and task_state reboot_started_hard.
Nov 29 02:13:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:13:37 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Instance rebooted successfully.
Nov 29 02:13:37 user nova-compute[75210]: DEBUG nova.compute.manager [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:13:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-6561db2e-ed1b-4ae7-bd41-e95997a34830 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.946s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-f9a92b9f-4a92-42cc-954f-a59a58077101 req-8a05911f-9e0e-4cc7-b4aa-58d2707aa6f0 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:13:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f9a92b9f-4a92-42cc-954f-a59a58077101 req-8a05911f-9e0e-4cc7-b4aa-58d2707aa6f0 service nova] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f9a92b9f-4a92-42cc-954f-a59a58077101 req-8a05911f-9e0e-4cc7-b4aa-58d2707aa6f0 service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f9a92b9f-4a92-42cc-954f-a59a58077101 req-8a05911f-9e0e-4cc7-b4aa-58d2707aa6f0 service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:37 user nova-compute[75210]: DEBUG nova.compute.manager [req-f9a92b9f-4a92-42cc-954f-a59a58077101 req-8a05911f-9e0e-4cc7-b4aa-58d2707aa6f0 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] No waiting events found dispatching network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:13:37 user nova-compute[75210]: WARNING nova.compute.manager [req-f9a92b9f-4a92-42cc-954f-a59a58077101 req-8a05911f-9e0e-4cc7-b4aa-58d2707aa6f0 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received unexpected event network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c for instance with vm_state active and task_state reboot_started_hard.
Nov 29 02:13:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "51f35c78-7012-45df-9036-a88ac0433fc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "51f35c78-7012-45df-9036-a88ac0433fc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:42 user nova-compute[75210]: INFO nova.compute.manager [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Detaching volume d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7
Nov 29 02:13:42 user nova-compute[75210]: INFO nova.virt.block_device [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Attempting to driver detach volume d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 from mountpoint /dev/vdb
Nov 29 02:13:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Attempting to detach device vdb from instance 51f35c78-7012-45df-9036-a88ac0433fc1 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:13:43 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:13:43 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:13:43 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:13:43 user nova-compute[75210]:   <serial>d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7</serial>
Nov 29 02:13:43 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:13:43 user nova-compute[75210]: </disk>
Nov 29 02:13:43 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:13:43 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Successfully detached device vdb from instance 51f35c78-7012-45df-9036-a88ac0433fc1 from the persistent domain config.
Nov 29 02:13:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 51f35c78-7012-45df-9036-a88ac0433fc1 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:13:43 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:13:43 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:13:43 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:13:43 user nova-compute[75210]:   <serial>d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7</serial>
Nov 29 02:13:43 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:13:43 user nova-compute[75210]: </disk>
Nov 29 02:13:43 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "51f35c78-7012-45df-9036-a88ac0433fc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 51f35c78-7012-45df-9036-a88ac0433fc1 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_power_states {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 51f35c78-7012-45df-9036-a88ac0433fc1 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Triggering sync for uuid 953a63c8-a86d-420c-98fe-bdaa77f85904 {{(pid=75210) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "51f35c78-7012-45df-9036-a88ac0433fc1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:43 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:47 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:13:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:13:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:13:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:13:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:13:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Skipping network cache update for instance because it is being deleted. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 29 02:13:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:13:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:13:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:13:52 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:13:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updating instance_info_cache with network_info: [{"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:13:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:13:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:13:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:13:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:13:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:54 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:13:55 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:13:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:57 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:13:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:13:57 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:13:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:13:57 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:13:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:57 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:13:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:13:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:13:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:13:59 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:13:59 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:13:59 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8646MB free_disk=24.973594665527344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:13:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:13:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:13:59 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance a2e85f85-ec9b-4db2-b456-b1ef4894df6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:13:59 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 51f35c78-7012-45df-9036-a88ac0433fc1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:13:59 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 953a63c8-a86d-420c-98fe-bdaa77f85904 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:13:59 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:13:59 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:13:59 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:13:59 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:13:59 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:13:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:03 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 51f35c78-7012-45df-9036-a88ac0433fc1 is timed out.
Nov 29 02:14:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Successfully detached device vdb from instance 51f35c78-7012-45df-9036-a88ac0433fc1 from the live domain config.
Nov 29 02:14:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfWxNyJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:14:03 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[214d906c-5e33-4482-b129-f40ab9e40823]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:14:03 user nova-compute[75210]: No targets found.
Nov 29 02:14:03 user nova-compute[75210]: iSNS:
Nov 29 02:14:03 user nova-compute[75210]: No targets found.
Nov 29 02:14:03 user nova-compute[75210]: STATIC:
Nov 29 02:14:03 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7
Nov 29 02:14:03 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:14:03 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:14:03 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7
Nov 29 02:14:03 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:14:03 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:14:03 user nova-compute[75210]: FIRMWARE:
Nov 29 02:14:03 user nova-compute[75210]: No targets found.
Nov 29 02:14:03 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:14:03 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:14:03 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f983d601-46ac-4751-a70f-72434f042ef9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deb2653-9456-441d-8200-a7549430f2d1]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:14:03 user nova-compute[75210]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)
Nov 29 02:14:03 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 (non-flash)
Nov 29 02:14:03 user nova-compute[75210]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)
Nov 29 02:14:03 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2408118280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[564085ff-ab9d-49de-91f3-3fbba2165092]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a698115-a329-4fcf-af1e-920e6de30fc1]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa97754-1a18-44f1-bb84-551af54567c4]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd3be30-046c-4ce8-8b4d-beffc57a618e]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f41544-0559-4941-b670-5add7de39980]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0264db-ca97-41df-9fe8-fb3ffea5bfc7]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7, portal: 172.16.0.220,3260]
Nov 29 02:14:03 user nova-compute[75210]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7, portal: 172.16.0.220,3260] successful.
Nov 29 02:14:03 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d55b6a-026b-4aa1-b49b-64372eae7673]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] <== disconnect_volume: return (302ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:14:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG nova.objects.instance [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lazy-loading 'flavor' on Instance uuid 51f35c78-7012-45df-9036-a88ac0433fc1 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-2a20c9c6-6fb6-4978-a33a-4c185ff4deb8 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "51f35c78-7012-45df-9036-a88ac0433fc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.741s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "51f35c78-7012-45df-9036-a88ac0433fc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.621s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:04 user nova-compute[75210]: INFO nova.compute.manager [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Terminating instance
Nov 29 02:14:04 user nova-compute[75210]: DEBUG nova.compute.manager [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-9c8a9637-50ba-44be-a0a1-c29da6231225 req-e087c0c0-619c-428d-a030-66b759154398 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Received event network-vif-unplugged-6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9c8a9637-50ba-44be-a0a1-c29da6231225 req-e087c0c0-619c-428d-a030-66b759154398 service nova] Acquiring lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9c8a9637-50ba-44be-a0a1-c29da6231225 req-e087c0c0-619c-428d-a030-66b759154398 service nova] Lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-9c8a9637-50ba-44be-a0a1-c29da6231225 req-e087c0c0-619c-428d-a030-66b759154398 service nova] Lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-9c8a9637-50ba-44be-a0a1-c29da6231225 req-e087c0c0-619c-428d-a030-66b759154398 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] No waiting events found dispatching network-vif-unplugged-6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:14:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-9c8a9637-50ba-44be-a0a1-c29da6231225 req-e087c0c0-619c-428d-a030-66b759154398 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Received event network-vif-unplugged-6c7db7f2-3297-4464-b2ed-9071afa7af3e for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Instance destroyed successfully.
Nov 29 02:14:05 user nova-compute[75210]: DEBUG nova.objects.instance [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lazy-loading 'resources' on Instance uuid 51f35c78-7012-45df-9036-a88ac0433fc1 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:11:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-507889322',display_name='tempest-VolumesSnapshotTestJSON-instance-507889322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-507889322',id=50,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9b335eGTVb0ubFsf6+1NzxwuPGsavEtHPGG8e3b4W6A4rR0UMf4PyRbk6/wCinZIQKhX3Fsg39GFeEtaKJarsg0JgWr2B2bXtEIfMmMOIHj3Nz9lvj8hDO9n8O5uE+8w==',key_name='tempest-keypair-2033507639',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8eeb31f8c5e4610a53597d0c38f4c90',ramdisk_id='',reservation_id='r-o1if72l7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2023644237',owner_user_name='tempest-VolumesSnapshotTestJSON-2023644237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc97635cf0684427b552af6ea29e5ccc',uuid=51f35c78-7012-45df-9036-a88ac0433fc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "address": "fa:16:3e:17:3d:17", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7db7f2-32", "ovs_interfaceid": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Converting VIF {"id": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "address": "fa:16:3e:17:3d:17", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7db7f2-32", "ovs_interfaceid": "6c7db7f2-3297-4464-b2ed-9071afa7af3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=6c7db7f2-3297-4464-b2ed-9071afa7af3e,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7db7f2-32') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG os_vif [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=6c7db7f2-3297-4464-b2ed-9071afa7af3e,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7db7f2-32') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c7db7f2-32, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dd8ba52-0b33-498d-b46a-cf9269df1d46) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:14:05 user nova-compute[75210]: INFO os_vif [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:3d:17,bridge_name='br-int',has_traffic_filtering=True,id=6c7db7f2-3297-4464-b2ed-9071afa7af3e,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7db7f2-32')
Nov 29 02:14:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfWxNyJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:14:05 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:14:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d26480b-9ef9-4e6c-8720-bd6164875fb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:14:05 user nova-compute[75210]: No targets found.
Nov 29 02:14:05 user nova-compute[75210]: iSNS:
Nov 29 02:14:05 user nova-compute[75210]: No targets found.
Nov 29 02:14:05 user nova-compute[75210]: STATIC:
Nov 29 02:14:05 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7
Nov 29 02:14:05 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:14:05 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:14:05 user nova-compute[75210]: FIRMWARE:
Nov 29 02:14:05 user nova-compute[75210]: No targets found.
Nov 29 02:14:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:14:05 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:14:05 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d49ad334-fcaf-40c1-a4ca-8c9ff9dd65b7', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2ceb1e-e7a9-4499-b9c1-af554cc57400]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb630a47-d01c-4938-8199-210d719c862c]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)
Nov 29 02:14:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)
Nov 29 02:14:05 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e8527e20>, {}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Disconnecting from: [] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] <== disconnect_volume: return (72ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:14:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Deleting instance files /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1_del
Nov 29 02:14:05 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Deletion of /opt/stack/data/nova/instances/51f35c78-7012-45df-9036-a88ac0433fc1_del complete
Nov 29 02:14:05 user nova-compute[75210]: INFO nova.compute.manager [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 29 02:14:05 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:14:05 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:14:06 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:14:06 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Took 0.68 seconds to deallocate network for instance.
Nov 29 02:14:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-293dfc01-4a7a-4ee7-9129-930369f62a8d req-93d8e4ac-6b26-40f0-b14c-bb1744c7ceff service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Received event network-vif-deleted-6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:14:06 user nova-compute[75210]: WARNING nova.volume.cinder [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Attachment 8001887d-aa88-48e6-a6b9-6f7a302110b2 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8001887d-aa88-48e6-a6b9-6f7a302110b2. (HTTP 404) (Request-ID: req-c7feb0ce-d6df-40ca-bedb-bde54b40541f)
Nov 29 02:14:06 user nova-compute[75210]: INFO nova.compute.manager [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Took 0.03 seconds to detach 1 volumes for instance.
Nov 29 02:14:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:14:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:06 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:14:06 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:14:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:06 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Deleted allocations for instance 51f35c78-7012-45df-9036-a88ac0433fc1
Nov 29 02:14:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-37d4ede3-f3f3-41dc-84de-0d0fe09a6a02 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "51f35c78-7012-45df-9036-a88ac0433fc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.036s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "51f35c78-7012-45df-9036-a88ac0433fc1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 23.004s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:06 user nova-compute[75210]: INFO nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 29 02:14:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "51f35c78-7012-45df-9036-a88ac0433fc1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-6f8b633f-54a3-41dc-92a1-288f6ad1ad82 req-caa2ee5a-b863-48a7-a0ba-e721745fe321 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Received event network-vif-plugged-6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:14:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6f8b633f-54a3-41dc-92a1-288f6ad1ad82 req-caa2ee5a-b863-48a7-a0ba-e721745fe321 service nova] Acquiring lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:14:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6f8b633f-54a3-41dc-92a1-288f6ad1ad82 req-caa2ee5a-b863-48a7-a0ba-e721745fe321 service nova] Lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6f8b633f-54a3-41dc-92a1-288f6ad1ad82 req-caa2ee5a-b863-48a7-a0ba-e721745fe321 service nova] Lock "51f35c78-7012-45df-9036-a88ac0433fc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:06 user nova-compute[75210]: DEBUG nova.compute.manager [req-6f8b633f-54a3-41dc-92a1-288f6ad1ad82 req-caa2ee5a-b863-48a7-a0ba-e721745fe321 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] No waiting events found dispatching network-vif-plugged-6c7db7f2-3297-4464-b2ed-9071afa7af3e {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:14:06 user nova-compute[75210]: WARNING nova.compute.manager [req-6f8b633f-54a3-41dc-92a1-288f6ad1ad82 req-caa2ee5a-b863-48a7-a0ba-e721745fe321 service nova] [instance: 51f35c78-7012-45df-9036-a88ac0433fc1] Received unexpected event network-vif-plugged-6c7db7f2-3297-4464-b2ed-9071afa7af3e for instance with vm_state deleted and task_state None.
Nov 29 02:14:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:14:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:14:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:14:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:14:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:14:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:14:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:14:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:14:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:14:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:14:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:14:49 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:14:50 user nova-compute[75210]: INFO nova.compute.claims [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Claim successful on node user
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG nova.network.neutron [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:14:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG nova.policy [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc97635cf0684427b552af6ea29e5ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eeb31f8c5e4610a53597d0c38f4c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:14:50 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Creating image(s)
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "/opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "/opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.169s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:50 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk 1073741824" returned: 0 in 0.091s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG nova.network.neutron [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Successfully created port: 47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Cannot resize image /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Ensure instance console log exists: /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG nova.network.neutron [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Successfully updated port: 47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "refresh_cache-c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquired lock "refresh_cache-c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG nova.network.neutron [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-e08f12c5-6a44-4222-bdce-21a4a5ab8662 req-b8d03d22-d0e2-4764-96f7-11a61a9d90cd service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Received event network-changed-47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG nova.compute.manager [req-e08f12c5-6a44-4222-bdce-21a4a5ab8662 req-b8d03d22-d0e2-4764-96f7-11a61a9d90cd service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Refreshing instance network info cache due to event network-changed-47cb7fd9-aafa-421f-88c8-3cbc536957f2. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e08f12c5-6a44-4222-bdce-21a4a5ab8662 req-b8d03d22-d0e2-4764-96f7-11a61a9d90cd service nova] Acquiring lock "refresh_cache-c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:14:51 user nova-compute[75210]: DEBUG nova.network.neutron [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.network.neutron [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Updating instance_info_cache with network_info: [{"id": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "address": "fa:16:3e:b3:d2:89", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cb7fd9-aa", "ovs_interfaceid": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Releasing lock "refresh_cache-c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Instance network_info: |[{"id": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "address": "fa:16:3e:b3:d2:89", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cb7fd9-aa", "ovs_interfaceid": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e08f12c5-6a44-4222-bdce-21a4a5ab8662 req-b8d03d22-d0e2-4764-96f7-11a61a9d90cd service nova] Acquired lock "refresh_cache-c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.network.neutron [req-e08f12c5-6a44-4222-bdce-21a4a5ab8662 req-b8d03d22-d0e2-4764-96f7-11a61a9d90cd service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Refreshing network info cache for port 47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Start _get_guest_xml network_info=[{"id": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "address": "fa:16:3e:b3:d2:89", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cb7fd9-aa", "ovs_interfaceid": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:14:52 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:14:52 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1265589094',display_name='tempest-VolumesSnapshotTestJSON-instance-1265589094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1265589094',id=51,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDDWnxJmI8euaHIk4m4zLxq4WR6Mv9U2mzP9Q/XrQNeGW8+BwgP9aly7lsJ90Bhe49D05EX/hyhM6o8ycqjQ6jNyAVxX50xpzqp45EKjQvVZcjPBsBuDhchN6wxjl7hkw==',key_name='tempest-keypair-1726423560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8eeb31f8c5e4610a53597d0c38f4c90',ramdisk_id='',reservation_id='r-mvc1smmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2023644237',owner_user_name='tempest-VolumesSnapshotTestJSON-2023644237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc97635cf0684427b552af6ea29e5ccc',uuid=c8efc99b-bfaa-4bf1-b6f4-e08acb915a22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "address": "fa:16:3e:b3:d2:89", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cb7fd9-aa", "ovs_interfaceid": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Converting VIF {"id": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "address": "fa:16:3e:b3:d2:89", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cb7fd9-aa", "ovs_interfaceid": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=47cb7fd9-aafa-421f-88c8-3cbc536957f2,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cb7fd9-aa') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.objects.instance [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lazy-loading 'pci_devices' on Instance uuid c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:14:52 user nova-compute[75210]:   <uuid>c8efc99b-bfaa-4bf1-b6f4-e08acb915a22</uuid>
Nov 29 02:14:52 user nova-compute[75210]:   <name>instance-00000033</name>
Nov 29 02:14:52 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:14:52 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:14:52 user nova-compute[75210]:   <metadata>
Nov 29 02:14:52 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:14:52 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:14:52 user nova-compute[75210]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1265589094</nova:name>
Nov 29 02:14:52 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:14:52</nova:creationTime>
Nov 29 02:14:52 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:14:52 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:14:52 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:14:52 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:14:52 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:14:52 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:14:52 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:14:52 user nova-compute[75210]:       <nova:owner>
Nov 29 02:14:52 user nova-compute[75210]:         <nova:user uuid="dc97635cf0684427b552af6ea29e5ccc">tempest-VolumesSnapshotTestJSON-2023644237-project-member</nova:user>
Nov 29 02:14:52 user nova-compute[75210]:         <nova:project uuid="f8eeb31f8c5e4610a53597d0c38f4c90">tempest-VolumesSnapshotTestJSON-2023644237</nova:project>
Nov 29 02:14:52 user nova-compute[75210]:       </nova:owner>
Nov 29 02:14:52 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 02:14:52 user nova-compute[75210]:       <nova:ports>
Nov 29 02:14:52 user nova-compute[75210]:         <nova:port uuid="47cb7fd9-aafa-421f-88c8-3cbc536957f2">
Nov 29 02:14:52 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 29 02:14:52 user nova-compute[75210]:         </nova:port>
Nov 29 02:14:52 user nova-compute[75210]:       </nova:ports>
Nov 29 02:14:52 user nova-compute[75210]:     </nova:instance>
Nov 29 02:14:52 user nova-compute[75210]:   </metadata>
Nov 29 02:14:52 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:14:52 user nova-compute[75210]:     <system>
Nov 29 02:14:52 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:14:52 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:14:52 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:14:52 user nova-compute[75210]:       <entry name="serial">c8efc99b-bfaa-4bf1-b6f4-e08acb915a22</entry>
Nov 29 02:14:52 user nova-compute[75210]:       <entry name="uuid">c8efc99b-bfaa-4bf1-b6f4-e08acb915a22</entry>
Nov 29 02:14:52 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:14:52 user nova-compute[75210]:     </system>
Nov 29 02:14:52 user nova-compute[75210]:   </sysinfo>
Nov 29 02:14:52 user nova-compute[75210]:   <os>
Nov 29 02:14:52 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:14:52 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:14:52 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:14:52 user nova-compute[75210]:   </os>
Nov 29 02:14:52 user nova-compute[75210]:   <features>
Nov 29 02:14:52 user nova-compute[75210]:     <acpi/>
Nov 29 02:14:52 user nova-compute[75210]:     <apic/>
Nov 29 02:14:52 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:14:52 user nova-compute[75210]:   </features>
Nov 29 02:14:52 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:14:52 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:14:52 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:14:52 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:14:52 user nova-compute[75210]:   </clock>
Nov 29 02:14:52 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:14:52 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:14:52 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:14:52 user nova-compute[75210]:   </cpu>
Nov 29 02:14:52 user nova-compute[75210]:   <devices>
Nov 29 02:14:52 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:14:52 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:14:52 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk"/>
Nov 29 02:14:52 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:14:52 user nova-compute[75210]:     </disk>
Nov 29 02:14:52 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:14:52 user nova-compute[75210]:       <mac address="fa:16:3e:b3:d2:89"/>
Nov 29 02:14:52 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:14:52 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:14:52 user nova-compute[75210]:       <target dev="tap47cb7fd9-aa"/>
Nov 29 02:14:52 user nova-compute[75210]:     </interface>
Nov 29 02:14:52 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:14:52 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/console.log" append="off"/>
Nov 29 02:14:52 user nova-compute[75210]:     </serial>
Nov 29 02:14:52 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:14:52 user nova-compute[75210]:     <video>
Nov 29 02:14:52 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:14:52 user nova-compute[75210]:     </video>
Nov 29 02:14:52 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:14:52 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:14:52 user nova-compute[75210]:     </rng>
Nov 29 02:14:52 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:14:52 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:14:52 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:14:52 user nova-compute[75210]:     </memballoon>
Nov 29 02:14:52 user nova-compute[75210]:   </devices>
Nov 29 02:14:52 user nova-compute[75210]: </domain>
Nov 29 02:14:52 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1265589094',display_name='tempest-VolumesSnapshotTestJSON-instance-1265589094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1265589094',id=51,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDDWnxJmI8euaHIk4m4zLxq4WR6Mv9U2mzP9Q/XrQNeGW8+BwgP9aly7lsJ90Bhe49D05EX/hyhM6o8ycqjQ6jNyAVxX50xpzqp45EKjQvVZcjPBsBuDhchN6wxjl7hkw==',key_name='tempest-keypair-1726423560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8eeb31f8c5e4610a53597d0c38f4c90',ramdisk_id='',reservation_id='r-mvc1smmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2023644237',owner_user_name='tempest-VolumesSnapshotTestJSON-2023644237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc97635cf0684427b552af6ea29e5ccc',uuid=c8efc99b-bfaa-4bf1-b6f4-e08acb915a22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "address": "fa:16:3e:b3:d2:89", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cb7fd9-aa", "ovs_interfaceid": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Converting VIF {"id": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "address": "fa:16:3e:b3:d2:89", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cb7fd9-aa", "ovs_interfaceid": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=47cb7fd9-aafa-421f-88c8-3cbc536957f2,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cb7fd9-aa') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG os_vif [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=47cb7fd9-aafa-421f-88c8-3cbc536957f2,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cb7fd9-aa') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17c26b66-55bc-58ff-8de4-09923f71c9e6', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47cb7fd9-aa, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47cb7fd9-aa, col_values=(('qos', UUID('6352654f-622a-45eb-b5ed-b60eff0be59f')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47cb7fd9-aa, col_values=(('external_ids', {'iface-id': '47cb7fd9-aafa-421f-88c8-3cbc536957f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:d2:89', 'vm-uuid': 'c8efc99b-bfaa-4bf1-b6f4-e08acb915a22'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:52 user nova-compute[75210]: INFO os_vif [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=47cb7fd9-aafa-421f-88c8-3cbc536957f2,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cb7fd9-aa')
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] No VIF found with MAC fa:16:3e:b3:d2:89, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.network.neutron [req-e08f12c5-6a44-4222-bdce-21a4a5ab8662 req-b8d03d22-d0e2-4764-96f7-11a61a9d90cd service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Updated VIF entry in instance network info cache for port 47cb7fd9-aafa-421f-88c8-3cbc536957f2. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG nova.network.neutron [req-e08f12c5-6a44-4222-bdce-21a4a5ab8662 req-b8d03d22-d0e2-4764-96f7-11a61a9d90cd service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Updating instance_info_cache with network_info: [{"id": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "address": "fa:16:3e:b3:d2:89", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cb7fd9-aa", "ovs_interfaceid": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:14:52 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-e08f12c5-6a44-4222-bdce-21a4a5ab8662 req-b8d03d22-d0e2-4764-96f7-11a61a9d90cd service nova] Releasing lock "refresh_cache-c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG nova.compute.manager [req-dd673ffb-80ee-45c4-ab63-02b4c88a106a req-a4439ee2-dba4-4ee4-8751-f14f1e00ac4e service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Received event network-vif-plugged-47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dd673ffb-80ee-45c4-ab63-02b4c88a106a req-a4439ee2-dba4-4ee4-8751-f14f1e00ac4e service nova] Acquiring lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dd673ffb-80ee-45c4-ab63-02b4c88a106a req-a4439ee2-dba4-4ee4-8751-f14f1e00ac4e service nova] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dd673ffb-80ee-45c4-ab63-02b4c88a106a req-a4439ee2-dba4-4ee4-8751-f14f1e00ac4e service nova] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG nova.compute.manager [req-dd673ffb-80ee-45c4-ab63-02b4c88a106a req-a4439ee2-dba4-4ee4-8751-f14f1e00ac4e service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] No waiting events found dispatching network-vif-plugged-47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:14:53 user nova-compute[75210]: WARNING nova.compute.manager [req-dd673ffb-80ee-45c4-ab63-02b4c88a106a req-a4439ee2-dba4-4ee4-8751-f14f1e00ac4e service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Received unexpected event network-vif-plugged-47cb7fd9-aafa-421f-88c8-3cbc536957f2 for instance with vm_state building and task_state spawning.
Nov 29 02:14:53 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updating instance_info_cache with network_info: [{"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-953a63c8-a86d-420c-98fe-bdaa77f85904" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:14:53 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:14:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:54 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:14:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:14:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:14:55 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Instance spawned successfully.
Nov 29 02:14:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:14:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:14:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:14:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:14:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:14:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:14:55 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:14:55 user nova-compute[75210]: INFO nova.compute.manager [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 29 02:14:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:14:55 user nova-compute[75210]: INFO nova.compute.manager [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Took 5.69 seconds to build instance.
Nov 29 02:14:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-cbfe643a-b9be-49ee-992b-fad83b220641 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.800s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:55 user nova-compute[75210]: DEBUG nova.compute.manager [req-7c419411-c9ac-4ef5-a898-582c7c6ec202 req-1816a504-5618-4232-ae2f-8ab02b92b64f service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Received event network-vif-plugged-47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:14:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7c419411-c9ac-4ef5-a898-582c7c6ec202 req-1816a504-5618-4232-ae2f-8ab02b92b64f service nova] Acquiring lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:14:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7c419411-c9ac-4ef5-a898-582c7c6ec202 req-1816a504-5618-4232-ae2f-8ab02b92b64f service nova] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7c419411-c9ac-4ef5-a898-582c7c6ec202 req-1816a504-5618-4232-ae2f-8ab02b92b64f service nova] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:55 user nova-compute[75210]: DEBUG nova.compute.manager [req-7c419411-c9ac-4ef5-a898-582c7c6ec202 req-1816a504-5618-4232-ae2f-8ab02b92b64f service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] No waiting events found dispatching network-vif-plugged-47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:14:55 user nova-compute[75210]: WARNING nova.compute.manager [req-7c419411-c9ac-4ef5-a898-582c7c6ec202 req-1816a504-5618-4232-ae2f-8ab02b92b64f service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Received unexpected event network-vif-plugged-47cb7fd9-aafa-421f-88c8-3cbc536957f2 for instance with vm_state active and task_state None.
Nov 29 02:14:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:14:57 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:14:58 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:14:58 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:14:58 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:14:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:14:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:14:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:14:58 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:14:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:14:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:14:59 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:15:00 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:15:00 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:15:00 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8704MB free_disk=24.991249084472656GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:15:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:15:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:15:00 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance a2e85f85-ec9b-4db2-b456-b1ef4894df6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:15:00 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 953a63c8-a86d-420c-98fe-bdaa77f85904 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:15:00 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:15:00 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:15:00 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:15:00 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:15:00 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:15:00 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:15:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:15:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:15:03 user nova-compute[75210]: INFO nova.compute.manager [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Terminating instance
Nov 29 02:15:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-ea6ab98e-75b3-4d9f-8105-b7340aa6a296 req-1b5bffb9-581b-4cbf-a9b9-63775ac50ad7 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-vif-unplugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ea6ab98e-75b3-4d9f-8105-b7340aa6a296 req-1b5bffb9-581b-4cbf-a9b9-63775ac50ad7 service nova] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ea6ab98e-75b3-4d9f-8105-b7340aa6a296 req-1b5bffb9-581b-4cbf-a9b9-63775ac50ad7 service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-ea6ab98e-75b3-4d9f-8105-b7340aa6a296 req-1b5bffb9-581b-4cbf-a9b9-63775ac50ad7 service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-ea6ab98e-75b3-4d9f-8105-b7340aa6a296 req-1b5bffb9-581b-4cbf-a9b9-63775ac50ad7 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] No waiting events found dispatching network-vif-unplugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG nova.compute.manager [req-ea6ab98e-75b3-4d9f-8105-b7340aa6a296 req-1b5bffb9-581b-4cbf-a9b9-63775ac50ad7 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-vif-unplugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:15:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Instance destroyed successfully.
Nov 29 02:15:03 user nova-compute[75210]: DEBUG nova.objects.instance [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lazy-loading 'resources' on Instance uuid 953a63c8-a86d-420c-98fe-bdaa77f85904 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-29T02:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-245300826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-245300826',id=48,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/oV2YiOdLrZqfATbxLr3cZ5gGa2Kz3qZy2t4wfNFvC3WzI4dq8STr3miU4QP3DJkFHguyIAPBNWk6n3gDtLcSqOunITTo/1Aw3sSrsaSfRA5NV9S9D77R1Vk1L+/OX9g==',key_name='tempest-keypair-673500543',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:13:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55934a4b47ab45a4a7f389919225c156',ramdisk_id='',reservation_id='r-azvatg0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2088736241',owner_user_name='tempest-AttachVolumeShelveTestJSON-2088736241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:13:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f7a67a01104567b3e96f9d150dddd2',uuid=953a63c8-a86d-420c-98fe-bdaa77f85904,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converting VIF {"id": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "address": "fa:16:3e:ed:3b:3e", "network": {"id": "e672e016-1f26-40ab-9503-87311d993b7f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-425120305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "55934a4b47ab45a4a7f389919225c156", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52e85b3f-0d", "ovs_interfaceid": "52e85b3f-0dac-43f8-a484-7993e2ac7729", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG os_vif [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52e85b3f-0d, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5512c941-5a08-444d-8248-41a59e9bd98c) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:03 user nova-compute[75210]: INFO os_vif [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:3b:3e,bridge_name='br-int',has_traffic_filtering=True,id=52e85b3f-0dac-43f8-a484-7993e2ac7729,network=Network(e672e016-1f26-40ab-9503-87311d993b7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52e85b3f-0d')
Nov 29 02:15:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Deleting instance files /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904_del
Nov 29 02:15:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Deletion of /opt/stack/data/nova/instances/953a63c8-a86d-420c-98fe-bdaa77f85904_del complete
Nov 29 02:15:03 user nova-compute[75210]: INFO nova.compute.manager [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 29 02:15:03 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:15:03 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:15:04 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:15:04 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Took 1.11 seconds to deallocate network for instance.
Nov 29 02:15:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-4f220cd0-5891-4f59-893b-1bf907a77f91 req-d7ecfe74-12c1-4233-95a0-2f1d6c24c8e3 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-vif-deleted-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:15:04 user nova-compute[75210]: INFO nova.compute.manager [req-4f220cd0-5891-4f59-893b-1bf907a77f91 req-d7ecfe74-12c1-4233-95a0-2f1d6c24c8e3 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Neutron deleted interface 52e85b3f-0dac-43f8-a484-7993e2ac7729; detaching it from the instance and deleting it from the info cache
Nov 29 02:15:04 user nova-compute[75210]: DEBUG nova.network.neutron [req-4f220cd0-5891-4f59-893b-1bf907a77f91 req-d7ecfe74-12c1-4233-95a0-2f1d6c24c8e3 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:15:04 user nova-compute[75210]: DEBUG nova.compute.manager [req-4f220cd0-5891-4f59-893b-1bf907a77f91 req-d7ecfe74-12c1-4233-95a0-2f1d6c24c8e3 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Detach interface failed, port_id=52e85b3f-0dac-43f8-a484-7993e2ac7729, reason: Instance 953a63c8-a86d-420c-98fe-bdaa77f85904 could not be found. {{(pid=75210) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 29 02:15:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:15:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:15:05 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:15:05 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:15:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:15:05 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Deleted allocations for instance 953a63c8-a86d-420c-98fe-bdaa77f85904
Nov 29 02:15:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e7e758df-5253-454c-93e9-6d5bd2d2b585 tempest-AttachVolumeShelveTestJSON-2088736241 tempest-AttachVolumeShelveTestJSON-2088736241-project-member] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:15:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-03add65b-4b26-4afc-b133-16d400a4fa2f req-acf62441-e087-40fc-9f6c-b3d718655300 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received event network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:15:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-03add65b-4b26-4afc-b133-16d400a4fa2f req-acf62441-e087-40fc-9f6c-b3d718655300 service nova] Acquiring lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:15:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-03add65b-4b26-4afc-b133-16d400a4fa2f req-acf62441-e087-40fc-9f6c-b3d718655300 service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:15:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-03add65b-4b26-4afc-b133-16d400a4fa2f req-acf62441-e087-40fc-9f6c-b3d718655300 service nova] Lock "953a63c8-a86d-420c-98fe-bdaa77f85904-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:15:05 user nova-compute[75210]: DEBUG nova.compute.manager [req-03add65b-4b26-4afc-b133-16d400a4fa2f req-acf62441-e087-40fc-9f6c-b3d718655300 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] No waiting events found dispatching network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:15:05 user nova-compute[75210]: WARNING nova.compute.manager [req-03add65b-4b26-4afc-b133-16d400a4fa2f req-acf62441-e087-40fc-9f6c-b3d718655300 service nova] [instance: 953a63c8-a86d-420c-98fe-bdaa77f85904] Received unexpected event network-vif-plugged-52e85b3f-0dac-43f8-a484-7993e2ac7729 for instance with vm_state deleted and task_state None.
Nov 29 02:15:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-bfb4b12d-5df5-40e5-8c03-57a36131a8cd req-1c8e8381-2a71-4c18-8d65-6a0437db3c5e service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-changed-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:15:21 user nova-compute[75210]: DEBUG nova.compute.manager [req-bfb4b12d-5df5-40e5-8c03-57a36131a8cd req-1c8e8381-2a71-4c18-8d65-6a0437db3c5e service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Refreshing instance network info cache due to event network-changed-d4aeab3f-f791-43b6-8309-2faff06c372c. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:15:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bfb4b12d-5df5-40e5-8c03-57a36131a8cd req-1c8e8381-2a71-4c18-8d65-6a0437db3c5e service nova] Acquiring lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:15:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bfb4b12d-5df5-40e5-8c03-57a36131a8cd req-1c8e8381-2a71-4c18-8d65-6a0437db3c5e service nova] Acquired lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:15:21 user nova-compute[75210]: DEBUG nova.network.neutron [req-bfb4b12d-5df5-40e5-8c03-57a36131a8cd req-1c8e8381-2a71-4c18-8d65-6a0437db3c5e service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Refreshing network info cache for port d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:15:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG nova.network.neutron [req-bfb4b12d-5df5-40e5-8c03-57a36131a8cd req-1c8e8381-2a71-4c18-8d65-6a0437db3c5e service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updated VIF entry in instance network info cache for port d4aeab3f-f791-43b6-8309-2faff06c372c. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG nova.network.neutron [req-bfb4b12d-5df5-40e5-8c03-57a36131a8cd req-1c8e8381-2a71-4c18-8d65-6a0437db3c5e service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updating instance_info_cache with network_info: [{"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-bfb4b12d-5df5-40e5-8c03-57a36131a8cd req-1c8e8381-2a71-4c18-8d65-6a0437db3c5e service nova] Releasing lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-094d03b9-02d9-4977-9924-e6f57b26d125 req-2b608d0c-2b57-4076-ba17-b70b76a791f6 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-changed-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-094d03b9-02d9-4977-9924-e6f57b26d125 req-2b608d0c-2b57-4076-ba17-b70b76a791f6 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Refreshing instance network info cache due to event network-changed-d4aeab3f-f791-43b6-8309-2faff06c372c. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-094d03b9-02d9-4977-9924-e6f57b26d125 req-2b608d0c-2b57-4076-ba17-b70b76a791f6 service nova] Acquiring lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-094d03b9-02d9-4977-9924-e6f57b26d125 req-2b608d0c-2b57-4076-ba17-b70b76a791f6 service nova] Acquired lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG nova.network.neutron [req-094d03b9-02d9-4977-9924-e6f57b26d125 req-2b608d0c-2b57-4076-ba17-b70b76a791f6 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Refreshing network info cache for port d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:15:22 user nova-compute[75210]: INFO nova.compute.manager [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Detaching volume 4e6bd910-c1e0-478f-8a72-ffa4055bcdf7
Nov 29 02:15:22 user nova-compute[75210]: INFO nova.virt.block_device [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Attempting to driver detach volume 4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 from mountpoint /dev/vdb
Nov 29 02:15:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Attempting to detach device vdb from instance a2e85f85-ec9b-4db2-b456-b1ef4894df6a from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:15:22 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:15:22 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 02:15:22 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:15:22 user nova-compute[75210]:   <serial>4e6bd910-c1e0-478f-8a72-ffa4055bcdf7</serial>
Nov 29 02:15:22 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 02:15:22 user nova-compute[75210]: </disk>
Nov 29 02:15:22 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:15:22 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Successfully detached device vdb from instance a2e85f85-ec9b-4db2-b456-b1ef4894df6a from the persistent domain config.
Nov 29 02:15:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a2e85f85-ec9b-4db2-b456-b1ef4894df6a from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:15:22 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:15:22 user nova-compute[75210]:   <source dev="/dev/sdc"/>
Nov 29 02:15:22 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:15:22 user nova-compute[75210]:   <serial>4e6bd910-c1e0-478f-8a72-ffa4055bcdf7</serial>
Nov 29 02:15:22 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 29 02:15:22 user nova-compute[75210]: </disk>
Nov 29 02:15:22 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG nova.network.neutron [req-094d03b9-02d9-4977-9924-e6f57b26d125 req-2b608d0c-2b57-4076-ba17-b70b76a791f6 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updated VIF entry in instance network info cache for port d4aeab3f-f791-43b6-8309-2faff06c372c. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG nova.network.neutron [req-094d03b9-02d9-4977-9924-e6f57b26d125 req-2b608d0c-2b57-4076-ba17-b70b76a791f6 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updating instance_info_cache with network_info: [{"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:15:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-094d03b9-02d9-4977-9924-e6f57b26d125 req-2b608d0c-2b57-4076-ba17-b70b76a791f6 service nova] Releasing lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:15:23 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:15:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:33 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:43 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a2e85f85-ec9b-4db2-b456-b1ef4894df6a is timed out.
Nov 29 02:15:43 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Successfully detached device vdb from instance a2e85f85-ec9b-4db2-b456-b1ef4894df6a from the live domain config.
Nov 29 02:15:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzoPpYGU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:15:43 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b953b88-4526-4d86-b7a6-d463a59aeb59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:15:43 user nova-compute[75210]: No targets found.
Nov 29 02:15:43 user nova-compute[75210]: iSNS:
Nov 29 02:15:43 user nova-compute[75210]: No targets found.
Nov 29 02:15:43 user nova-compute[75210]: STATIC:
Nov 29 02:15:43 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7
Nov 29 02:15:43 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:15:43 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:15:43 user nova-compute[75210]: FIRMWARE:
Nov 29 02:15:43 user nova-compute[75210]: No targets found.
Nov 29 02:15:43 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:15:43 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:15:43 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f6b6f9-1e58-4b7c-99f8-24add39e104d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[91478604-c4dd-468d-9079-cb38bc1ee1ee]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)
Nov 29 02:15:43 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 (non-flash)
Nov 29 02:15:43 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f1e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7'): ({'sdc'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Removing single pathed devices sdc {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dadb8fe-56ed-488e-9098-8d5edd700b5b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b732b5e-c4dc-44bd-b5cf-86a5bc646101]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Flushing IO for device /dev/sdc {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d28ba73-cbe3-4b2b-9bf0-a8840bedacc2]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6578eea0-c8cd-4c1a-990d-f08764ddb55e]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] SCSI volumes sdc have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf69ad0-f5b6-434e-9448-f079c49544f6]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f836a614-d12e-4b08-9b9c-00d32b800c77]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260]
Nov 29 02:15:43 user nova-compute[75210]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7, portal: 172.16.0.220,3260] successful.
Nov 29 02:15:43 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e6bd910-c1e0-478f-8a72-ffa4055bcdf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1af6542-29fc-4f7a-8e3f-72ddfd14d592]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] <== disconnect_volume: return (289ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:15:43 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:44 user nova-compute[75210]: DEBUG nova.objects.instance [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'flavor' on Instance uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:15:44 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d6571eb4-b427-4289-a917-5abe616a383a tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.611s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:15:48 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:15:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:15:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:15:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:15:53 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:15:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:15:53 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:15:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:15:53 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:15:53 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:15:53 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:15:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:15:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:15:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:15:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:15:53 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:54 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updating instance_info_cache with network_info: [{"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:15:54 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-a2e85f85-ec9b-4db2-b456-b1ef4894df6a" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:15:54 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:15:55 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:15:55 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:15:58 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:15:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:15:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:15:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:15:58 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:15:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:15:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:15:59 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:15:59 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:15:59 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:15:59 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=24.99020004272461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:15:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:15:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:15:59 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance a2e85f85-ec9b-4db2-b456-b1ef4894df6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:15:59 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:15:59 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:15:59 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:16:00 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:16:00 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:16:00 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:16:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:16:01 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:16:01 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:16:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:16:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:16:16 user nova-compute[75210]: INFO nova.compute.manager [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Terminating instance
Nov 29 02:16:16 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-f6ba17f2-2f21-4929-ba63-705a676311e3 req-2f41e76a-2f4d-46ee-a9cd-2ae496456de7 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-vif-unplugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f6ba17f2-2f21-4929-ba63-705a676311e3 req-2f41e76a-2f4d-46ee-a9cd-2ae496456de7 service nova] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f6ba17f2-2f21-4929-ba63-705a676311e3 req-2f41e76a-2f4d-46ee-a9cd-2ae496456de7 service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f6ba17f2-2f21-4929-ba63-705a676311e3 req-2f41e76a-2f4d-46ee-a9cd-2ae496456de7 service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-f6ba17f2-2f21-4929-ba63-705a676311e3 req-2f41e76a-2f4d-46ee-a9cd-2ae496456de7 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] No waiting events found dispatching network-vif-unplugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:16:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-f6ba17f2-2f21-4929-ba63-705a676311e3 req-2f41e76a-2f4d-46ee-a9cd-2ae496456de7 service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-vif-unplugged-d4aeab3f-f791-43b6-8309-2faff06c372c for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:16:17 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Instance destroyed successfully.
Nov 29 02:16:17 user nova-compute[75210]: DEBUG nova.objects.instance [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'resources' on Instance uuid a2e85f85-ec9b-4db2-b456-b1ef4894df6a {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:11:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1681739102',display_name='tempest-TestMinimumBasicScenario-server-1681739102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1681739102',id=49,image_ref='a50c7532-d681-41c1-bb4c-54e19f2d6620',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFE9YWpLQ+jIgfd51Ql6tVDm7Uvvks+ZtZ46busjWVEWvoifewvMIwNROH6r3cIs9Wp93SxsJMGDPkgRK2S2mYXjz19TPExjnVGoqJpYEAhRGD+5erIr0cn682A47nxL0Q==',key_name='tempest-TestMinimumBasicScenario-839367194',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='912ac2027baf41d6bfe9db163fe672f6',ramdisk_id='',reservation_id='r-vr4oo58x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a50c7532-d681-41c1-bb4c-54e19f2d6620',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-717689186',owner_user_name='tempest-TestMinimumBasicScenario-717689186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:13:37Z,user_data=None,user_id='c401b408dbfd40abb3d75d44a56d0e6d',uuid=a2e85f85-ec9b-4db2-b456-b1ef4894df6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converting VIF {"id": "d4aeab3f-f791-43b6-8309-2faff06c372c", "address": "fa:16:3e:ef:ca:f9", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4aeab3f-f7", "ovs_interfaceid": "d4aeab3f-f791-43b6-8309-2faff06c372c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG os_vif [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4aeab3f-f7, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49ff7598-6e21-45e5-b50f-0d5f75afb530) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:16:17 user nova-compute[75210]: INFO os_vif [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:ca:f9,bridge_name='br-int',has_traffic_filtering=True,id=d4aeab3f-f791-43b6-8309-2faff06c372c,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4aeab3f-f7')
Nov 29 02:16:17 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Deleting instance files /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a_del
Nov 29 02:16:17 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Deletion of /opt/stack/data/nova/instances/a2e85f85-ec9b-4db2-b456-b1ef4894df6a_del complete
Nov 29 02:16:17 user nova-compute[75210]: INFO nova.compute.manager [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 29 02:16:17 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:16:17 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:16:18 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:16:18 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Took 0.50 seconds to deallocate network for instance.
Nov 29 02:16:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:16:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:16:18 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:16:18 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:16:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:16:18 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Deleted allocations for instance a2e85f85-ec9b-4db2-b456-b1ef4894df6a
Nov 29 02:16:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e51005a8-f921-489f-8024-b974a30ffad2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.795s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:16:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-f8f13c56-e43f-43dd-b97a-a295bb8b2cc7 req-a55da13f-cb17-4a05-8171-d9ea45304f1e service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:16:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8f13c56-e43f-43dd-b97a-a295bb8b2cc7 req-a55da13f-cb17-4a05-8171-d9ea45304f1e service nova] Acquiring lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:16:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8f13c56-e43f-43dd-b97a-a295bb8b2cc7 req-a55da13f-cb17-4a05-8171-d9ea45304f1e service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:16:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-f8f13c56-e43f-43dd-b97a-a295bb8b2cc7 req-a55da13f-cb17-4a05-8171-d9ea45304f1e service nova] Lock "a2e85f85-ec9b-4db2-b456-b1ef4894df6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:16:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-f8f13c56-e43f-43dd-b97a-a295bb8b2cc7 req-a55da13f-cb17-4a05-8171-d9ea45304f1e service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] No waiting events found dispatching network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:16:18 user nova-compute[75210]: WARNING nova.compute.manager [req-f8f13c56-e43f-43dd-b97a-a295bb8b2cc7 req-a55da13f-cb17-4a05-8171-d9ea45304f1e service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received unexpected event network-vif-plugged-d4aeab3f-f791-43b6-8309-2faff06c372c for instance with vm_state deleted and task_state None.
Nov 29 02:16:18 user nova-compute[75210]: DEBUG nova.compute.manager [req-f8f13c56-e43f-43dd-b97a-a295bb8b2cc7 req-a55da13f-cb17-4a05-8171-d9ea45304f1e service nova] [instance: a2e85f85-ec9b-4db2-b456-b1ef4894df6a] Received event network-vif-deleted-d4aeab3f-f791-43b6-8309-2faff06c372c {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:16:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:16:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:16:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:16:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG nova.compute.manager [req-5e11b25b-68f7-4e08-bf9c-7394398bacd5 req-636e8f40-a03c-4e74-92f6-0b88ffce0f73 service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Received event network-changed-47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG nova.compute.manager [req-5e11b25b-68f7-4e08-bf9c-7394398bacd5 req-636e8f40-a03c-4e74-92f6-0b88ffce0f73 service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Refreshing instance network info cache due to event network-changed-47cb7fd9-aafa-421f-88c8-3cbc536957f2. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5e11b25b-68f7-4e08-bf9c-7394398bacd5 req-636e8f40-a03c-4e74-92f6-0b88ffce0f73 service nova] Acquiring lock "refresh_cache-c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5e11b25b-68f7-4e08-bf9c-7394398bacd5 req-636e8f40-a03c-4e74-92f6-0b88ffce0f73 service nova] Acquired lock "refresh_cache-c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG nova.network.neutron [req-5e11b25b-68f7-4e08-bf9c-7394398bacd5 req-636e8f40-a03c-4e74-92f6-0b88ffce0f73 service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Refreshing network info cache for port 47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG nova.objects.instance [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lazy-loading 'flavor' on Instance uuid c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:16:41 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Ignoring supplied device name: /dev/vdb
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:16:41 user nova-compute[75210]: INFO nova.compute.manager [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Attaching volume 72fd7071-ae3d-4c9e-bbbc-edda3092db96 to /dev/vdb
Nov 29 02:16:41 user nova-compute[75210]: DEBUG nova.network.neutron [req-5e11b25b-68f7-4e08-bf9c-7394398bacd5 req-636e8f40-a03c-4e74-92f6-0b88ffce0f73 service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Updated VIF entry in instance network info cache for port 47cb7fd9-aafa-421f-88c8-3cbc536957f2. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG nova.network.neutron [req-5e11b25b-68f7-4e08-bf9c-7394398bacd5 req-636e8f40-a03c-4e74-92f6-0b88ffce0f73 service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Updating instance_info_cache with network_info: [{"id": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "address": "fa:16:3e:b3:d2:89", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cb7fd9-aa", "ovs_interfaceid": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5e11b25b-68f7-4e08-bf9c-7394398bacd5 req-636e8f40-a03c-4e74-92f6-0b88ffce0f73 service nova] Releasing lock "refresh_cache-c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG os_brick.utils [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc31d834-f48f-4ffe-a3c3-6bb2738a27b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e520aada-2889-4e36-bdb2-e2159143786f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50105c9-2986-4919-8aa0-bd4c03602dab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e53b9f2-232d-4c10-9a5a-180d90143c95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:16:41 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:16:41 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ad0d9b-34d4-4315-a691-f8b30a93bb01]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG os_brick.utils [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Updating existing volume attachment record: afc8479e-aeac-4396-84d5-a68677161e5c {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:16:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiyRQquO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:16:48 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:16:48 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:16:48 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f93a909-0b76-431f-9969-ac0a72118c5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:16:48 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8584fc-7a04-482f-b11c-eecca17cf6b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96] added
Nov 29 02:16:48 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e9a81e-d94e-4ece-b02c-7181e6cfa0c0]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2fe077-fd91-4c74-a139-11343f1c7717]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tiyRQquO {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tiyRQquO" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[348cb307-0295-478b-a97d-5b6620b9f849]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tiyRQquO'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaaea5d-a27a-43bd-ba33-b9ef44677a20]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ec8b73-52a1-4f39-9ffd-b79b7dfb5c09]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:16:48 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:16:48 user nova-compute[75210]:  {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:16:48 user nova-compute[75210]: WARNING os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 02:16:48 user nova-compute[75210]: 
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ab0aa2-0e28-46d2-ac19-68cce5652f20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96, portal: 172.16.0.220,3260]
Nov 29 02:16:48 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96, portal: 172.16.0.220,3260] successful.
Nov 29 02:16:48 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bde8db6-9258-428f-9bc9-578a704f6b15]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30efe9a-1ecf-4025-82c8-c29c6c1cb4d9]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 (non-flash)
Nov 29 02:16:48 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 (non-flash)
Nov 29 02:16:48 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.232s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f868278a-5a46-4d4a-89c6-0a215a4385f1]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:16:48 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:16:49 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:16:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:16:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiyRQquO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:16:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.260s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:16:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] <== connect_volume: return (1261ms) {'type': 'block', 'scsi_wwn': '23162643866626266', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:16:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162643866626266', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:16:49 user nova-compute[75210]: DEBUG nova.objects.instance [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lazy-loading 'flavor' on Instance uuid c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:16:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 02:16:49 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:16:49 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:16:49 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:16:49 user nova-compute[75210]:   <serial>72fd7071-ae3d-4c9e-bbbc-edda3092db96</serial>
Nov 29 02:16:49 user nova-compute[75210]: </disk>
Nov 29 02:16:49 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 02:16:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:16:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:16:50 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] No VIF found with MAC fa:16:3e:b3:d2:89, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:16:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-50f004da-be8b-4175-afce-543b2af72afb tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.899s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:16:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:16:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:54 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:16:54 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:16:54 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:16:55 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:16:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:16:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:16:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:16:55 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:16:55 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Updating instance_info_cache with network_info: [{"id": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "address": "fa:16:3e:b3:d2:89", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cb7fd9-aa", "ovs_interfaceid": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:16:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:16:55 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:16:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:16:57 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:17:00 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:17:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:00 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:17:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:17:01 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:17:01 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:17:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8930MB free_disk=25.015377044677734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:17:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:17:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:17:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:17:01 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:17:01 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:17:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:17:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:02 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:17:02 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:17:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:17:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:07 user nova-compute[75210]: INFO nova.compute.manager [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Detaching volume 72fd7071-ae3d-4c9e-bbbc-edda3092db96
Nov 29 02:17:07 user nova-compute[75210]: INFO nova.virt.block_device [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Attempting to driver detach volume 72fd7071-ae3d-4c9e-bbbc-edda3092db96 from mountpoint /dev/vdb
Nov 29 02:17:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Attempting to detach device vdb from instance c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:17:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:17:07 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:17:07 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:17:07 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:17:07 user nova-compute[75210]:   <serial>72fd7071-ae3d-4c9e-bbbc-edda3092db96</serial>
Nov 29 02:17:07 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:17:07 user nova-compute[75210]: </disk>
Nov 29 02:17:07 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:17:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Successfully detached device vdb from instance c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 from the persistent domain config.
Nov 29 02:17:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:17:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:17:07 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:17:07 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:17:07 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:17:07 user nova-compute[75210]:   <serial>72fd7071-ae3d-4c9e-bbbc-edda3092db96</serial>
Nov 29 02:17:07 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:17:07 user nova-compute[75210]: </disk>
Nov 29 02:17:07 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:17:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:08 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "070330e3-0343-4915-a710-55caae091991" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:17:10 user nova-compute[75210]: INFO nova.compute.claims [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Claim successful on node user
Nov 29 02:17:10 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG nova.network.neutron [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:17:10 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:17:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG nova.policy [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c401b408dbfd40abb3d75d44a56d0e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912ac2027baf41d6bfe9db163fe672f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:17:10 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Creating image(s)
Nov 29 02:17:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "/opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "/opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "/opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "57c871355e74367147a08117b7b85779e9c7f352" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "57c871355e74367147a08117b7b85779e9c7f352" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352.part --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:11 user nova-compute[75210]: DEBUG nova.network.neutron [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Successfully created port: 1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:17:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352.part --force-share --output=json" returned: 0 in 0.171s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:11 user nova-compute[75210]: DEBUG nova.virt.images [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] becf2280-d295-4fdd-a52d-a4b309ff929c was qcow2, converting to raw {{(pid=75210) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 29 02:17:11 user nova-compute[75210]: DEBUG nova.privsep.utils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75210) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 29 02:17:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352.part /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352.converted {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352.part /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352.converted" returned: 0 in 0.258s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352.converted --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352.converted --force-share --output=json" returned: 0 in 0.168s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "57c871355e74367147a08117b7b85779e9c7f352" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.130s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.network.neutron [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Successfully updated port: 1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquired lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.network.neutron [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-25253b7d-d534-4dbd-ab62-1870f1d93360 req-a907715b-3ecb-42c4-9e94-a0ad10d65c7d service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-changed-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.compute.manager [req-25253b7d-d534-4dbd-ab62-1870f1d93360 req-a907715b-3ecb-42c4-9e94-a0ad10d65c7d service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Refreshing instance network info cache due to event network-changed-1aec9a00-7979-47c2-af6b-86edfcdcec70. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-25253b7d-d534-4dbd-ab62-1870f1d93360 req-a907715b-3ecb-42c4-9e94-a0ad10d65c7d service nova] Acquiring lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.network.neutron [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352 --force-share --output=json" returned: 0 in 0.175s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "57c871355e74367147a08117b7b85779e9c7f352" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "57c871355e74367147a08117b7b85779e9c7f352" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352 --force-share --output=json" returned: 0 in 0.170s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352,backing_fmt=raw /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352,backing_fmt=raw /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk 1073741824" returned: 0 in 0.071s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "57c871355e74367147a08117b7b85779e9c7f352" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.network.neutron [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Updating instance_info_cache with network_info: [{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Releasing lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Instance network_info: |[{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-25253b7d-d534-4dbd-ab62-1870f1d93360 req-a907715b-3ecb-42c4-9e94-a0ad10d65c7d service nova] Acquired lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.network.neutron [req-25253b7d-d534-4dbd-ab62-1870f1d93360 req-a907715b-3ecb-42c4-9e94-a0ad10d65c7d service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Refreshing network info cache for port 1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57c871355e74367147a08117b7b85779e9c7f352 --force-share --output=json" returned: 0 in 0.190s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Cannot resize image /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Ensure instance console log exists: /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Start _get_guest_xml network_info=[{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T02:17:08Z,direct_url=<?>,disk_format='qcow2',id=becf2280-d295-4fdd-a52d-a4b309ff929c,min_disk=0,min_ram=0,name='tempest-scenario-img--1558355486',owner='912ac2027baf41d6bfe9db163fe672f6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T02:17:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': 'becf2280-d295-4fdd-a52d-a4b309ff929c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:17:12 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:17:12 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T02:17:08Z,direct_url=<?>,disk_format='qcow2',id=becf2280-d295-4fdd-a52d-a4b309ff929c,min_disk=0,min_ram=0,name='tempest-scenario-img--1558355486',owner='912ac2027baf41d6bfe9db163fe672f6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T02:17:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-651883070',display_name='tempest-TestMinimumBasicScenario-server-651883070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-651883070',id=52,image_ref='becf2280-d295-4fdd-a52d-a4b309ff929c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsUe14BfzgeHzdgCaEpIcB0lI5EyF2YAt71kK4ymvF7LVWjTzLxcNbikI0GR0vf7CRDqQ9NN7diP+/inGaKSB0MC42Nr61Idyag7dA6GjuN37/SipW8bclvP30Uwat7Zg==',key_name='tempest-TestMinimumBasicScenario-1419589163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912ac2027baf41d6bfe9db163fe672f6',ramdisk_id='',reservation_id='r-t01pqfa5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='becf2280-d295-4fdd-a52d-a4b309ff929c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-717689186',owner_user_name='tempest-TestMinimumBasicScenario-717689186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:17:11Z,user_data=None,user_id='c401b408dbfd40abb3d75d44a56d0e6d',uuid=070330e3-0343-4915-a710-55caae091991,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converting VIF {"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d9:05,bridge_name='br-int',has_traffic_filtering=True,id=1aec9a00-7979-47c2-af6b-86edfcdcec70,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aec9a00-79') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.objects.instance [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'pci_devices' on Instance uuid 070330e3-0343-4915-a710-55caae091991 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:17:12 user nova-compute[75210]:   <uuid>070330e3-0343-4915-a710-55caae091991</uuid>
Nov 29 02:17:12 user nova-compute[75210]:   <name>instance-00000034</name>
Nov 29 02:17:12 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:17:12 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:17:12 user nova-compute[75210]:   <metadata>
Nov 29 02:17:12 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:17:12 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:17:12 user nova-compute[75210]:       <nova:name>tempest-TestMinimumBasicScenario-server-651883070</nova:name>
Nov 29 02:17:12 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:17:12</nova:creationTime>
Nov 29 02:17:12 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:17:12 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:17:12 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:17:12 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:17:12 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:17:12 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:17:12 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:17:12 user nova-compute[75210]:       <nova:owner>
Nov 29 02:17:12 user nova-compute[75210]:         <nova:user uuid="c401b408dbfd40abb3d75d44a56d0e6d">tempest-TestMinimumBasicScenario-717689186-project-member</nova:user>
Nov 29 02:17:12 user nova-compute[75210]:         <nova:project uuid="912ac2027baf41d6bfe9db163fe672f6">tempest-TestMinimumBasicScenario-717689186</nova:project>
Nov 29 02:17:12 user nova-compute[75210]:       </nova:owner>
Nov 29 02:17:12 user nova-compute[75210]:       <nova:root type="image" uuid="becf2280-d295-4fdd-a52d-a4b309ff929c"/>
Nov 29 02:17:12 user nova-compute[75210]:       <nova:ports>
Nov 29 02:17:12 user nova-compute[75210]:         <nova:port uuid="1aec9a00-7979-47c2-af6b-86edfcdcec70">
Nov 29 02:17:12 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 29 02:17:12 user nova-compute[75210]:         </nova:port>
Nov 29 02:17:12 user nova-compute[75210]:       </nova:ports>
Nov 29 02:17:12 user nova-compute[75210]:     </nova:instance>
Nov 29 02:17:12 user nova-compute[75210]:   </metadata>
Nov 29 02:17:12 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:17:12 user nova-compute[75210]:     <system>
Nov 29 02:17:12 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:17:12 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:17:12 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:17:12 user nova-compute[75210]:       <entry name="serial">070330e3-0343-4915-a710-55caae091991</entry>
Nov 29 02:17:12 user nova-compute[75210]:       <entry name="uuid">070330e3-0343-4915-a710-55caae091991</entry>
Nov 29 02:17:12 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:17:12 user nova-compute[75210]:     </system>
Nov 29 02:17:12 user nova-compute[75210]:   </sysinfo>
Nov 29 02:17:12 user nova-compute[75210]:   <os>
Nov 29 02:17:12 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:17:12 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:17:12 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:17:12 user nova-compute[75210]:   </os>
Nov 29 02:17:12 user nova-compute[75210]:   <features>
Nov 29 02:17:12 user nova-compute[75210]:     <acpi/>
Nov 29 02:17:12 user nova-compute[75210]:     <apic/>
Nov 29 02:17:12 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:17:12 user nova-compute[75210]:   </features>
Nov 29 02:17:12 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:17:12 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:17:12 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:17:12 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:17:12 user nova-compute[75210]:   </clock>
Nov 29 02:17:12 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:17:12 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:17:12 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:17:12 user nova-compute[75210]:   </cpu>
Nov 29 02:17:12 user nova-compute[75210]:   <devices>
Nov 29 02:17:12 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:17:12 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:17:12 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk"/>
Nov 29 02:17:12 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:17:12 user nova-compute[75210]:     </disk>
Nov 29 02:17:12 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:17:12 user nova-compute[75210]:       <mac address="fa:16:3e:a3:d9:05"/>
Nov 29 02:17:12 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:17:12 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:17:12 user nova-compute[75210]:       <target dev="tap1aec9a00-79"/>
Nov 29 02:17:12 user nova-compute[75210]:     </interface>
Nov 29 02:17:12 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:17:12 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/console.log" append="off"/>
Nov 29 02:17:12 user nova-compute[75210]:     </serial>
Nov 29 02:17:12 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:17:12 user nova-compute[75210]:     <video>
Nov 29 02:17:12 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:17:12 user nova-compute[75210]:     </video>
Nov 29 02:17:12 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:17:12 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:17:12 user nova-compute[75210]:     </rng>
Nov 29 02:17:12 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:17:12 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:17:12 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:17:12 user nova-compute[75210]:     </memballoon>
Nov 29 02:17:12 user nova-compute[75210]:   </devices>
Nov 29 02:17:12 user nova-compute[75210]: </domain>
Nov 29 02:17:12 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-651883070',display_name='tempest-TestMinimumBasicScenario-server-651883070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-651883070',id=52,image_ref='becf2280-d295-4fdd-a52d-a4b309ff929c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsUe14BfzgeHzdgCaEpIcB0lI5EyF2YAt71kK4ymvF7LVWjTzLxcNbikI0GR0vf7CRDqQ9NN7diP+/inGaKSB0MC42Nr61Idyag7dA6GjuN37/SipW8bclvP30Uwat7Zg==',key_name='tempest-TestMinimumBasicScenario-1419589163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='912ac2027baf41d6bfe9db163fe672f6',ramdisk_id='',reservation_id='r-t01pqfa5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='becf2280-d295-4fdd-a52d-a4b309ff929c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-717689186',owner_user_name='tempest-TestMinimumBasicScenario-717689186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:17:11Z,user_data=None,user_id='c401b408dbfd40abb3d75d44a56d0e6d',uuid=070330e3-0343-4915-a710-55caae091991,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converting VIF {"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d9:05,bridge_name='br-int',has_traffic_filtering=True,id=1aec9a00-7979-47c2-af6b-86edfcdcec70,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aec9a00-79') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG os_vif [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d9:05,bridge_name='br-int',has_traffic_filtering=True,id=1aec9a00-7979-47c2-af6b-86edfcdcec70,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aec9a00-79') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f32b8b9-02f7-5aee-879f-174080ae1fa1', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aec9a00-79, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:17:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1aec9a00-79, col_values=(('qos', UUID('1ecb4796-7c89-4e41-9396-bd313c351c7d')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:17:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1aec9a00-79, col_values=(('external_ids', {'iface-id': '1aec9a00-7979-47c2-af6b-86edfcdcec70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:d9:05', 'vm-uuid': '070330e3-0343-4915-a710-55caae091991'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:17:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:17:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:13 user nova-compute[75210]: INFO os_vif [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d9:05,bridge_name='br-int',has_traffic_filtering=True,id=1aec9a00-7979-47c2-af6b-86edfcdcec70,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aec9a00-79')
Nov 29 02:17:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:17:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] No VIF found with MAC fa:16:3e:a3:d9:05, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:17:13 user nova-compute[75210]: DEBUG nova.network.neutron [req-25253b7d-d534-4dbd-ab62-1870f1d93360 req-a907715b-3ecb-42c4-9e94-a0ad10d65c7d service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Updated VIF entry in instance network info cache for port 1aec9a00-7979-47c2-af6b-86edfcdcec70. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:17:13 user nova-compute[75210]: DEBUG nova.network.neutron [req-25253b7d-d534-4dbd-ab62-1870f1d93360 req-a907715b-3ecb-42c4-9e94-a0ad10d65c7d service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Updating instance_info_cache with network_info: [{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:17:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-25253b7d-d534-4dbd-ab62-1870f1d93360 req-a907715b-3ecb-42c4-9e94-a0ad10d65c7d service nova] Releasing lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:17:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-53ed998b-340e-45bd-84c5-d9196ee0ff54 req-75ca27a8-5bfe-4f0a-8cac-e48d1e0179d4 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:17:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-53ed998b-340e-45bd-84c5-d9196ee0ff54 req-75ca27a8-5bfe-4f0a-8cac-e48d1e0179d4 service nova] Acquiring lock "070330e3-0343-4915-a710-55caae091991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-53ed998b-340e-45bd-84c5-d9196ee0ff54 req-75ca27a8-5bfe-4f0a-8cac-e48d1e0179d4 service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-53ed998b-340e-45bd-84c5-d9196ee0ff54 req-75ca27a8-5bfe-4f0a-8cac-e48d1e0179d4 service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-53ed998b-340e-45bd-84c5-d9196ee0ff54 req-75ca27a8-5bfe-4f0a-8cac-e48d1e0179d4 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] No waiting events found dispatching network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:17:14 user nova-compute[75210]: WARNING nova.compute.manager [req-53ed998b-340e-45bd-84c5-d9196ee0ff54 req-75ca27a8-5bfe-4f0a-8cac-e48d1e0179d4 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received unexpected event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 for instance with vm_state building and task_state spawning.
Nov 29 02:17:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG nova.compute.manager [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:17:16 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 070330e3-0343-4915-a710-55caae091991] Instance spawned successfully.
Nov 29 02:17:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:17:16 user nova-compute[75210]: INFO nova.compute.manager [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 29 02:17:16 user nova-compute[75210]: DEBUG nova.compute.manager [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-411f722c-825f-4e5b-bcba-02288f0d94ce req-d638f71a-764b-4230-a91e-9a83ce9415cc service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-411f722c-825f-4e5b-bcba-02288f0d94ce req-d638f71a-764b-4230-a91e-9a83ce9415cc service nova] Acquiring lock "070330e3-0343-4915-a710-55caae091991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-411f722c-825f-4e5b-bcba-02288f0d94ce req-d638f71a-764b-4230-a91e-9a83ce9415cc service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-411f722c-825f-4e5b-bcba-02288f0d94ce req-d638f71a-764b-4230-a91e-9a83ce9415cc service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG nova.compute.manager [req-411f722c-825f-4e5b-bcba-02288f0d94ce req-d638f71a-764b-4230-a91e-9a83ce9415cc service nova] [instance: 070330e3-0343-4915-a710-55caae091991] No waiting events found dispatching network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:17:16 user nova-compute[75210]: WARNING nova.compute.manager [req-411f722c-825f-4e5b-bcba-02288f0d94ce req-d638f71a-764b-4230-a91e-9a83ce9415cc service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received unexpected event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 for instance with vm_state building and task_state spawning.
Nov 29 02:17:16 user nova-compute[75210]: INFO nova.compute.manager [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Took 6.11 seconds to build instance.
Nov 29 02:17:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-f418125f-1d31-41cc-beae-7db6949841a9 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.217s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:18 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:28 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 is timed out.
Nov 29 02:17:28 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Successfully detached device vdb from instance c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 from the live domain config.
Nov 29 02:17:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiyRQquO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:17:28 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[48505a83-c6ec-409a-8e09-13897814f47a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:17:28 user nova-compute[75210]: No targets found.
Nov 29 02:17:28 user nova-compute[75210]: iSNS:
Nov 29 02:17:28 user nova-compute[75210]: No targets found.
Nov 29 02:17:28 user nova-compute[75210]: STATIC:
Nov 29 02:17:28 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96
Nov 29 02:17:28 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:17:28 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:17:28 user nova-compute[75210]: FIRMWARE:
Nov 29 02:17:28 user nova-compute[75210]: No targets found.
Nov 29 02:17:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:17:28 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:17:28 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02ceb34-2e95-4f4e-8049-60c900d8e6b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4490af0-ea04-4df7-9a77-873bfe6673ae]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 (non-flash)
Nov 29 02:17:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 (non-flash)
Nov 29 02:17:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e84aacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef30714-8d1d-4113-9e13-65fb3a347cf3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[735ba901-48d7-4652-aac4-068b4a1dd9a5]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b728a2ed-a0c9-4e2f-9f84-3aa70c0dce14]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b26cbfd-9f60-4956-9978-16327e238373]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c73f71-40f7-4d98-a002-6a900fc2e33c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e799c55e-bc29-44d8-ab17-e6a2830622c7]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96, portal: 172.16.0.220,3260]
Nov 29 02:17:28 user nova-compute[75210]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96, portal: 172.16.0.220,3260] successful.
Nov 29 02:17:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dbf526-c72f-4c30-9850-e6ae19ee369f]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] <== disconnect_volume: return (279ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:17:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG nova.objects.instance [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lazy-loading 'flavor' on Instance uuid c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7ab84401-f0ee-4067-a169-1013fe292374 tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.656s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.543s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:29 user nova-compute[75210]: INFO nova.compute.manager [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Terminating instance
Nov 29 02:17:29 user nova-compute[75210]: DEBUG nova.compute.manager [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG nova.compute.manager [req-31e07ec0-1026-4ab5-b0d4-8b02df9b350e req-7d72fde2-cc04-4cf3-ac7b-0ed6dc79f47a service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Received event network-vif-unplugged-47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-31e07ec0-1026-4ab5-b0d4-8b02df9b350e req-7d72fde2-cc04-4cf3-ac7b-0ed6dc79f47a service nova] Acquiring lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-31e07ec0-1026-4ab5-b0d4-8b02df9b350e req-7d72fde2-cc04-4cf3-ac7b-0ed6dc79f47a service nova] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-31e07ec0-1026-4ab5-b0d4-8b02df9b350e req-7d72fde2-cc04-4cf3-ac7b-0ed6dc79f47a service nova] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG nova.compute.manager [req-31e07ec0-1026-4ab5-b0d4-8b02df9b350e req-7d72fde2-cc04-4cf3-ac7b-0ed6dc79f47a service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] No waiting events found dispatching network-vif-unplugged-47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG nova.compute.manager [req-31e07ec0-1026-4ab5-b0d4-8b02df9b350e req-7d72fde2-cc04-4cf3-ac7b-0ed6dc79f47a service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Received event network-vif-unplugged-47cb7fd9-aafa-421f-88c8-3cbc536957f2 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:17:29 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Instance destroyed successfully.
Nov 29 02:17:29 user nova-compute[75210]: DEBUG nova.objects.instance [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lazy-loading 'resources' on Instance uuid c8efc99b-bfaa-4bf1-b6f4-e08acb915a22 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:14:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1265589094',display_name='tempest-VolumesSnapshotTestJSON-instance-1265589094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1265589094',id=51,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDDWnxJmI8euaHIk4m4zLxq4WR6Mv9U2mzP9Q/XrQNeGW8+BwgP9aly7lsJ90Bhe49D05EX/hyhM6o8ycqjQ6jNyAVxX50xpzqp45EKjQvVZcjPBsBuDhchN6wxjl7hkw==',key_name='tempest-keypair-1726423560',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:14:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8eeb31f8c5e4610a53597d0c38f4c90',ramdisk_id='',reservation_id='r-mvc1smmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2023644237',owner_user_name='tempest-VolumesSnapshotTestJSON-2023644237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc97635cf0684427b552af6ea29e5ccc',uuid=c8efc99b-bfaa-4bf1-b6f4-e08acb915a22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "address": "fa:16:3e:b3:d2:89", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cb7fd9-aa", "ovs_interfaceid": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Converting VIF {"id": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "address": "fa:16:3e:b3:d2:89", "network": {"id": "961f7270-15c0-446f-ba41-f4912e8faf17", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1614823808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eeb31f8c5e4610a53597d0c38f4c90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47cb7fd9-aa", "ovs_interfaceid": "47cb7fd9-aafa-421f-88c8-3cbc536957f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=47cb7fd9-aafa-421f-88c8-3cbc536957f2,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cb7fd9-aa') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG os_vif [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=47cb7fd9-aafa-421f-88c8-3cbc536957f2,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cb7fd9-aa') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47cb7fd9-aa, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6352654f-622a-45eb-b5ed-b60eff0be59f) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:17:29 user nova-compute[75210]: INFO os_vif [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:d2:89,bridge_name='br-int',has_traffic_filtering=True,id=47cb7fd9-aafa-421f-88c8-3cbc536957f2,network=Network(961f7270-15c0-446f-ba41-f4912e8faf17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47cb7fd9-aa')
Nov 29 02:17:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:72fd7071-ae3d-4c9e-bbbc-edda3092db96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiyRQquO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:17:29 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:17:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[cbe95c23-4f65-4648-a462-fe147f1d7417]: Unexpected error while running command.
Nov 29 02:17:29 user nova-compute[75210]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 02:17:29 user nova-compute[75210]: Exit code: 21
Nov 29 02:17:29 user nova-compute[75210]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 02:17:29 user nova-compute[75210]: Stderr: '' {{(pid=85542) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 29 02:17:29 user nova-compute[75210]: Traceback (most recent call last):
Nov 29 02:17:29 user nova-compute[75210]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 29 02:17:29 user nova-compute[75210]:     ret = func(*f_args, **f_kwargs)
Nov 29 02:17:29 user nova-compute[75210]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 29 02:17:29 user nova-compute[75210]:     return func(*args, **kwargs)
Nov 29 02:17:29 user nova-compute[75210]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 29 02:17:29 user nova-compute[75210]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 29 02:17:29 user nova-compute[75210]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 29 02:17:29 user nova-compute[75210]:     return putils.execute(on_execute=on_execute,
Nov 29 02:17:29 user nova-compute[75210]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 29 02:17:29 user nova-compute[75210]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 29 02:17:29 user nova-compute[75210]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 29 02:17:29 user nova-compute[75210]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 02:17:29 user nova-compute[75210]: Exit code: 21
Nov 29 02:17:29 user nova-compute[75210]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 02:17:29 user nova-compute[75210]: Stderr: ''
Nov 29 02:17:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe95c23-4f65-4648-a462-fe147f1d7417]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 29 02:17:29 user nova-compute[75210]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 02:17:29 user nova-compute[75210]: Exit code: 21
Nov 29 02:17:29 user nova-compute[75210]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 02:17:29 user nova-compute[75210]: Stderr: ''
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 29 02:17:29 user nova-compute[75210]: ERROR os_brick.initiator.connectors.iscsi 
Nov 29 02:17:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75210) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.029s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] <== disconnect_volume: return (29ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:17:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:17:29 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Deleting instance files /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22_del
Nov 29 02:17:29 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Deletion of /opt/stack/data/nova/instances/c8efc99b-bfaa-4bf1-b6f4-e08acb915a22_del complete
Nov 29 02:17:30 user nova-compute[75210]: INFO nova.compute.manager [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 29 02:17:30 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:17:30 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:17:30 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:17:30 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:17:30 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Took 0.89 seconds to deallocate network for instance.
Nov 29 02:17:30 user nova-compute[75210]: DEBUG nova.compute.manager [req-7430741e-3035-4787-bbf9-e4c4809ea78b req-0b21e488-7942-46bf-a2b1-3af26a2b0689 service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Received event network-vif-deleted-47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:17:30 user nova-compute[75210]: WARNING nova.volume.cinder [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Attachment afc8479e-aeac-4396-84d5-a68677161e5c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = afc8479e-aeac-4396-84d5-a68677161e5c. (HTTP 404) (Request-ID: req-6fe7f222-e717-4655-92e1-4faedbb71e10)
Nov 29 02:17:30 user nova-compute[75210]: INFO nova.compute.manager [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Took 0.03 seconds to detach 1 volumes for instance.
Nov 29 02:17:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:31 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:17:31 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:17:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:31 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Deleted allocations for instance c8efc99b-bfaa-4bf1-b6f4-e08acb915a22
Nov 29 02:17:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-e19e9d2d-ca38-46e0-9eca-989562f9d9ff tempest-VolumesSnapshotTestJSON-2023644237 tempest-VolumesSnapshotTestJSON-2023644237-project-member] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.102s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-5aad87b4-e6ad-4b52-8881-c17137e35f6d req-6db8ffe1-c39c-4313-8126-b15db72d3639 service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Received event network-vif-plugged-47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:17:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5aad87b4-e6ad-4b52-8881-c17137e35f6d req-6db8ffe1-c39c-4313-8126-b15db72d3639 service nova] Acquiring lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:17:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5aad87b4-e6ad-4b52-8881-c17137e35f6d req-6db8ffe1-c39c-4313-8126-b15db72d3639 service nova] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:17:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-5aad87b4-e6ad-4b52-8881-c17137e35f6d req-6db8ffe1-c39c-4313-8126-b15db72d3639 service nova] Lock "c8efc99b-bfaa-4bf1-b6f4-e08acb915a22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:17:31 user nova-compute[75210]: DEBUG nova.compute.manager [req-5aad87b4-e6ad-4b52-8881-c17137e35f6d req-6db8ffe1-c39c-4313-8126-b15db72d3639 service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] No waiting events found dispatching network-vif-plugged-47cb7fd9-aafa-421f-88c8-3cbc536957f2 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:17:31 user nova-compute[75210]: WARNING nova.compute.manager [req-5aad87b4-e6ad-4b52-8881-c17137e35f6d req-6db8ffe1-c39c-4313-8126-b15db72d3639 service nova] [instance: c8efc99b-bfaa-4bf1-b6f4-e08acb915a22] Received unexpected event network-vif-plugged-47cb7fd9-aafa-421f-88c8-3cbc536957f2 for instance with vm_state deleted and task_state None.
Nov 29 02:17:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:17:51 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:17:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:54 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:17:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:17:56 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:17:56 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:17:57 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:17:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:17:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:17:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:17:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:17:57 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:17:57 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid 070330e3-0343-4915-a710-55caae091991 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:17:58 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Updating instance_info_cache with network_info: [{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:17:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:17:58 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:17:58 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:17:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:18:00 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:18:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:18:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:18:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:18:00 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:18:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:18:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:18:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:18:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:18:01 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:18:01 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:18:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=24.992321014404297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 070330e3-0343-4915-a710-55caae091991 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing inventories for resource provider 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating ProviderTree inventory for provider 28871a06-d5c8-43d0-87af-3689cd143011 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating inventory in ProviderTree for provider 28871a06-d5c8-43d0-87af-3689cd143011 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing aggregate associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, aggregates: None {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing trait associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, traits: HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:18:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:18:02 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:18:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances with incomplete migration  {{(pid=75210) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 02:18:03 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:18:03 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:18:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:18:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:18:07 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:18:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 02:18:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] There are 0 instances to clean {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 02:18:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:18:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:18:19 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:18:24 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:18:29 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:18:34 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:18:38 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:18:39 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:18:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:18:44 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:18:49 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:18:50 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:18:51 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:18:54 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:18:54 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:18:56 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:18:57 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:18:57 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:18:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:18:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:18:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:18:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:18:57 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:18:57 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid 070330e3-0343-4915-a710-55caae091991 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:18:57 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Updating instance_info_cache with network_info: [{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:18:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:18:57 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:18:59 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:18:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:18:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:18:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:18:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:18:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:18:59 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:00 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:19:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:19:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:19:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:19:00 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:19:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:01 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:19:01 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:19:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=24.990699768066406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:19:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:19:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:19:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 070330e3-0343-4915-a710-55caae091991 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:19:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:19:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:19:01 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:19:01 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:19:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:19:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "070330e3-0343-4915-a710-55caae091991" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG nova.objects.instance [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'flavor' on Instance uuid 070330e3-0343-4915-a710-55caae091991 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "070330e3-0343-4915-a710-55caae091991" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:19:04 user nova-compute[75210]: INFO nova.compute.manager [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Attaching volume e097afb0-08da-456c-8a71-d1f3db51567c to /dev/vdb
Nov 29 02:19:04 user nova-compute[75210]: DEBUG os_brick.utils [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e24b65-d4ea-4141-a6bd-05d1803ccad0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc16c0ef-65d6-4701-a9d0-ef670ea85f46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4317e2c-84d3-42a4-bc08-e2e5cd08640d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[97951203-12d4-49cc-aebe-695a403df382]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:19:04 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:19:04 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[090b2fe1-d4bc-43ff-a171-298aae10b4f8]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG os_brick.utils [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Updating existing volume attachment record: 77893fb5-5e9c-4756-8911-1e15f3afdd4e {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:19:04 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:19:05 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:19:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:19:05 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:19:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:19:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWutHKTV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:19:10 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:19:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:19:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:19:10 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:19:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:19:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:19:10 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:19:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:10 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af9b030-6430-458c-bcf7-302d3387e78b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:19:10 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:19:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:10 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b2fc5a-2a05-4daa-b44f-e370289d8de7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:10 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c] added
Nov 29 02:19:10 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:19:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e4494d-f617-4f24-b724-df111d1b3649]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ef2b8e-24a5-4588-957e-96602a3f51a7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWutHKTV {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FWutHKTV" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb9abc2-cd58-437c-b136-d400a8bd8e8c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FWutHKTV'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f68f0f8-ea42-4590-982b-381cd1727a40]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7226e23-32d6-4076-b133-ba6f2a52753d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:19:11 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:19:11 user nova-compute[75210]:  {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:19:11 user nova-compute[75210]: WARNING os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 02:19:11 user nova-compute[75210]: 
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3407272b-1f41-4249-bb5b-5d969f5caa42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c, portal: 172.16.0.220,3260]
Nov 29 02:19:11 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c, portal: 172.16.0.220,3260] successful.
Nov 29 02:19:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9ca2a3-51eb-46ce-b1f0-d52b537bd8ed]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[836a4705-8f4d-4831-9980-cd2b32b4a118]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c (non-flash)
Nov 29 02:19:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c (non-flash)
Nov 29 02:19:11 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d82e665-5be2-4042-a00c-ec5314ef106d]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:19:11 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:19:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:19:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWutHKTV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:19:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:19:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26634363062373734', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:19:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634363062373734', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:19:12 user nova-compute[75210]: DEBUG nova.objects.instance [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'flavor' on Instance uuid 070330e3-0343-4915-a710-55caae091991 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:19:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 02:19:12 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:19:12 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:19:12 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:19:12 user nova-compute[75210]:   <serial>e097afb0-08da-456c-8a71-d1f3db51567c</serial>
Nov 29 02:19:12 user nova-compute[75210]: </disk>
Nov 29 02:19:12 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 02:19:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:19:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:19:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] No VIF found with MAC fa:16:3e:a3:d9:05, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:19:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d1bbd277-a171-4fe7-b3f0-2158888fd4c2 tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.497s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:19:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-4576be26-6caa-4adb-8ba8-d02d24c16228 req-995772f5-a10a-4677-903f-b83857903a22 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-changed-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:19:14 user nova-compute[75210]: DEBUG nova.compute.manager [req-4576be26-6caa-4adb-8ba8-d02d24c16228 req-995772f5-a10a-4677-903f-b83857903a22 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Refreshing instance network info cache due to event network-changed-1aec9a00-7979-47c2-af6b-86edfcdcec70. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:19:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4576be26-6caa-4adb-8ba8-d02d24c16228 req-995772f5-a10a-4677-903f-b83857903a22 service nova] Acquiring lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:19:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4576be26-6caa-4adb-8ba8-d02d24c16228 req-995772f5-a10a-4677-903f-b83857903a22 service nova] Acquired lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:19:14 user nova-compute[75210]: DEBUG nova.network.neutron [req-4576be26-6caa-4adb-8ba8-d02d24c16228 req-995772f5-a10a-4677-903f-b83857903a22 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Refreshing network info cache for port 1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:19:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:19:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:19:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:19:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:19:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:19:15 user nova-compute[75210]: DEBUG nova.network.neutron [req-4576be26-6caa-4adb-8ba8-d02d24c16228 req-995772f5-a10a-4677-903f-b83857903a22 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Updated VIF entry in instance network info cache for port 1aec9a00-7979-47c2-af6b-86edfcdcec70. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:19:15 user nova-compute[75210]: DEBUG nova.network.neutron [req-4576be26-6caa-4adb-8ba8-d02d24c16228 req-995772f5-a10a-4677-903f-b83857903a22 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Updating instance_info_cache with network_info: [{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:19:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-4576be26-6caa-4adb-8ba8-d02d24c16228 req-995772f5-a10a-4677-903f-b83857903a22 service nova] Releasing lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:19:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-a350ebdf-47d1-4b75-8f48-e3c54092e065 req-67009141-e556-4ddb-8fc8-e47e78ad6296 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-changed-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:19:17 user nova-compute[75210]: DEBUG nova.compute.manager [req-a350ebdf-47d1-4b75-8f48-e3c54092e065 req-67009141-e556-4ddb-8fc8-e47e78ad6296 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Refreshing instance network info cache due to event network-changed-1aec9a00-7979-47c2-af6b-86edfcdcec70. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:19:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a350ebdf-47d1-4b75-8f48-e3c54092e065 req-67009141-e556-4ddb-8fc8-e47e78ad6296 service nova] Acquiring lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:19:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a350ebdf-47d1-4b75-8f48-e3c54092e065 req-67009141-e556-4ddb-8fc8-e47e78ad6296 service nova] Acquired lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:19:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-a350ebdf-47d1-4b75-8f48-e3c54092e065 req-67009141-e556-4ddb-8fc8-e47e78ad6296 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Refreshing network info cache for port 1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:19:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-a350ebdf-47d1-4b75-8f48-e3c54092e065 req-67009141-e556-4ddb-8fc8-e47e78ad6296 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Updated VIF entry in instance network info cache for port 1aec9a00-7979-47c2-af6b-86edfcdcec70. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:19:17 user nova-compute[75210]: DEBUG nova.network.neutron [req-a350ebdf-47d1-4b75-8f48-e3c54092e065 req-67009141-e556-4ddb-8fc8-e47e78ad6296 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Updating instance_info_cache with network_info: [{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:19:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-a350ebdf-47d1-4b75-8f48-e3c54092e065 req-67009141-e556-4ddb-8fc8-e47e78ad6296 service nova] Releasing lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:19:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-58ef9982-03b8-49ef-aaaa-3bc2f40e927e tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "070330e3-0343-4915-a710-55caae091991" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:19:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-58ef9982-03b8-49ef-aaaa-3bc2f40e927e tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:19:17 user nova-compute[75210]: INFO nova.compute.manager [None req-58ef9982-03b8-49ef-aaaa-3bc2f40e927e tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Rebooting instance
Nov 29 02:19:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-58ef9982-03b8-49ef-aaaa-3bc2f40e927e tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:19:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-58ef9982-03b8-49ef-aaaa-3bc2f40e927e tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquired lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:19:17 user nova-compute[75210]: DEBUG nova.network.neutron [None req-58ef9982-03b8-49ef-aaaa-3bc2f40e927e tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:19:18 user nova-compute[75210]: DEBUG nova.network.neutron [None req-58ef9982-03b8-49ef-aaaa-3bc2f40e927e tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Updating instance_info_cache with network_info: [{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:19:18 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-58ef9982-03b8-49ef-aaaa-3bc2f40e927e tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Releasing lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:19:18 user nova-compute[75210]: DEBUG nova.compute.manager [None req-58ef9982-03b8-49ef-aaaa-3bc2f40e927e tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:19:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:20 user nova-compute[75210]: DEBUG nova.compute.manager [req-98e064f2-07c1-479e-a120-f3d5cd21af99 req-a2f3789a-1b03-4b38-a2c9-71722bbae692 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-unplugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:19:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-98e064f2-07c1-479e-a120-f3d5cd21af99 req-a2f3789a-1b03-4b38-a2c9-71722bbae692 service nova] Acquiring lock "070330e3-0343-4915-a710-55caae091991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:19:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-98e064f2-07c1-479e-a120-f3d5cd21af99 req-a2f3789a-1b03-4b38-a2c9-71722bbae692 service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:19:20 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-98e064f2-07c1-479e-a120-f3d5cd21af99 req-a2f3789a-1b03-4b38-a2c9-71722bbae692 service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:19:20 user nova-compute[75210]: DEBUG nova.compute.manager [req-98e064f2-07c1-479e-a120-f3d5cd21af99 req-a2f3789a-1b03-4b38-a2c9-71722bbae692 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] No waiting events found dispatching network-vif-unplugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:19:20 user nova-compute[75210]: WARNING nova.compute.manager [req-98e064f2-07c1-479e-a120-f3d5cd21af99 req-a2f3789a-1b03-4b38-a2c9-71722bbae692 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received unexpected event network-vif-unplugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 for instance with vm_state active and task_state reboot_started.
Nov 29 02:19:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:21 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-58ef9982-03b8-49ef-aaaa-3bc2f40e927e tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Instance shutdown successfully.
Nov 29 02:19:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Acquiring lock "070330e3-0343-4915-a710-55caae091991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] No waiting events found dispatching network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:19:22 user nova-compute[75210]: WARNING nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received unexpected event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 for instance with vm_state active and task_state reboot_started.
Nov 29 02:19:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Acquiring lock "070330e3-0343-4915-a710-55caae091991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] No waiting events found dispatching network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:19:22 user nova-compute[75210]: WARNING nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received unexpected event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 for instance with vm_state active and task_state reboot_started.
Nov 29 02:19:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Acquiring lock "070330e3-0343-4915-a710-55caae091991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] No waiting events found dispatching network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:19:22 user nova-compute[75210]: WARNING nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received unexpected event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 for instance with vm_state active and task_state reboot_started.
Nov 29 02:19:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-unplugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Acquiring lock "070330e3-0343-4915-a710-55caae091991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] No waiting events found dispatching network-vif-unplugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:19:22 user nova-compute[75210]: WARNING nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received unexpected event network-vif-unplugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 for instance with vm_state active and task_state reboot_started.
Nov 29 02:19:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Acquiring lock "070330e3-0343-4915-a710-55caae091991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:19:22 user nova-compute[75210]: DEBUG nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] No waiting events found dispatching network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:19:22 user nova-compute[75210]: WARNING nova.compute.manager [req-8e293cd9-6d46-46ae-b89d-a475ab8491b2 req-e8dc4c07-4a0c-4bf7-a948-316f1964830a service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received unexpected event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 for instance with vm_state active and task_state reboot_started.
Nov 29 02:19:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:23 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-697b41be-7100-4fb8-a5ab-a4ec4982f746 req-7ff88f27-4119-4f0b-bd96-4f4777924332 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:19:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-697b41be-7100-4fb8-a5ab-a4ec4982f746 req-7ff88f27-4119-4f0b-bd96-4f4777924332 service nova] Acquiring lock "070330e3-0343-4915-a710-55caae091991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:19:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-697b41be-7100-4fb8-a5ab-a4ec4982f746 req-7ff88f27-4119-4f0b-bd96-4f4777924332 service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:19:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-697b41be-7100-4fb8-a5ab-a4ec4982f746 req-7ff88f27-4119-4f0b-bd96-4f4777924332 service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:19:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-697b41be-7100-4fb8-a5ab-a4ec4982f746 req-7ff88f27-4119-4f0b-bd96-4f4777924332 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] No waiting events found dispatching network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:19:24 user nova-compute[75210]: WARNING nova.compute.manager [req-697b41be-7100-4fb8-a5ab-a4ec4982f746 req-7ff88f27-4119-4f0b-bd96-4f4777924332 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received unexpected event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 for instance with vm_state active and task_state reboot_started.
Nov 29 02:19:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-697b41be-7100-4fb8-a5ab-a4ec4982f746 req-7ff88f27-4119-4f0b-bd96-4f4777924332 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:19:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-697b41be-7100-4fb8-a5ab-a4ec4982f746 req-7ff88f27-4119-4f0b-bd96-4f4777924332 service nova] Acquiring lock "070330e3-0343-4915-a710-55caae091991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:19:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-697b41be-7100-4fb8-a5ab-a4ec4982f746 req-7ff88f27-4119-4f0b-bd96-4f4777924332 service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:19:24 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-697b41be-7100-4fb8-a5ab-a4ec4982f746 req-7ff88f27-4119-4f0b-bd96-4f4777924332 service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:19:24 user nova-compute[75210]: DEBUG nova.compute.manager [req-697b41be-7100-4fb8-a5ab-a4ec4982f746 req-7ff88f27-4119-4f0b-bd96-4f4777924332 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] No waiting events found dispatching network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:19:24 user nova-compute[75210]: WARNING nova.compute.manager [req-697b41be-7100-4fb8-a5ab-a4ec4982f746 req-7ff88f27-4119-4f0b-bd96-4f4777924332 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received unexpected event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 for instance with vm_state active and task_state reboot_started.
Nov 29 02:19:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 070330e3-0343-4915-a710-55caae091991] Instance running successfully.
Nov 29 02:19:24 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-58ef9982-03b8-49ef-aaaa-3bc2f40e927e tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Instance soft rebooted successfully.
Nov 29 02:19:24 user nova-compute[75210]: DEBUG nova.compute.manager [None req-58ef9982-03b8-49ef-aaaa-3bc2f40e927e tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:19:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:25 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-58ef9982-03b8-49ef-aaaa-3bc2f40e927e tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.360s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:19:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:51 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:53 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:19:54 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:19:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:19:57 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:19:57 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:19:59 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:19:59 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:19:59 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:19:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:19:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:19:59 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:19:59 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid 070330e3-0343-4915-a710-55caae091991 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Updating instance_info_cache with network_info: [{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:20:00 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:20:01 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:20:01 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:20:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=9025MB free_disk=24.98078155517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:20:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:20:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:20:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 070330e3-0343-4915-a710-55caae091991 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:20:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:20:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:20:01 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:20:01 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:20:01 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:20:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:20:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:20:07 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:20:07 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:20:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:20:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:20:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:20:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:20:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:20:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:20:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:20:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:20:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:20:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:20:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:20:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:20:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:20:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:20:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:20:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:20:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:20:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:20:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:20:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:20:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:20:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:20:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:20:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:20:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:20:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:20:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:20:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:20:51 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:20:54 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:20:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:20:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:20:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:20:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:20:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:20:55 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:20:59 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:20:59 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:21:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:01 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:21:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:21:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:21:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:21:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:21:01 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:21:01 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid 070330e3-0343-4915-a710-55caae091991 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:21:01 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Updating instance_info_cache with network_info: [{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:21:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:21:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:21:01 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:21:01 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75210) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 29 02:21:02 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:21:02 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:21:02 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=9025MB free_disk=24.980236053466797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 070330e3-0343-4915-a710-55caae091991 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:21:02 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:21:03 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:21:03 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:21:03 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:21:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:21:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:21:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:21:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:21:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:21:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:09 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-7873168e-c368-4ac4-9f8d-f29ddf55d039 req-b51ff6ea-42a3-4d89-87a0-638473b3a7f0 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-changed-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:21:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-7873168e-c368-4ac4-9f8d-f29ddf55d039 req-b51ff6ea-42a3-4d89-87a0-638473b3a7f0 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Refreshing instance network info cache due to event network-changed-1aec9a00-7979-47c2-af6b-86edfcdcec70. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:21:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7873168e-c368-4ac4-9f8d-f29ddf55d039 req-b51ff6ea-42a3-4d89-87a0-638473b3a7f0 service nova] Acquiring lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:21:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7873168e-c368-4ac4-9f8d-f29ddf55d039 req-b51ff6ea-42a3-4d89-87a0-638473b3a7f0 service nova] Acquired lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:21:09 user nova-compute[75210]: DEBUG nova.network.neutron [req-7873168e-c368-4ac4-9f8d-f29ddf55d039 req-b51ff6ea-42a3-4d89-87a0-638473b3a7f0 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Refreshing network info cache for port 1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:21:09 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:21:09 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:21:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:21:09 user nova-compute[75210]: DEBUG nova.network.neutron [req-7873168e-c368-4ac4-9f8d-f29ddf55d039 req-b51ff6ea-42a3-4d89-87a0-638473b3a7f0 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Updated VIF entry in instance network info cache for port 1aec9a00-7979-47c2-af6b-86edfcdcec70. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:21:09 user nova-compute[75210]: DEBUG nova.network.neutron [req-7873168e-c368-4ac4-9f8d-f29ddf55d039 req-b51ff6ea-42a3-4d89-87a0-638473b3a7f0 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Updating instance_info_cache with network_info: [{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:21:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7873168e-c368-4ac4-9f8d-f29ddf55d039 req-b51ff6ea-42a3-4d89-87a0-638473b3a7f0 service nova] Releasing lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-dd7aef24-0493-4ab9-a081-94631bea93d2 req-2e2c200f-6e9b-4550-ba78-79fa3fb2c24c service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-changed-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG nova.compute.manager [req-dd7aef24-0493-4ab9-a081-94631bea93d2 req-2e2c200f-6e9b-4550-ba78-79fa3fb2c24c service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Refreshing instance network info cache due to event network-changed-1aec9a00-7979-47c2-af6b-86edfcdcec70. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dd7aef24-0493-4ab9-a081-94631bea93d2 req-2e2c200f-6e9b-4550-ba78-79fa3fb2c24c service nova] Acquiring lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dd7aef24-0493-4ab9-a081-94631bea93d2 req-2e2c200f-6e9b-4550-ba78-79fa3fb2c24c service nova] Acquired lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG nova.network.neutron [req-dd7aef24-0493-4ab9-a081-94631bea93d2 req-2e2c200f-6e9b-4550-ba78-79fa3fb2c24c service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Refreshing network info cache for port 1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "070330e3-0343-4915-a710-55caae091991" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:21:10 user nova-compute[75210]: INFO nova.compute.manager [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Detaching volume e097afb0-08da-456c-8a71-d1f3db51567c
Nov 29 02:21:10 user nova-compute[75210]: INFO nova.virt.block_device [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Attempting to driver detach volume e097afb0-08da-456c-8a71-d1f3db51567c from mountpoint /dev/vdb
Nov 29 02:21:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Attempting to detach device vdb from instance 070330e3-0343-4915-a710-55caae091991 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:21:10 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:21:10 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:21:10 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:21:10 user nova-compute[75210]:   <serial>e097afb0-08da-456c-8a71-d1f3db51567c</serial>
Nov 29 02:21:10 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:21:10 user nova-compute[75210]: </disk>
Nov 29 02:21:10 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:21:10 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Successfully detached device vdb from instance 070330e3-0343-4915-a710-55caae091991 from the persistent domain config.
Nov 29 02:21:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 070330e3-0343-4915-a710-55caae091991 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:21:10 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:21:10 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:21:10 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:21:10 user nova-compute[75210]:   <serial>e097afb0-08da-456c-8a71-d1f3db51567c</serial>
Nov 29 02:21:10 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:21:10 user nova-compute[75210]: </disk>
Nov 29 02:21:10 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG nova.network.neutron [req-dd7aef24-0493-4ab9-a081-94631bea93d2 req-2e2c200f-6e9b-4550-ba78-79fa3fb2c24c service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Updated VIF entry in instance network info cache for port 1aec9a00-7979-47c2-af6b-86edfcdcec70. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG nova.network.neutron [req-dd7aef24-0493-4ab9-a081-94631bea93d2 req-2e2c200f-6e9b-4550-ba78-79fa3fb2c24c service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Updating instance_info_cache with network_info: [{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-dd7aef24-0493-4ab9-a081-94631bea93d2 req-2e2c200f-6e9b-4550-ba78-79fa3fb2c24c service nova] Releasing lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:21:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 070330e3-0343-4915-a710-55caae091991 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:21:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:15 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:21:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:21:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:21:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:21:20 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:25 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:21:30 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 070330e3-0343-4915-a710-55caae091991 is timed out.
Nov 29 02:21:30 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Successfully detached device vdb from instance 070330e3-0343-4915-a710-55caae091991 from the live domain config.
Nov 29 02:21:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FWutHKTV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:21:30 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fce30dd-45c1-49ca-84be-98364f41c936]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:21:30 user nova-compute[75210]: No targets found.
Nov 29 02:21:30 user nova-compute[75210]: iSNS:
Nov 29 02:21:30 user nova-compute[75210]: No targets found.
Nov 29 02:21:30 user nova-compute[75210]: STATIC:
Nov 29 02:21:30 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c
Nov 29 02:21:30 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:21:30 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:21:30 user nova-compute[75210]: FIRMWARE:
Nov 29 02:21:30 user nova-compute[75210]: No targets found.
Nov 29 02:21:30 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:21:30 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:21:30 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a84647-6ee4-4614-906c-4179fc19b3c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2123447-202e-4d68-b407-d3ebc4f1cd5a]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c (non-flash)
Nov 29 02:21:30 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c (non-flash)
Nov 29 02:21:30 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23c4f3f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[45275461-e59c-462e-a900-623904865cb5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[660786e1-afb4-49e4-af8a-44eaf68025f7]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c901ec5-6702-4b90-bd10-0e362f90ab33]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea57e5c8-d17a-43fe-9c24-3d8391ebd41b]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[67291a9c-bc95-4c61-9bb5-3ad2be5d4aee]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:21:30 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:21:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:21:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e3dd01-81c7-473e-8bb8-ecb9acf60cfd]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:21:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c, portal: 172.16.0.220,3260]
Nov 29 02:21:31 user nova-compute[75210]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c, portal: 172.16.0.220,3260] successful.
Nov 29 02:21:31 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:21:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:21:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e097afb0-08da-456c-8a71-d1f3db51567c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:21:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[686caa4e-bff1-4cf4-8baa-2285584630ad]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:21:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:21:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:21:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] <== disconnect_volume: return (284ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:21:31 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:21:32 user nova-compute[75210]: DEBUG nova.objects.instance [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'flavor' on Instance uuid 070330e3-0343-4915-a710-55caae091991 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:21:32 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-696b406f-761f-432f-8bf2-4d4cdabae65d tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.941s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:21:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:21:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:21:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:21:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:21:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:21:35 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:40 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:21:45 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:21:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:21:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:21:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:21:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:21:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:21:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:21:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:21:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:21:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:21:55 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:21:56 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:21:59 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:22:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:22:01 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:22:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:22:01 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:22:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:22:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:22:01 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:22:01 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid 070330e3-0343-4915-a710-55caae091991 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Updating instance_info_cache with network_info: [{"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-070330e3-0343-4915-a710-55caae091991" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: 070330e3-0343-4915-a710-55caae091991] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:22:02 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:22:03 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:22:03 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:22:03 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=9000MB free_disk=24.979389190673828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:22:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:22:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:22:03 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance 070330e3-0343-4915-a710-55caae091991 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:22:03 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:22:03 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:22:03 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:22:03 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:22:03 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:22:03 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:22:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:22:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:22:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:22:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:22:05 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "070330e3-0343-4915-a710-55caae091991" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "070330e3-0343-4915-a710-55caae091991-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:22:07 user nova-compute[75210]: INFO nova.compute.manager [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Terminating instance
Nov 29 02:22:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-187a298f-f3eb-42ae-89c9-374219671c68 req-88a70c58-d28c-4e38-90ca-4e329e8685e6 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-unplugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-187a298f-f3eb-42ae-89c9-374219671c68 req-88a70c58-d28c-4e38-90ca-4e329e8685e6 service nova] Acquiring lock "070330e3-0343-4915-a710-55caae091991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-187a298f-f3eb-42ae-89c9-374219671c68 req-88a70c58-d28c-4e38-90ca-4e329e8685e6 service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-187a298f-f3eb-42ae-89c9-374219671c68 req-88a70c58-d28c-4e38-90ca-4e329e8685e6 service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-187a298f-f3eb-42ae-89c9-374219671c68 req-88a70c58-d28c-4e38-90ca-4e329e8685e6 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] No waiting events found dispatching network-vif-unplugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG nova.compute.manager [req-187a298f-f3eb-42ae-89c9-374219671c68 req-88a70c58-d28c-4e38-90ca-4e329e8685e6 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-unplugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:22:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: 070330e3-0343-4915-a710-55caae091991] Instance destroyed successfully.
Nov 29 02:22:07 user nova-compute[75210]: DEBUG nova.objects.instance [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lazy-loading 'resources' on Instance uuid 070330e3-0343-4915-a710-55caae091991 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-651883070',display_name='tempest-TestMinimumBasicScenario-server-651883070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-651883070',id=52,image_ref='becf2280-d295-4fdd-a52d-a4b309ff929c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsUe14BfzgeHzdgCaEpIcB0lI5EyF2YAt71kK4ymvF7LVWjTzLxcNbikI0GR0vf7CRDqQ9NN7diP+/inGaKSB0MC42Nr61Idyag7dA6GjuN37/SipW8bclvP30Uwat7Zg==',key_name='tempest-TestMinimumBasicScenario-1419589163',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:17:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='912ac2027baf41d6bfe9db163fe672f6',ramdisk_id='',reservation_id='r-t01pqfa5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='becf2280-d295-4fdd-a52d-a4b309ff929c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-717689186',owner_user_name='tempest-TestMinimumBasicScenario-717689186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:19:25Z,user_data=None,user_id='c401b408dbfd40abb3d75d44a56d0e6d',uuid=070330e3-0343-4915-a710-55caae091991,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converting VIF {"id": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "address": "fa:16:3e:a3:d9:05", "network": {"id": "0479b93d-4c07-434e-a388-b7f1e38b192c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1696993964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "912ac2027baf41d6bfe9db163fe672f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aec9a00-79", "ovs_interfaceid": "1aec9a00-7979-47c2-af6b-86edfcdcec70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:d9:05,bridge_name='br-int',has_traffic_filtering=True,id=1aec9a00-7979-47c2-af6b-86edfcdcec70,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aec9a00-79') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG os_vif [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:d9:05,bridge_name='br-int',has_traffic_filtering=True,id=1aec9a00-7979-47c2-af6b-86edfcdcec70,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aec9a00-79') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aec9a00-79, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ecb4796-7c89-4e41-9396-bd313c351c7d) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:07 user nova-compute[75210]: INFO os_vif [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:d9:05,bridge_name='br-int',has_traffic_filtering=True,id=1aec9a00-7979-47c2-af6b-86edfcdcec70,network=Network(0479b93d-4c07-434e-a388-b7f1e38b192c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aec9a00-79')
Nov 29 02:22:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Deleting instance files /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991_del
Nov 29 02:22:07 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Deletion of /opt/stack/data/nova/instances/070330e3-0343-4915-a710-55caae091991_del complete
Nov 29 02:22:07 user nova-compute[75210]: INFO nova.compute.manager [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] [instance: 070330e3-0343-4915-a710-55caae091991] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 29 02:22:07 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: 070330e3-0343-4915-a710-55caae091991] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:22:07 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 070330e3-0343-4915-a710-55caae091991] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:22:08 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:08 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: 070330e3-0343-4915-a710-55caae091991] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:22:08 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: 070330e3-0343-4915-a710-55caae091991] Took 0.48 seconds to deallocate network for instance.
Nov 29 02:22:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:22:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:22:08 user nova-compute[75210]: DEBUG nova.compute.manager [req-68ea7d41-603a-4f1d-a628-10cd00a25f36 req-532c03f7-a604-46d9-8f78-63b33b8a2dad service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-deleted-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:22:08 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:22:08 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:22:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:22:08 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Deleted allocations for instance 070330e3-0343-4915-a710-55caae091991
Nov 29 02:22:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-45d43288-2312-424b-89fd-df5138df1adc tempest-TestMinimumBasicScenario-717689186 tempest-TestMinimumBasicScenario-717689186-project-member] Lock "070330e3-0343-4915-a710-55caae091991" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.687s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:22:09 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:22:09 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:22:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:22:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-2a57a5a3-52d9-47ae-88b5-c9bc93c56a01 req-ba0dd6f3-5484-422d-9ca0-9be8966a8eb2 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:22:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2a57a5a3-52d9-47ae-88b5-c9bc93c56a01 req-ba0dd6f3-5484-422d-9ca0-9be8966a8eb2 service nova] Acquiring lock "070330e3-0343-4915-a710-55caae091991-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:22:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2a57a5a3-52d9-47ae-88b5-c9bc93c56a01 req-ba0dd6f3-5484-422d-9ca0-9be8966a8eb2 service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:22:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-2a57a5a3-52d9-47ae-88b5-c9bc93c56a01 req-ba0dd6f3-5484-422d-9ca0-9be8966a8eb2 service nova] Lock "070330e3-0343-4915-a710-55caae091991-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:22:09 user nova-compute[75210]: DEBUG nova.compute.manager [req-2a57a5a3-52d9-47ae-88b5-c9bc93c56a01 req-ba0dd6f3-5484-422d-9ca0-9be8966a8eb2 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] No waiting events found dispatching network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:22:09 user nova-compute[75210]: WARNING nova.compute.manager [req-2a57a5a3-52d9-47ae-88b5-c9bc93c56a01 req-ba0dd6f3-5484-422d-9ca0-9be8966a8eb2 service nova] [instance: 070330e3-0343-4915-a710-55caae091991] Received unexpected event network-vif-plugged-1aec9a00-7979-47c2-af6b-86edfcdcec70 for instance with vm_state deleted and task_state None.
Nov 29 02:22:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:22:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:22:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:22:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:22:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:22:52 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:22:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:22:55 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:22:56 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:22:56 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:22:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:22:58 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:00 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:23:02 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:23:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:23:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:23:02 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Didn't find any instances for network info cache update. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 02:23:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:03 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:23:04 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:23:04 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:23:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:23:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:23:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:23:04 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:23:04 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:23:04 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:23:04 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=9128MB free_disk=25.04619598388672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:23:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:23:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:23:05 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:23:05 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:23:05 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing inventories for resource provider 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 02:23:05 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating ProviderTree inventory for provider 28871a06-d5c8-43d0-87af-3689cd143011 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 02:23:05 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating inventory in ProviderTree for provider 28871a06-d5c8-43d0-87af-3689cd143011 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 02:23:05 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing aggregate associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, aggregates: None {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 02:23:05 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing trait associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, traits: HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 02:23:05 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:23:05 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:23:05 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:23:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:23:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:09 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:23:09 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:23:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 02:23:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] There are 0 instances to clean {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 02:23:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:23:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:23:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:23:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances with incomplete migration  {{(pid=75210) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 02:23:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:55 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:57 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:23:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:23:58 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:24:00 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:01 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:24:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:02 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_power_states {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:24:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:03 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:03 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:24:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:24:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:24:03 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Didn't find any instances for network info cache update. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 02:24:04 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:24:05 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:24:05 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:24:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:24:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:24:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:24:05 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:24:05 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:24:05 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:24:05 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=25.03244400024414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:24:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:24:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:24:06 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:24:06 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:24:06 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:24:06 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:24:06 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:24:06 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:24:06 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Starting instance... {{(pid=75210) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75210) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 29 02:24:09 user nova-compute[75210]: INFO nova.compute.claims [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Claim successful on node user
Nov 29 02:24:09 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Start building networks asynchronously for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Allocating IP information in the background. {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] allocate_for_instance() {{(pid=75210) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 29 02:24:09 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 29 02:24:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Start building block device mappings for instance. {{(pid=75210) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG nova.policy [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f05ff57f6ad942be9ae508c534cc5d19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b659cbef61b45dc8cd0267caabba7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75210) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Start spawning the instance on the hypervisor. {{(pid=75210) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Creating instance directory {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 29 02:24:09 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Creating image(s)
Nov 29 02:24:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "/opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "/opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:24:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.189s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f9b181358d6e12401ff067a4ff508cef838edbd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.236s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk 1073741824 {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8,backing_fmt=raw /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk 1073741824" returned: 0 in 0.097s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f9b181358d6e12401ff067a4ff508cef838edbd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Successfully created port: 007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f9b181358d6e12401ff067a4ff508cef838edbd8 --force-share --output=json" returned: 0 in 0.217s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk. size=1073741824 {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG nova.virt.disk.api [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Cannot resize image /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk to a smaller size. {{(pid=75210) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Created local disks {{(pid=75210) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Ensure instance console log exists: /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/console.log {{(pid=75210) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:24:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Successfully updated port: 007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquired lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Building network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-8926d9f7-5d86-4025-b80f-802a174b832f req-0d117d43-a19a-41db-80bb-97b846c25ead service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Received event network-changed-007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.compute.manager [req-8926d9f7-5d86-4025-b80f-802a174b832f req-0d117d43-a19a-41db-80bb-97b846c25ead service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Refreshing instance network info cache due to event network-changed-007c844b-e8f8-4126-8117-633546ce0901. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8926d9f7-5d86-4025-b80f-802a174b832f req-0d117d43-a19a-41db-80bb-97b846c25ead service nova] Acquiring lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Instance cache missing network info. {{(pid=75210) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.network.neutron [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating instance_info_cache with network_info: [{"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Releasing lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Instance network_info: |[{"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75210) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8926d9f7-5d86-4025-b80f-802a174b832f req-0d117d43-a19a-41db-80bb-97b846c25ead service nova] Acquired lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.network.neutron [req-8926d9f7-5d86-4025-b80f-802a174b832f req-0d117d43-a19a-41db-80bb-97b846c25ead service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Refreshing network info cache for port 007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Start _get_guest_xml network_info=[{"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'size': 0, 'image_id': '7071ee05-5aa5-4613-b78b-8f17b0ec59bc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 29 02:24:11 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:24:11 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] CPU controller missing on host. {{(pid=75210) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.host [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] CPU controller found on host. {{(pid=75210) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75210) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-29T01:32:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-29T01:32:39Z,direct_url=<?>,disk_format='qcow2',id=7071ee05-5aa5-4613-b78b-8f17b0ec59bc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d462191b18242ee876eccb74d204f68',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-29T01:32:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Flavor limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Image limits 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Flavor pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Image pref 0:0:0 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75210) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Got 1 possible topologies {{(pid=75210) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.hardware [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75210) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1529088599',display_name='tempest-SnapshotDataIntegrityTests-server-1529088599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1529088599',id=53,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFG4DltvjF5lbu72RMZghf7r4GkMpKCzluXG1IBM4/clz8F7lPtJkXjFzY4Ini0baBvE0tIp95wOHp9Nqe99ncqqWpaGhfLlq3O8x90Q0jeZVT9nxAEvcSuVIj1elKctg==',key_name='tempest-keypair-1232023627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b659cbef61b45dc8cd0267caabba7c8',ramdisk_id='',reservation_id='r-pc7xdrdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-724313800',owner_user_name='tempest-SnapshotDataIntegrityTests-724313800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:24:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05ff57f6ad942be9ae508c534cc5d19',uuid=f4703f38-74d3-4869-9504-c13d82920e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75210) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Converting VIF {"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=007c844b-e8f8-4126-8117-633546ce0901,network=Network(5de3924e-c420-415b-9726-6dbcddb2fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007c844b-e8') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'pci_devices' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] End _get_guest_xml xml=<domain type="kvm">
Nov 29 02:24:11 user nova-compute[75210]:   <uuid>f4703f38-74d3-4869-9504-c13d82920e40</uuid>
Nov 29 02:24:11 user nova-compute[75210]:   <name>instance-00000035</name>
Nov 29 02:24:11 user nova-compute[75210]:   <memory>524288</memory>
Nov 29 02:24:11 user nova-compute[75210]:   <vcpu>1</vcpu>
Nov 29 02:24:11 user nova-compute[75210]:   <metadata>
Nov 29 02:24:11 user nova-compute[75210]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 29 02:24:11 user nova-compute[75210]:       <nova:package version="0.0.0"/>
Nov 29 02:24:11 user nova-compute[75210]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1529088599</nova:name>
Nov 29 02:24:11 user nova-compute[75210]:       <nova:creationTime>2023-11-29 02:24:11</nova:creationTime>
Nov 29 02:24:11 user nova-compute[75210]:       <nova:flavor name="m1.tiny">
Nov 29 02:24:11 user nova-compute[75210]:         <nova:memory>512</nova:memory>
Nov 29 02:24:11 user nova-compute[75210]:         <nova:disk>1</nova:disk>
Nov 29 02:24:11 user nova-compute[75210]:         <nova:swap>0</nova:swap>
Nov 29 02:24:11 user nova-compute[75210]:         <nova:ephemeral>0</nova:ephemeral>
Nov 29 02:24:11 user nova-compute[75210]:         <nova:vcpus>1</nova:vcpus>
Nov 29 02:24:11 user nova-compute[75210]:       </nova:flavor>
Nov 29 02:24:11 user nova-compute[75210]:       <nova:owner>
Nov 29 02:24:11 user nova-compute[75210]:         <nova:user uuid="f05ff57f6ad942be9ae508c534cc5d19">tempest-SnapshotDataIntegrityTests-724313800-project-member</nova:user>
Nov 29 02:24:11 user nova-compute[75210]:         <nova:project uuid="9b659cbef61b45dc8cd0267caabba7c8">tempest-SnapshotDataIntegrityTests-724313800</nova:project>
Nov 29 02:24:11 user nova-compute[75210]:       </nova:owner>
Nov 29 02:24:11 user nova-compute[75210]:       <nova:root type="image" uuid="7071ee05-5aa5-4613-b78b-8f17b0ec59bc"/>
Nov 29 02:24:11 user nova-compute[75210]:       <nova:ports>
Nov 29 02:24:11 user nova-compute[75210]:         <nova:port uuid="007c844b-e8f8-4126-8117-633546ce0901">
Nov 29 02:24:11 user nova-compute[75210]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 29 02:24:11 user nova-compute[75210]:         </nova:port>
Nov 29 02:24:11 user nova-compute[75210]:       </nova:ports>
Nov 29 02:24:11 user nova-compute[75210]:     </nova:instance>
Nov 29 02:24:11 user nova-compute[75210]:   </metadata>
Nov 29 02:24:11 user nova-compute[75210]:   <sysinfo type="smbios">
Nov 29 02:24:11 user nova-compute[75210]:     <system>
Nov 29 02:24:11 user nova-compute[75210]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 29 02:24:11 user nova-compute[75210]:       <entry name="product">OpenStack Nova</entry>
Nov 29 02:24:11 user nova-compute[75210]:       <entry name="version">0.0.0</entry>
Nov 29 02:24:11 user nova-compute[75210]:       <entry name="serial">f4703f38-74d3-4869-9504-c13d82920e40</entry>
Nov 29 02:24:11 user nova-compute[75210]:       <entry name="uuid">f4703f38-74d3-4869-9504-c13d82920e40</entry>
Nov 29 02:24:11 user nova-compute[75210]:       <entry name="family">Virtual Machine</entry>
Nov 29 02:24:11 user nova-compute[75210]:     </system>
Nov 29 02:24:11 user nova-compute[75210]:   </sysinfo>
Nov 29 02:24:11 user nova-compute[75210]:   <os>
Nov 29 02:24:11 user nova-compute[75210]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 29 02:24:11 user nova-compute[75210]:     <boot dev="hd"/>
Nov 29 02:24:11 user nova-compute[75210]:     <smbios mode="sysinfo"/>
Nov 29 02:24:11 user nova-compute[75210]:   </os>
Nov 29 02:24:11 user nova-compute[75210]:   <features>
Nov 29 02:24:11 user nova-compute[75210]:     <acpi/>
Nov 29 02:24:11 user nova-compute[75210]:     <apic/>
Nov 29 02:24:11 user nova-compute[75210]:     <vmcoreinfo/>
Nov 29 02:24:11 user nova-compute[75210]:   </features>
Nov 29 02:24:11 user nova-compute[75210]:   <clock offset="utc">
Nov 29 02:24:11 user nova-compute[75210]:     <timer name="pit" tickpolicy="delay"/>
Nov 29 02:24:11 user nova-compute[75210]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 29 02:24:11 user nova-compute[75210]:     <timer name="hpet" present="no"/>
Nov 29 02:24:11 user nova-compute[75210]:   </clock>
Nov 29 02:24:11 user nova-compute[75210]:   <cpu mode="custom" match="exact">
Nov 29 02:24:11 user nova-compute[75210]:     <model>Nehalem</model>
Nov 29 02:24:11 user nova-compute[75210]:     <topology sockets="1" cores="1" threads="1"/>
Nov 29 02:24:11 user nova-compute[75210]:   </cpu>
Nov 29 02:24:11 user nova-compute[75210]:   <devices>
Nov 29 02:24:11 user nova-compute[75210]:     <disk type="file" device="disk">
Nov 29 02:24:11 user nova-compute[75210]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 29 02:24:11 user nova-compute[75210]:       <source file="/opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk"/>
Nov 29 02:24:11 user nova-compute[75210]:       <target dev="vda" bus="virtio"/>
Nov 29 02:24:11 user nova-compute[75210]:     </disk>
Nov 29 02:24:11 user nova-compute[75210]:     <interface type="ethernet">
Nov 29 02:24:11 user nova-compute[75210]:       <mac address="fa:16:3e:41:f1:51"/>
Nov 29 02:24:11 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:24:11 user nova-compute[75210]:       <mtu size="1442"/>
Nov 29 02:24:11 user nova-compute[75210]:       <target dev="tap007c844b-e8"/>
Nov 29 02:24:11 user nova-compute[75210]:     </interface>
Nov 29 02:24:11 user nova-compute[75210]:     <serial type="pty">
Nov 29 02:24:11 user nova-compute[75210]:       <log file="/opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/console.log" append="off"/>
Nov 29 02:24:11 user nova-compute[75210]:     </serial>
Nov 29 02:24:11 user nova-compute[75210]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 29 02:24:11 user nova-compute[75210]:     <video>
Nov 29 02:24:11 user nova-compute[75210]:       <model type="virtio"/>
Nov 29 02:24:11 user nova-compute[75210]:     </video>
Nov 29 02:24:11 user nova-compute[75210]:     <rng model="virtio">
Nov 29 02:24:11 user nova-compute[75210]:       <backend model="random">/dev/urandom</backend>
Nov 29 02:24:11 user nova-compute[75210]:     </rng>
Nov 29 02:24:11 user nova-compute[75210]:     <controller type="usb" index="0" model="none"/>
Nov 29 02:24:11 user nova-compute[75210]:     <memballoon model="virtio">
Nov 29 02:24:11 user nova-compute[75210]:       <stats period="10"/>
Nov 29 02:24:11 user nova-compute[75210]:     </memballoon>
Nov 29 02:24:11 user nova-compute[75210]:   </devices>
Nov 29 02:24:11 user nova-compute[75210]: </domain>
Nov 29 02:24:11 user nova-compute[75210]:  {{(pid=75210) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1529088599',display_name='tempest-SnapshotDataIntegrityTests-server-1529088599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1529088599',id=53,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFG4DltvjF5lbu72RMZghf7r4GkMpKCzluXG1IBM4/clz8F7lPtJkXjFzY4Ini0baBvE0tIp95wOHp9Nqe99ncqqWpaGhfLlq3O8x90Q0jeZVT9nxAEvcSuVIj1elKctg==',key_name='tempest-keypair-1232023627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b659cbef61b45dc8cd0267caabba7c8',ramdisk_id='',reservation_id='r-pc7xdrdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-724313800',owner_user_name='tempest-SnapshotDataIntegrityTests-724313800-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-29T02:24:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05ff57f6ad942be9ae508c534cc5d19',uuid=f4703f38-74d3-4869-9504-c13d82920e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Converting VIF {"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=007c844b-e8f8-4126-8117-633546ce0901,network=Network(5de3924e-c420-415b-9726-6dbcddb2fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007c844b-e8') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG os_vif [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=007c844b-e8f8-4126-8117-633546ce0901,network=Network(5de3924e-c420-415b-9726-6dbcddb2fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007c844b-e8') {{(pid=75210) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a2fb1fe-f09c-5ced-818b-531433d2d27e', '_type': 'linux-noop'}}, row=False) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap007c844b-e8, may_exist=True, interface_attrs={}) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap007c844b-e8, col_values=(('qos', UUID('30354885-8c2b-4024-a60d-c0a956ba8077')),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap007c844b-e8, col_values=(('external_ids', {'iface-id': '007c844b-e8f8-4126-8117-633546ce0901', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:f1:51', 'vm-uuid': 'f4703f38-74d3-4869-9504-c13d82920e40'}),), if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:24:11 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:24:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:12 user nova-compute[75210]: INFO os_vif [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=007c844b-e8f8-4126-8117-633546ce0901,network=Network(5de3924e-c420-415b-9726-6dbcddb2fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007c844b-e8')
Nov 29 02:24:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:24:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No VIF found with MAC fa:16:3e:41:f1:51, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:24:12 user nova-compute[75210]: DEBUG nova.network.neutron [req-8926d9f7-5d86-4025-b80f-802a174b832f req-0d117d43-a19a-41db-80bb-97b846c25ead service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updated VIF entry in instance network info cache for port 007c844b-e8f8-4126-8117-633546ce0901. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:24:12 user nova-compute[75210]: DEBUG nova.network.neutron [req-8926d9f7-5d86-4025-b80f-802a174b832f req-0d117d43-a19a-41db-80bb-97b846c25ead service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating instance_info_cache with network_info: [{"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:24:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-8926d9f7-5d86-4025-b80f-802a174b832f req-0d117d43-a19a-41db-80bb-97b846c25ead service nova] Releasing lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:24:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:24:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:24:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:13 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-6b4c1632-3e29-4585-bb23-1e7b59172270 req-98af6be2-fdf8-4598-b158-d59841161a29 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Received event network-vif-plugged-007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:24:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6b4c1632-3e29-4585-bb23-1e7b59172270 req-98af6be2-fdf8-4598-b158-d59841161a29 service nova] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:24:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6b4c1632-3e29-4585-bb23-1e7b59172270 req-98af6be2-fdf8-4598-b158-d59841161a29 service nova] Lock "f4703f38-74d3-4869-9504-c13d82920e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:24:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-6b4c1632-3e29-4585-bb23-1e7b59172270 req-98af6be2-fdf8-4598-b158-d59841161a29 service nova] Lock "f4703f38-74d3-4869-9504-c13d82920e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:24:13 user nova-compute[75210]: DEBUG nova.compute.manager [req-6b4c1632-3e29-4585-bb23-1e7b59172270 req-98af6be2-fdf8-4598-b158-d59841161a29 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] No waiting events found dispatching network-vif-plugged-007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:24:13 user nova-compute[75210]: WARNING nova.compute.manager [req-6b4c1632-3e29-4585-bb23-1e7b59172270 req-98af6be2-fdf8-4598-b158-d59841161a29 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Received unexpected event network-vif-plugged-007c844b-e8f8-4126-8117-633546ce0901 for instance with vm_state building and task_state spawning.
Nov 29 02:24:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:14 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:15 user nova-compute[75210]: DEBUG nova.compute.manager [req-1c114a96-5542-404f-957c-25f05f360891 req-002b5933-6174-4ed5-9a18-9eb3c7113c42 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Received event network-vif-plugged-007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:24:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1c114a96-5542-404f-957c-25f05f360891 req-002b5933-6174-4ed5-9a18-9eb3c7113c42 service nova] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:24:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1c114a96-5542-404f-957c-25f05f360891 req-002b5933-6174-4ed5-9a18-9eb3c7113c42 service nova] Lock "f4703f38-74d3-4869-9504-c13d82920e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:24:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-1c114a96-5542-404f-957c-25f05f360891 req-002b5933-6174-4ed5-9a18-9eb3c7113c42 service nova] Lock "f4703f38-74d3-4869-9504-c13d82920e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:24:15 user nova-compute[75210]: DEBUG nova.compute.manager [req-1c114a96-5542-404f-957c-25f05f360891 req-002b5933-6174-4ed5-9a18-9eb3c7113c42 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] No waiting events found dispatching network-vif-plugged-007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:24:15 user nova-compute[75210]: WARNING nova.compute.manager [req-1c114a96-5542-404f-957c-25f05f360891 req-002b5933-6174-4ed5-9a18-9eb3c7113c42 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Received unexpected event network-vif-plugged-007c844b-e8f8-4126-8117-633546ce0901 for instance with vm_state building and task_state spawning.
Nov 29 02:24:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Instance event wait completed in 0 seconds for  {{(pid=75210) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 29 02:24:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Guest created on hypervisor {{(pid=75210) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 29 02:24:15 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Instance spawned successfully.
Nov 29 02:24:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 29 02:24:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Found default for hw_cdrom_bus of ide {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:24:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Found default for hw_disk_bus of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:24:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Found default for hw_input_bus of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:24:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Found default for hw_pointer_model of None {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:24:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Found default for hw_video_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:24:15 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Found default for hw_vif_model of virtio {{(pid=75210) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 29 02:24:15 user nova-compute[75210]: INFO nova.compute.manager [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 29 02:24:15 user nova-compute[75210]: DEBUG nova.compute.manager [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Checking state {{(pid=75210) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 29 02:24:15 user nova-compute[75210]: INFO nova.compute.manager [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Took 6.69 seconds to build instance.
Nov 29 02:24:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c386d984-6020-43a5-837d-03de9892ee70 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.823s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:24:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:16 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:24:21 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:24:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:24:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:24:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:26 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:31 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:36 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:41 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:46 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:24:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:24:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:24:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:24:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:56 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:24:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:24:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:24:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:24:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:24:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:24:58 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:25:00 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:25:01 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:25:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:25:05 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:25:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:25:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:25:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:25:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:25:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:25:05 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:25:05 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating instance_info_cache with network_info: [{"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:25:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:25:05 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:25:05 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:25:06 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:25:07 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:25:08 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:25:08 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:25:08 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=25.000137329101562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:25:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:25:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:25:08 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance f4703f38-74d3-4869-9504-c13d82920e40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:25:08 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:25:08 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:25:08 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:25:08 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:25:08 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:25:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:25:09 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:25:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:25:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:25:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:25:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:25:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:25:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:25:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:25:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:25:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:25:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:25:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:25:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:25:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:25:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:25:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:25:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:25:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:25:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:25:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:26:00 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:26:00 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:26:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-7f304b8c-d3ab-42d2-9279-a2a486c683b8 req-b967d7c4-5624-47ec-9692-10df6b997500 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Received event network-changed-007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:26:00 user nova-compute[75210]: DEBUG nova.compute.manager [req-7f304b8c-d3ab-42d2-9279-a2a486c683b8 req-b967d7c4-5624-47ec-9692-10df6b997500 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Refreshing instance network info cache due to event network-changed-007c844b-e8f8-4126-8117-633546ce0901. {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 29 02:26:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7f304b8c-d3ab-42d2-9279-a2a486c683b8 req-b967d7c4-5624-47ec-9692-10df6b997500 service nova] Acquiring lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:26:00 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7f304b8c-d3ab-42d2-9279-a2a486c683b8 req-b967d7c4-5624-47ec-9692-10df6b997500 service nova] Acquired lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:26:00 user nova-compute[75210]: DEBUG nova.network.neutron [req-7f304b8c-d3ab-42d2-9279-a2a486c683b8 req-b967d7c4-5624-47ec-9692-10df6b997500 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Refreshing network info cache for port 007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 29 02:26:01 user nova-compute[75210]: DEBUG nova.network.neutron [req-7f304b8c-d3ab-42d2-9279-a2a486c683b8 req-b967d7c4-5624-47ec-9692-10df6b997500 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updated VIF entry in instance network info cache for port 007c844b-e8f8-4126-8117-633546ce0901. {{(pid=75210) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 29 02:26:01 user nova-compute[75210]: DEBUG nova.network.neutron [req-7f304b8c-d3ab-42d2-9279-a2a486c683b8 req-b967d7c4-5624-47ec-9692-10df6b997500 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating instance_info_cache with network_info: [{"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:26:01 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-7f304b8c-d3ab-42d2-9279-a2a486c683b8 req-b967d7c4-5624-47ec-9692-10df6b997500 service nova] Releasing lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:26:01 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:02 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG nova.objects.instance [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'flavor' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:26:05 user nova-compute[75210]: INFO nova.compute.manager [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Attaching volume 8dee0348-dbd9-41da-b2ba-aabf63d17b84 to /dev/vdb
Nov 29 02:26:05 user nova-compute[75210]: DEBUG os_brick.utils [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[135c8ad1-f1f7-4f90-b176-409342eac8b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f1e5b3-7c6b-41c8-ab13-6a5e10a6d1f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a628796-5580-4584-bb70-65506c21403f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5adb76e-df73-4ccc-9541-45460eb96419]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:26:05 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:26:05 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0467aa3d-72fe-4dd3-ba3d-8e20046ff78b]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG os_brick.utils [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:26:05 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating existing volume attachment record: eb9b5117-b9f5-4678-b9cc-ddf2d28892f4 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:26:06 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:26:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:07 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:26:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:26:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:26:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:26:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:26:07 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:26:07 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:26:07 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating instance_info_cache with network_info: [{"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:26:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:26:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:26:08 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:26:09 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:26:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:26:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:26:09 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:26:09 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:26:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:09 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:10 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:26:10 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:26:10 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=24.999122619628906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:26:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:26:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:26:10 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance f4703f38-74d3-4869-9504-c13d82920e40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:26:10 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:26:10 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:26:10 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:26:10 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:26:10 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:26:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:26:11 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFhqXHiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:26:12 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:26:12 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:26:12 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[906ea8ff-5c8f-4ce2-b078-69071e1249ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:26:12 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1c0ee8-e5f9-489c-8b41-7b53100e9793]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84] added
Nov 29 02:26:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd82f47-7a5c-421c-9766-0ab936792cba]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba26ec8-6ec3-4d0a-bdce-b076ab6a8e3e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GFhqXHiI {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GFhqXHiI" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd55066-b908-449e-80e6-e3431de13a4d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GFhqXHiI'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b179d9-1c1d-4f3a-a0f7-92d3041be56c]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b82dca7-70f0-4ea7-975f-0fb505d7f404]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:26:12 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:26:12 user nova-compute[75210]:  {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:26:12 user nova-compute[75210]: WARNING os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 02:26:12 user nova-compute[75210]: 
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8c6fda-a1a6-48f4-b43a-0bada442edff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84, portal: 172.16.0.220,3260]
Nov 29 02:26:12 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84, portal: 172.16.0.220,3260] successful.
Nov 29 02:26:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b1bd70-3e62-4827-9207-263def938ab4]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe0dc35-c43a-4ee8-9f0a-b64cfed41bc7]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 (non-flash)
Nov 29 02:26:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 (non-flash)
Nov 29 02:26:12 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef6aa60-7060-417a-861d-10fea3e73e43]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:26:12 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFhqXHiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:26:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:26:13 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23831366262343436', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:26:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831366262343436', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:26:13 user nova-compute[75210]: DEBUG nova.objects.instance [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'flavor' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:26:13 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 02:26:13 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:26:13 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:26:13 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:26:13 user nova-compute[75210]:   <serial>8dee0348-dbd9-41da-b2ba-aabf63d17b84</serial>
Nov 29 02:26:13 user nova-compute[75210]: </disk>
Nov 29 02:26:13 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 02:26:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:26:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:26:14 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No VIF found with MAC fa:16:3e:41:f1:51, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:26:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-bba9f3fd-f3c2-47d7-a1e0-0ba4eb838b2e tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.819s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:26:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:26:28 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:26:28 user nova-compute[75210]: INFO nova.compute.manager [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Detaching volume 8dee0348-dbd9-41da-b2ba-aabf63d17b84
Nov 29 02:26:28 user nova-compute[75210]: INFO nova.virt.block_device [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Attempting to driver detach volume 8dee0348-dbd9-41da-b2ba-aabf63d17b84 from mountpoint /dev/vdb
Nov 29 02:26:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Attempting to detach device vdb from instance f4703f38-74d3-4869-9504-c13d82920e40 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:26:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:26:28 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:26:28 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:26:28 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:26:28 user nova-compute[75210]:   <serial>8dee0348-dbd9-41da-b2ba-aabf63d17b84</serial>
Nov 29 02:26:28 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:26:28 user nova-compute[75210]: </disk>
Nov 29 02:26:28 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:26:28 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Successfully detached device vdb from instance f4703f38-74d3-4869-9504-c13d82920e40 from the persistent domain config.
Nov 29 02:26:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4703f38-74d3-4869-9504-c13d82920e40 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:26:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:26:28 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:26:28 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:26:28 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:26:28 user nova-compute[75210]:   <serial>8dee0348-dbd9-41da-b2ba-aabf63d17b84</serial>
Nov 29 02:26:28 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:26:28 user nova-compute[75210]: </disk>
Nov 29 02:26:28 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:26:29 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:26:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:26:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:26:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:26:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:26:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:26:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:26:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:26:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:26:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:26:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:49 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f4703f38-74d3-4869-9504-c13d82920e40 is timed out.
Nov 29 02:26:49 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Successfully detached device vdb from instance f4703f38-74d3-4869-9504-c13d82920e40 from the live domain config.
Nov 29 02:26:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GFhqXHiI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:26:49 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[290f10e7-1695-49e0-bb96-8a3c276557f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:26:49 user nova-compute[75210]: No targets found.
Nov 29 02:26:49 user nova-compute[75210]: iSNS:
Nov 29 02:26:49 user nova-compute[75210]: No targets found.
Nov 29 02:26:49 user nova-compute[75210]: STATIC:
Nov 29 02:26:49 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84
Nov 29 02:26:49 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:26:49 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:26:49 user nova-compute[75210]: FIRMWARE:
Nov 29 02:26:49 user nova-compute[75210]: No targets found.
Nov 29 02:26:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:26:49 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:26:49 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c606f396-d489-4c99-93d7-39a306a58681]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d5cace-f930-40d2-a4ef-777ae45000de]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 (non-flash)
Nov 29 02:26:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 (non-flash)
Nov 29 02:26:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2408118310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30f1fde-1064-4bf5-8ee5-1a34c52264f5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e885f848-b4dd-4384-b78b-4409f429f5d0]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfebd448-4c62-4ad2-a9fa-9330d2942386]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb9dca6-abfe-4d63-9730-669a71585e01]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b3c7ac-e532-416b-b3ea-5b8200bcf5bf]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc0191f-e6e2-417a-bc07-60c37d3b57fa]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84, portal: 172.16.0.220,3260]
Nov 29 02:26:49 user nova-compute[75210]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84, portal: 172.16.0.220,3260] successful.
Nov 29 02:26:49 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8dee0348-dbd9-41da-b2ba-aabf63d17b84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21a8cbf-1b6b-42a5-8723-c72a9c8b69bb]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] <== disconnect_volume: return (282ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:26:49 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:26:50 user nova-compute[75210]: DEBUG nova.objects.instance [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'flavor' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:26:50 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7b4ed085-beb5-417a-85eb-c80e5c724e18 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.859s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:26:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:26:56 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:26:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:26:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:26:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:26:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:26:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:26:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:27:00 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:27:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:27:02 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:27:03 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:27:06 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:27:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:27:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:27:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:27:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:27:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:27:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:27:07 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:27:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:27:07 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:27:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:27:07 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:27:07 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:27:07 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:27:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating instance_info_cache with network_info: [{"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:27:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:27:08 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:27:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:27:11 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:27:11 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:27:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:27:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:27:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:27:11 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:27:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:11 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:27:12 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:27:12 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:27:12 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=24.99811553955078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:27:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:27:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:27:12 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance f4703f38-74d3-4869-9504-c13d82920e40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:27:12 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:27:12 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:27:12 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:27:12 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:27:12 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:27:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:27:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:27:13 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:27:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:27:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:27:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:27:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:27:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:27:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG nova.objects.instance [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'flavor' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:27:21 user nova-compute[75210]: INFO nova.compute.manager [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Attaching volume b80c0792-5232-47db-82ff-bed69ed6b291 to /dev/vdb
Nov 29 02:27:21 user nova-compute[75210]: DEBUG os_brick.utils [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[00298616-6c96-4e0f-8643-cebc727fad6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[523215bd-b476-4eb8-bda4-7d6b0d8a1845]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9975fa-70f5-402e-9854-323388d32dea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[796bb0de-7bfa-4761-b628-54354a7c9068]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:21 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:27:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:27:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:27:22 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:27:22 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:27:22 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c477add-a1f5-404f-9da2-f6fa677c5d92]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:27:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:27:22 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:27:22 user nova-compute[75210]: DEBUG os_brick.utils [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:27:22 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating existing volume attachment record: a150269c-65f6-445f-8598-51864a10f692 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:27:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:27:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:27:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:27:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:27:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:27:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:27:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqvDSZPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:27:28 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:27:28 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:27:28 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a95fc3-fa40-45c4-9d79-d9ac2e29d928]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:27:28 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[13827727-d530-428f-bd04-fe10809bf5f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291] added
Nov 29 02:27:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44baf69-85c8-4a76-9b7b-a91fbc9357e7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d3f39-7d10-466d-894a-5a1acbe314be]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqvDSZPC {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqvDSZPC" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[7749b131-8e70-40b1-a4db-1b624cebabf3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fqvDSZPC'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9e4d3f-5e07-4d84-83bc-43d101018ebc]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ea931a-0cd9-411c-a8ff-62258e910e4f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:27:28 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:27:28 user nova-compute[75210]:  {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:27:28 user nova-compute[75210]: WARNING os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 02:27:28 user nova-compute[75210]: 
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b68ba1-7008-4dac-a90c-043a06dd33d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291, portal: 172.16.0.220,3260]
Nov 29 02:27:28 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291, portal: 172.16.0.220,3260] successful.
Nov 29 02:27:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfc31f6-f06f-4ea2-8bec-2a48813b72f8]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[54996393-be41-44bc-bbae-e4c72ae5bd6c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 (non-flash)
Nov 29 02:27:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 (non-flash)
Nov 29 02:27:28 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:27:28 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:29 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:29 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[07425429-0a4f-4bd2-81c1-c15ce2e320bc]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:29 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:27:30 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:27:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqvDSZPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:27:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:27:30 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26364396539366664', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:27:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364396539366664', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:27:30 user nova-compute[75210]: DEBUG nova.objects.instance [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'flavor' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:27:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 02:27:30 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:27:30 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:27:30 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:27:30 user nova-compute[75210]:   <serial>b80c0792-5232-47db-82ff-bed69ed6b291</serial>
Nov 29 02:27:30 user nova-compute[75210]: </disk>
Nov 29 02:27:30 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 02:27:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:27:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:27:30 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No VIF found with MAC fa:16:3e:41:f1:51, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:27:30 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-277b514d-9aa0-48c9-8ac7-fdd13296c1bf tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.730s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:27:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:27:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:27:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:27:33 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:27:33 user nova-compute[75210]: INFO nova.compute.manager [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Detaching volume b80c0792-5232-47db-82ff-bed69ed6b291
Nov 29 02:27:33 user nova-compute[75210]: INFO nova.virt.block_device [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Attempting to driver detach volume b80c0792-5232-47db-82ff-bed69ed6b291 from mountpoint /dev/vdb
Nov 29 02:27:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Attempting to detach device vdb from instance f4703f38-74d3-4869-9504-c13d82920e40 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:27:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:27:33 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:27:33 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:27:33 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:27:33 user nova-compute[75210]:   <serial>b80c0792-5232-47db-82ff-bed69ed6b291</serial>
Nov 29 02:27:33 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:27:33 user nova-compute[75210]: </disk>
Nov 29 02:27:33 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:27:33 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Successfully detached device vdb from instance f4703f38-74d3-4869-9504-c13d82920e40 from the persistent domain config.
Nov 29 02:27:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4703f38-74d3-4869-9504-c13d82920e40 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:27:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:27:33 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:27:33 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:27:33 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:27:33 user nova-compute[75210]:   <serial>b80c0792-5232-47db-82ff-bed69ed6b291</serial>
Nov 29 02:27:33 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:27:33 user nova-compute[75210]: </disk>
Nov 29 02:27:33 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:27:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:27:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:27:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:27:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:27:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:27:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:27:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:27:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:27:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:27:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:27:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:27:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:27:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:27:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:27:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:27:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:27:53 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f4703f38-74d3-4869-9504-c13d82920e40 is timed out.
Nov 29 02:27:53 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Successfully detached device vdb from instance f4703f38-74d3-4869-9504-c13d82920e40 from the live domain config.
Nov 29 02:27:53 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqvDSZPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:27:53 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:27:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43c0bc0-c832-457a-a198-ef4b6968ab4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:27:53 user nova-compute[75210]: No targets found.
Nov 29 02:27:53 user nova-compute[75210]: iSNS:
Nov 29 02:27:53 user nova-compute[75210]: No targets found.
Nov 29 02:27:53 user nova-compute[75210]: STATIC:
Nov 29 02:27:53 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291
Nov 29 02:27:53 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:27:53 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:27:53 user nova-compute[75210]: FIRMWARE:
Nov 29 02:27:53 user nova-compute[75210]: No targets found.
Nov 29 02:27:53 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:27:53 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:27:53 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cb5ade-e9af-40c5-854d-95a7d83dba7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9569b2-d813-421e-bbf9-054a3b17b304]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 (non-flash)
Nov 29 02:27:53 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 (non-flash)
Nov 29 02:27:53 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e81b5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:27:53 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[93246044-0313-41c5-bf21-c862d969cb36]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75304a1-9f5f-4801-91b9-7af00ef692ef]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f5cd38-e453-440b-93c7-450d18d89094]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd326ef-e82c-4bc8-be6f-dede1f581bdf]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca9fe6c-e046-4823-9ecc-02ee5adc9a55]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa845081-43a9-41e4-a326-f2af929db259]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291, portal: 172.16.0.220,3260]
Nov 29 02:27:54 user nova-compute[75210]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291, portal: 172.16.0.220,3260] successful.
Nov 29 02:27:54 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80c0792-5232-47db-82ff-bed69ed6b291 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[2851a5e3-f1eb-48a8-a81b-6eaa3658c588]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] <== disconnect_volume: return (289ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:27:54 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:27:55 user nova-compute[75210]: DEBUG nova.objects.instance [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'flavor' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:27:55 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-71d7c4f2-3310-42e7-9ea1-3978fa098ab5 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.790s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:27:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:28:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:28:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:02 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:28:03 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:28:04 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:28:06 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:28:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:28:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:28:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:28:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:08 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:28:08 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:28:08 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:28:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:28:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:28:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:28:08 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:28:08 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating instance_info_cache with network_info: [{"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:28:08 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:28:08 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:28:08 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:28:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:12 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:13 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:28:13 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:28:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=24.997112274169922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance f4703f38-74d3-4869-9504-c13d82920e40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing inventories for resource provider 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating ProviderTree inventory for provider 28871a06-d5c8-43d0-87af-3689cd143011 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Updating inventory in ProviderTree for provider 28871a06-d5c8-43d0-87af-3689cd143011 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing aggregate associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, aggregates: None {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Refreshing trait associations for resource provider 28871a06-d5c8-43d0-87af-3689cd143011, traits: HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE41,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA {{(pid=75210) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:28:13 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances with incomplete migration  {{(pid=75210) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 29 02:28:14 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:28:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:28:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:28:23 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:28:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Cleaning up deleted instances {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 29 02:28:23 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] There are 0 instances to clean {{(pid=75210) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'flavor' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:28:26 user nova-compute[75210]: INFO nova.compute.manager [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Attaching volume 367fb889-ec42-462e-9050-4c79d64bbde0 to /dev/vdb
Nov 29 02:28:26 user nova-compute[75210]: DEBUG os_brick.utils [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66e5b4e-afc6-492e-b9d1-7f295d0a4b2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0996c8-d2c9-471b-a0a1-a146b951b968]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[778bdddc-8b00-4bef-91c3-8806021b8cb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a514c56f-295e-4ca2-96e8-ba99b5997da5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:28:26 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:28:26 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f51fd47-6fa8-4d87-b6c9-c071ba7c7114]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG os_brick.utils [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:28:26 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating existing volume attachment record: 2f4310a8-03c4-4b4f-b3e3-385a0c4d0647 {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:28:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:28:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:28:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:28:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMFpgaAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:28:33 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:28:33 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:28:33 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[69090439-caab-49a0-b08a-1deea0dbd380]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:28:33 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d836e3e-fa61-44d0-9930-35749582542c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0] added
Nov 29 02:28:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[23035503-d0e2-41f5-87fe-3bf2cc0166b4]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[620ae37b-04b8-4596-bd0c-551ebbb8cc84]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMFpgaAY {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMFpgaAY" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca54cebb-7f24-46a1-9420-17d29bc65b41]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fMFpgaAY'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5206a053-6317-4ac1-b5bf-2885281be686]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3040a434-c882-427e-93c2-d29e246c351f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:28:33 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:28:33 user nova-compute[75210]:  {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:28:33 user nova-compute[75210]: WARNING os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 02:28:33 user nova-compute[75210]: 
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fecde4b-6411-4a95-b7a9-c3c99c5fddb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0, portal: 172.16.0.220,3260]
Nov 29 02:28:33 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0, portal: 172.16.0.220,3260] successful.
Nov 29 02:28:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d71429-0372-4b67-bf63-4f4bf44b7da9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42ac64c-f433-4a92-8510-ba440186faf7]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 (non-flash)
Nov 29 02:28:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 (non-flash)
Nov 29 02:28:33 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d584436-ba08-4f4b-922c-e04ae7e8b340]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:33 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:28:34 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:28:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMFpgaAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:28:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:28:34 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23135623831616461', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:28:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135623831616461', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:28:34 user nova-compute[75210]: DEBUG nova.objects.instance [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'flavor' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:28:34 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 02:28:34 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:28:34 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:28:34 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:28:34 user nova-compute[75210]:   <serial>367fb889-ec42-462e-9050-4c79d64bbde0</serial>
Nov 29 02:28:34 user nova-compute[75210]: </disk>
Nov 29 02:28:34 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 02:28:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:28:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:28:35 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No VIF found with MAC fa:16:3e:41:f1:51, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:28:35 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-c63beb9a-236d-4e15-82f9-1a9d6cd37e60 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.856s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:28:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:28:37 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:28:37 user nova-compute[75210]: INFO nova.compute.manager [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Detaching volume 367fb889-ec42-462e-9050-4c79d64bbde0
Nov 29 02:28:37 user nova-compute[75210]: INFO nova.virt.block_device [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Attempting to driver detach volume 367fb889-ec42-462e-9050-4c79d64bbde0 from mountpoint /dev/vdb
Nov 29 02:28:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Attempting to detach device vdb from instance f4703f38-74d3-4869-9504-c13d82920e40 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:28:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:28:37 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:28:37 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:28:37 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:28:37 user nova-compute[75210]:   <serial>367fb889-ec42-462e-9050-4c79d64bbde0</serial>
Nov 29 02:28:37 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:28:37 user nova-compute[75210]: </disk>
Nov 29 02:28:37 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:28:37 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Successfully detached device vdb from instance f4703f38-74d3-4869-9504-c13d82920e40 from the persistent domain config.
Nov 29 02:28:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4703f38-74d3-4869-9504-c13d82920e40 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:28:37 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:28:37 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:28:37 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:28:37 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:28:37 user nova-compute[75210]:   <serial>367fb889-ec42-462e-9050-4c79d64bbde0</serial>
Nov 29 02:28:37 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:28:37 user nova-compute[75210]: </disk>
Nov 29 02:28:37 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:28:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:28:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:28:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:28:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:28:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:28:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:28:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:28:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:28:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:28:57 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:28:58 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f4703f38-74d3-4869-9504-c13d82920e40 is timed out.
Nov 29 02:28:58 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Successfully detached device vdb from instance f4703f38-74d3-4869-9504-c13d82920e40 from the live domain config.
Nov 29 02:28:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMFpgaAY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:28:58 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc8fd3a-db5a-4122-a76c-699029f10055]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:28:58 user nova-compute[75210]: No targets found.
Nov 29 02:28:58 user nova-compute[75210]: iSNS:
Nov 29 02:28:58 user nova-compute[75210]: No targets found.
Nov 29 02:28:58 user nova-compute[75210]: STATIC:
Nov 29 02:28:58 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0
Nov 29 02:28:58 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:28:58 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:28:58 user nova-compute[75210]: FIRMWARE:
Nov 29 02:28:58 user nova-compute[75210]: No targets found.
Nov 29 02:28:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:28:58 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:28:58 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93767c8-9bb1-48a7-9fd3-f81ba692981f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a40d481-79b6-4c63-9ca7-34cdfcb836e3]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 (non-flash)
Nov 29 02:28:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 (non-flash)
Nov 29 02:28:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e870a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[99016fb4-3035-494e-9547-2dba5dbf8e8c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[236d0362-dcee-44fc-9426-08a87cde80b6]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da3fec0-5b6f-4bfd-8899-3875b0b91666]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[33063b1d-4123-4edf-8bbb-0b0310822cb0]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d19b9fb-b285-41d3-9ebf-8fff1199cfdb]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b74ff0-608d-4e0e-90d9-746bb72bee19]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0, portal: 172.16.0.220,3260]
Nov 29 02:28:58 user nova-compute[75210]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0, portal: 172.16.0.220,3260] successful.
Nov 29 02:28:58 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367fb889-ec42-462e-9050-4c79d64bbde0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e3ad5f-94e6-4f4c-88da-210b33b758b9]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] <== disconnect_volume: return (276ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:28:58 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:28:59 user nova-compute[75210]: DEBUG nova.objects.instance [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'flavor' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:28:59 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-7aac6548-432f-42f4-9feb-1a5e1c64e28a tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.651s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:29:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:29:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:29:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:29:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:29:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:03 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:29:04 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:29:04 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:29:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:29:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:29:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:29:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:29:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:08 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:29:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:29:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:29:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:29:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:29:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:29:10 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:29:10 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:29:10 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating instance_info_cache with network_info: [{"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:29:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:29:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:29:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:29:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:29:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:29:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:29:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:29:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:29:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:29:14 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:29:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:29:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:29:14 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:29:14 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:29:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:14 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:15 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:29:15 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:29:15 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=24.99610137939453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:29:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:29:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:29:15 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance f4703f38-74d3-4869-9504-c13d82920e40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:29:15 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:29:15 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:29:15 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:29:15 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:29:15 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:29:15 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:29:16 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:29:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:29:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:29:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:29:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:29:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:29:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG nova.objects.instance [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'flavor' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:29:31 user nova-compute[75210]: INFO nova.compute.manager [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Attaching volume 85b0a72e-e7e9-449e-b163-e2ce5eb62f8b to /dev/vdb
Nov 29 02:29:31 user nova-compute[75210]: DEBUG os_brick.utils [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[d419a360-f973-498a-8c1c-b27243dbdef5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a271e0227c1\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d0429f-2c60-4166-87db-142d5ae2d9ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cc7e4e-b08d-448e-9b3f-75abc393caa5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a352b8-3815-4f49-9ae9-3927e431556c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Running cmd (subprocess): nvme version {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] 'nvme version' failed. Not Retrying. {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] nvme not present on system {{(pid=75210) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 29 02:29:31 user nova-compute[75210]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 29 02:29:31 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[999c9ae2-78f2-45bc-ada3-6d5bfde11475]: (4, '') {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75210) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.lightos [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] LIGHTOS: no hostnqn found. {{(pid=75210) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG os_brick.utils [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a271e0227c1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:29:31 user nova-compute[75210]: DEBUG nova.virt.block_device [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating existing volume attachment record: 3081106d-a4a3-4c6d-947f-b0bf077f58ce {{(pid=75210) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 29 02:29:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:29:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:29:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:29:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:29:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Calling os-brick to attach iSCSI Volume {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMaowhjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:29:38 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:29:38 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:29:38 user nova-compute[75210]: INFO os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4167de5c-b65a-4960-86ba-c7122b7e2151]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 29 02:29:38 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --interface default --op new {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9756b1-031d-4384-9b52-9d8d1e3c00ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b] added\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b] added
Nov 29 02:29:38 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9b6185-b468-4fd0-bf90-a866819638c7]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fa8908-8073-471a-ab65-ab51852d62d1]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMaowhjN {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XMaowhjN" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae11fc1-4cf0-4bed-928c-6bf74b52c069]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XMaowhjN'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8b4f8d-ea59-4ac6-8b11-af0d1258fb9d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[4486b565-8fba-40f6-8412-a09843373c24]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:29:38 user nova-compute[75210]:  {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 29 02:29:38 user nova-compute[75210]:  {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:29:38 user nova-compute[75210]: WARNING os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 29 02:29:38 user nova-compute[75210]: 
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --login {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a52f4c-3553-496a-9ed2-0d62f629a20c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b, portal: 172.16.0.220,3260]
Nov 29 02:29:38 user nova-compute[75210]: Login to [iface: default, target: iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b, portal: 172.16.0.220,3260] successful.
Nov 29 02:29:38 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[3292a967-be60-4142-8c1a-b3a68c0dfaf5]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1667f8a8-fa50-4e65-90ef-ab01d293bcee]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b (non-flash)
Nov 29 02:29:38 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b (non-flash)
Nov 29 02:29:38 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Connected to 172.16.0.220:3260 {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75210) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75210) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e4ebc7-df0c-4532-8873-b4a38fe15b91]: (4, ('- - 0', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75210) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 29 02:29:38 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMaowhjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75210) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 29 02:29:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:29:39 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23032393634643465', 'path': '/dev/sdb'} {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:29:39 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032393634643465', 'path': '/dev/sdb'} {{(pid=75210) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 29 02:29:39 user nova-compute[75210]: DEBUG nova.objects.instance [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'flavor' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:29:39 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] attach device xml: <disk type="block" device="disk">
Nov 29 02:29:39 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:29:39 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:29:39 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:29:39 user nova-compute[75210]:   <serial>85b0a72e-e7e9-449e-b163-e2ce5eb62f8b</serial>
Nov 29 02:29:39 user nova-compute[75210]: </disk>
Nov 29 02:29:39 user nova-compute[75210]:  {{(pid=75210) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 29 02:29:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No BDM found with device name vda, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:29:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75210) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 29 02:29:40 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] No VIF found with MAC fa:16:3e:41:f1:51, not building metadata {{(pid=75210) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 29 02:29:40 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d4d6a015-ff07-414a-b4d7-287deb9654ec tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.995s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:29:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:29:42 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:29:42 user nova-compute[75210]: INFO nova.compute.manager [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Detaching volume 85b0a72e-e7e9-449e-b163-e2ce5eb62f8b
Nov 29 02:29:42 user nova-compute[75210]: INFO nova.virt.block_device [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Attempting to driver detach volume 85b0a72e-e7e9-449e-b163-e2ce5eb62f8b from mountpoint /dev/vdb
Nov 29 02:29:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Attempting to detach device vdb from instance f4703f38-74d3-4869-9504-c13d82920e40 from the persistent domain config. {{(pid=75210) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 29 02:29:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:29:42 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:29:42 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:29:42 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:29:42 user nova-compute[75210]:   <serial>85b0a72e-e7e9-449e-b163-e2ce5eb62f8b</serial>
Nov 29 02:29:42 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:29:42 user nova-compute[75210]: </disk>
Nov 29 02:29:42 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:29:42 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Successfully detached device vdb from instance f4703f38-74d3-4869-9504-c13d82920e40 from the persistent domain config.
Nov 29 02:29:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4703f38-74d3-4869-9504-c13d82920e40 from the live domain config. {{(pid=75210) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 29 02:29:42 user nova-compute[75210]: DEBUG nova.virt.libvirt.guest [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] detach device xml: <disk type="block" device="disk">
Nov 29 02:29:42 user nova-compute[75210]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 29 02:29:42 user nova-compute[75210]:   <source dev="/dev/sdb"/>
Nov 29 02:29:42 user nova-compute[75210]:   <target dev="vdb" bus="virtio"/>
Nov 29 02:29:42 user nova-compute[75210]:   <serial>85b0a72e-e7e9-449e-b163-e2ce5eb62f8b</serial>
Nov 29 02:29:42 user nova-compute[75210]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 29 02:29:42 user nova-compute[75210]: </disk>
Nov 29 02:29:42 user nova-compute[75210]:  {{(pid=75210) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 29 02:29:43 user nova-compute[75210]: DEBUG nova.virt.libvirt.driver [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 29 02:29:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:29:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:29:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:29:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:29:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:29:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:29:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:30:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:30:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:30:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:30:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:03 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f4703f38-74d3-4869-9504-c13d82920e40 is timed out.
Nov 29 02:30:03 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Successfully detached device vdb from instance f4703f38-74d3-4869-9504-c13d82920e40 from the live domain config.
Nov 29 02:30:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] calling os-brick to detach iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f23e86c9150>, {'target_iqn': 'iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XMaowhjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 29 02:30:03 user nova-compute[75210]: WARNING os_brick.initiator.connectors.base [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[130a01f0-b327-4026-9505-808e079e75bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 29 02:30:03 user nova-compute[75210]: No targets found.
Nov 29 02:30:03 user nova-compute[75210]: iSNS:
Nov 29 02:30:03 user nova-compute[75210]: No targets found.
Nov 29 02:30:03 user nova-compute[75210]: STATIC:
Nov 29 02:30:03 user nova-compute[75210]: Target: iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b
Nov 29 02:30:03 user nova-compute[75210]:         Portal: 172.16.0.220:3260,-1
Nov 29 02:30:03 user nova-compute[75210]:                 Iface Name: default
Nov 29 02:30:03 user nova-compute[75210]: FIRMWARE:
Nov 29 02:30:03 user nova-compute[75210]: No targets found.
Nov 29 02:30:03 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 29 02:30:03 user nova-compute[75210]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 29 02:30:03 user nova-compute[75210]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75210) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b', 0)] {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b865bb-7601-45c1-b408-383c5ce52943]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b99da42-62e1-404e-832b-966b4d5c4ed4]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b (non-flash)\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b (non-flash)
Nov 29 02:30:03 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b (non-flash)
Nov 29 02:30:03 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f23e870a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b'): ({'sdb'}, set())}) {{(pid=75210) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Removing single pathed devices sdb {{(pid=75210) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b67827-c9cf-46f7-ac7d-83cbc014bf46]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71d1685-b9d7-4316-9480-14d7cf36bdf0]: (4, ('ok\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Flushing IO for device /dev/sdb {{(pid=75210) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b84dd29-a988-414a-aea9-76f7d3e2296d]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75210) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef49ef5-91bb-400f-b280-0570be137eef]: (4, ('1', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.linuxscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] SCSI volumes sdb have been removed. {{(pid=75210) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b')] {{(pid=75210) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c13321-07e7-4f4f-91f9-fefd7c7bb3b3]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --logout {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeb431c-418e-422b-8a36-c2d8c07e8b6a]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b, portal: 172.16.0.220,3260]
Nov 29 02:30:03 user nova-compute[75210]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b, portal: 172.16.0.220,3260] successful.
Nov 29 02:30:03 user nova-compute[75210]:  stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op delete {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85b0a72e-e7e9-449e-b163-e2ce5eb62f8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85542) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b705d6b-7a14-49a0-8b3a-5b4c99cb6f8e]: (4, ('', '')) {{(pid=85542) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75210) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.base [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] <== disconnect_volume: return (290ms) None {{(pid=75210) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 29 02:30:03 user nova-compute[75210]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Disconnected iSCSI Volume {{(pid=75210) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 29 02:30:04 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:30:04 user nova-compute[75210]: DEBUG nova.objects.instance [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'flavor' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:30:04 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-d2e2449a-cd27-47ef-98e9-ce9ec9b2c132 tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.781s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:30:05 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:30:05 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:30:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:30:08 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:30:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:30:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:30:10 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:30:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 29 02:30:10 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquired lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 29 02:30:10 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Forcefully refreshing network info cache for instance {{(pid=75210) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 29 02:30:10 user nova-compute[75210]: DEBUG nova.objects.instance [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lazy-loading 'info_cache' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:30:11 user nova-compute[75210]: DEBUG nova.network.neutron [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating instance_info_cache with network_info: [{"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:30:11 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Releasing lock "refresh_cache-f4703f38-74d3-4869-9504-c13d82920e40" {{(pid=75210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 29 02:30:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updated the network info_cache for instance {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 29 02:30:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:30:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:30:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:12 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:30:12 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:30:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:30:16 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:30:16 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:30:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:30:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:30:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:30:16 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:30:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:30:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:30:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 29 02:30:16 user nova-compute[75210]: DEBUG oslo_concurrency.processutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 29 02:30:17 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:30:17 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:30:17 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=24.995147705078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:30:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:30:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:30:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:30:17 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Instance f4703f38-74d3-4869-9504-c13d82920e40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75210) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 29 02:30:17 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:30:17 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:30:17 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:30:17 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:30:17 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:30:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:30:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:30:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:30:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:30:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:30:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:30:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:30:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:30:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:30:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:30:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:30:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:30:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:30:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:30:56 user nova-compute[75210]: INFO nova.compute.manager [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Terminating instance
Nov 29 02:30:56 user nova-compute[75210]: DEBUG nova.compute.manager [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Start destroying the instance on the hypervisor. {{(pid=75210) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-cbf60770-92f8-4c57-b1eb-5880fcc1d410 req-f7d510fd-7694-4a05-8843-58ccc4b62922 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Received event network-vif-unplugged-007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cbf60770-92f8-4c57-b1eb-5880fcc1d410 req-f7d510fd-7694-4a05-8843-58ccc4b62922 service nova] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cbf60770-92f8-4c57-b1eb-5880fcc1d410 req-f7d510fd-7694-4a05-8843-58ccc4b62922 service nova] Lock "f4703f38-74d3-4869-9504-c13d82920e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-cbf60770-92f8-4c57-b1eb-5880fcc1d410 req-f7d510fd-7694-4a05-8843-58ccc4b62922 service nova] Lock "f4703f38-74d3-4869-9504-c13d82920e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-cbf60770-92f8-4c57-b1eb-5880fcc1d410 req-f7d510fd-7694-4a05-8843-58ccc4b62922 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] No waiting events found dispatching network-vif-unplugged-007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:30:56 user nova-compute[75210]: DEBUG nova.compute.manager [req-cbf60770-92f8-4c57-b1eb-5880fcc1d410 req-f7d510fd-7694-4a05-8843-58ccc4b62922 service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Received event network-vif-unplugged-007c844b-e8f8-4126-8117-633546ce0901 for instance with task_state deleting. {{(pid=75210) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:57 user nova-compute[75210]: INFO nova.virt.libvirt.driver [-] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Instance destroyed successfully.
Nov 29 02:30:57 user nova-compute[75210]: DEBUG nova.objects.instance [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lazy-loading 'resources' on Instance uuid f4703f38-74d3-4869-9504-c13d82920e40 {{(pid=75210) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG nova.virt.libvirt.vif [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-29T02:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1529088599',display_name='tempest-SnapshotDataIntegrityTests-server-1529088599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1529088599',id=53,image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFG4DltvjF5lbu72RMZghf7r4GkMpKCzluXG1IBM4/clz8F7lPtJkXjFzY4Ini0baBvE0tIp95wOHp9Nqe99ncqqWpaGhfLlq3O8x90Q0jeZVT9nxAEvcSuVIj1elKctg==',key_name='tempest-keypair-1232023627',keypairs=<?>,launch_index=0,launched_at=2023-11-29T02:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b659cbef61b45dc8cd0267caabba7c8',ramdisk_id='',reservation_id='r-pc7xdrdz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7071ee05-5aa5-4613-b78b-8f17b0ec59bc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-724313800',owner_user_name='tempest-SnapshotDataIntegrityTests-724313800-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-29T02:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05ff57f6ad942be9ae508c534cc5d19',uuid=f4703f38-74d3-4869-9504-c13d82920e40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Converting VIF {"id": "007c844b-e8f8-4126-8117-633546ce0901", "address": "fa:16:3e:41:f1:51", "network": {"id": "5de3924e-c420-415b-9726-6dbcddb2fb20", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-201511258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b659cbef61b45dc8cd0267caabba7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007c844b-e8", "ovs_interfaceid": "007c844b-e8f8-4126-8117-633546ce0901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG nova.network.os_vif_util [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=007c844b-e8f8-4126-8117-633546ce0901,network=Network(5de3924e-c420-415b-9726-6dbcddb2fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007c844b-e8') {{(pid=75210) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG os_vif [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=007c844b-e8f8-4126-8117-633546ce0901,network=Network(5de3924e-c420-415b-9726-6dbcddb2fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007c844b-e8') {{(pid=75210) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap007c844b-e8, bridge=br-int, if_exists=True) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30354885-8c2b-4024-a60d-c0a956ba8077) {{(pid=75210) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:30:57 user nova-compute[75210]: INFO os_vif [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:f1:51,bridge_name='br-int',has_traffic_filtering=True,id=007c844b-e8f8-4126-8117-633546ce0901,network=Network(5de3924e-c420-415b-9726-6dbcddb2fb20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007c844b-e8')
Nov 29 02:30:57 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Deleting instance files /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40_del
Nov 29 02:30:57 user nova-compute[75210]: INFO nova.virt.libvirt.driver [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Deletion of /opt/stack/data/nova/instances/f4703f38-74d3-4869-9504-c13d82920e40_del complete
Nov 29 02:30:57 user nova-compute[75210]: INFO nova.compute.manager [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 29 02:30:57 user nova-compute[75210]: DEBUG oslo.service.loopingcall [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75210) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG nova.compute.manager [-] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Deallocating network for instance {{(pid=75210) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: f4703f38-74d3-4869-9504-c13d82920e40] deallocate_for_instance() {{(pid=75210) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG nova.network.neutron [-] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Updating instance_info_cache with network_info: [] {{(pid=75210) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 29 02:30:57 user nova-compute[75210]: INFO nova.compute.manager [-] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Took 0.61 seconds to deallocate network for instance.
Nov 29 02:30:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:30:57 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:30:58 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:30:58 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:30:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:30:58 user nova-compute[75210]: INFO nova.scheduler.client.report [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Deleted allocations for instance f4703f38-74d3-4869-9504-c13d82920e40
Nov 29 02:30:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-9ac9e089-9aea-4596-99e2-9f97f8e3a9cd tempest-SnapshotDataIntegrityTests-724313800 tempest-SnapshotDataIntegrityTests-724313800-project-member] Lock "f4703f38-74d3-4869-9504-c13d82920e40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.813s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:30:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-099a9c1b-3530-4485-a9de-0ef8105f50b8 req-42f27c11-c692-46bc-bb74-2588e2cc6b0b service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Received event network-vif-plugged-007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:30:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-099a9c1b-3530-4485-a9de-0ef8105f50b8 req-42f27c11-c692-46bc-bb74-2588e2cc6b0b service nova] Acquiring lock "f4703f38-74d3-4869-9504-c13d82920e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:30:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-099a9c1b-3530-4485-a9de-0ef8105f50b8 req-42f27c11-c692-46bc-bb74-2588e2cc6b0b service nova] Lock "f4703f38-74d3-4869-9504-c13d82920e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:30:58 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [req-099a9c1b-3530-4485-a9de-0ef8105f50b8 req-42f27c11-c692-46bc-bb74-2588e2cc6b0b service nova] Lock "f4703f38-74d3-4869-9504-c13d82920e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:30:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-099a9c1b-3530-4485-a9de-0ef8105f50b8 req-42f27c11-c692-46bc-bb74-2588e2cc6b0b service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] No waiting events found dispatching network-vif-plugged-007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 29 02:30:58 user nova-compute[75210]: WARNING nova.compute.manager [req-099a9c1b-3530-4485-a9de-0ef8105f50b8 req-42f27c11-c692-46bc-bb74-2588e2cc6b0b service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Received unexpected event network-vif-plugged-007c844b-e8f8-4126-8117-633546ce0901 for instance with vm_state deleted and task_state None.
Nov 29 02:30:58 user nova-compute[75210]: DEBUG nova.compute.manager [req-099a9c1b-3530-4485-a9de-0ef8105f50b8 req-42f27c11-c692-46bc-bb74-2588e2cc6b0b service nova] [instance: f4703f38-74d3-4869-9504-c13d82920e40] Received event network-vif-deleted-007c844b-e8f8-4126-8117-633546ce0901 {{(pid=75210) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 29 02:31:00 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:31:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:31:05 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:31:06 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:31:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:31:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:31:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:31:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:31:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:31:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:31:07 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:31:09 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:31:11 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:31:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:31:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:31:11 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Didn't find any instances for network info cache update. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 29 02:31:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:31:14 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:31:14 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:31:14 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75210) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 29 02:31:16 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:31:16 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager.update_available_resource {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:31:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:31:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:31:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:31:16 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Auditing locally available compute resources for user (node: user) {{(pid=75210) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 29 02:31:16 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:31:16 user nova-compute[75210]: WARNING nova.virt.libvirt.driver [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 29 02:31:16 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Hypervisor/Node resource view: name=user free_ram=9124MB free_disk=25.014495849609375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75210) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 29 02:31:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 29 02:31:16 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 29 02:31:16 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 29 02:31:16 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75210) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 29 02:31:16 user nova-compute[75210]: DEBUG nova.compute.provider_tree [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed in ProviderTree for provider: 28871a06-d5c8-43d0-87af-3689cd143011 {{(pid=75210) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 29 02:31:16 user nova-compute[75210]: DEBUG nova.scheduler.client.report [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Inventory has not changed for provider 28871a06-d5c8-43d0-87af-3689cd143011 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75210) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 29 02:31:17 user nova-compute[75210]: DEBUG nova.compute.resource_tracker [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Compute_service record updated for user:user {{(pid=75210) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 29 02:31:17 user nova-compute[75210]: DEBUG oslo_concurrency.lockutils [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75210) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 29 02:31:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:31:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:31:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:31:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:31:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:31:17 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:31:22 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:31:27 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:31:32 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:31:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:31:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:31:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75210) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 29 02:31:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:31:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75210) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 29 02:31:37 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:31:42 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:31:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:31:47 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:31:50 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:31:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:31:52 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:31:57 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:32:02 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:32:07 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:32:07 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:32:07 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 29 02:32:09 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:32:10 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:32:11 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:32:12 user nova-compute[75210]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75210) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 29 02:32:13 user nova-compute[75210]: DEBUG oslo_service.periodic_task [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75210) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 29 02:32:13 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Starting heal instance info cache {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 29 02:32:13 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Rebuilding the list of instances to heal {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 29 02:32:13 user nova-compute[75210]: DEBUG nova.compute.manager [None req-119b4f2d-2515-4c27-a108-5f35b0fa9fdb None None] Didn't find any instances for network info cache update. {{(pid=75210) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}